We need to be vigilant about how we design and train these machine-learning systems, or we will see ingrained forms of bias built into the artificial intelligence of the future.
Interpretation
We must carefully manage how we create AI systems to prevent bias in their outcomes.
This quote by Kate Crawford emphasizes the importance of being vigilant in the design and training of machine-learning systems. It warns that without careful attention, biases prevalent in society can be embedded in artificial intelligence, leading to negative consequences in how these technologies function and affect our lives in the future.
In practice
In a panel discussion on AI ethics, this quote could highlight the need for accountability in technology development.
If you're not thinking about the way systemic bias can be propagated through the criminal justice system or predictive policing, then it's very likely that, if you're designing a system based on historical data, you're going to be perpetuating those biases.
As we move into an era in which personal devices are seen as proxies for public needs, we run the risk that already-existing inequities will be further entrenched. Thus, with every big data set, we need to ask which people are excluded. Which places are less visible? What happens if you live in the shadow of big data sets?
Only by developing a deeper understanding of AI systems as they act in the world can we ensure that this new infrastructure never turns toxic.
It is a failure of imagination and methodology to claim that it is necessary to experiment on millions of people without their consent in order to produce good data science.
The fear isn't that big data discriminates. We already know that it does. It's that you don't know if you've been discriminated against.
If you have rooms that are very homogeneous, that have all had the same life experiences and educational backgrounds, and they're all relatively wealthy, their perspective on the world is going to mirror what they already know. That can be dangerous when we're making systems that will affect so many diverse populations.
The programmer, like the poet, works only slightly removed from pure thought-stuff. He builds his castles in the air, from air, creating by exertion of the imagination. Few media of creation are so flexible, so easy to polish and rework, so readily capable of realizing grand conceptual structures.
Nobody reads the disclosures that roll down your computer screen. You click 'I agree' but you don't know what you're agreeing to.
Why commit technological suicide by restricting the flow of talent into the United States?
Overnight the digital age had changed the course of history for our company. Everything that we thought was in our control no longer was. But within a year we had invested in social media and digital experts. Now Starbucks is the number one brand on Facebook.
Marketers use big data profiling to predict who is about to get pregnant, who is likely to buy a new car, and who is about to change sexual orientations. That's how they know what ads to send to whom. The NSA, meanwhile, wants to know who is likely to commit an act of terrorism - and for this, they need us.
Software is eating the world, but AI is going to eat software.
Subscribe for the occasional hand-picked quote. No noise.