What are the primary sources of bias in AI models as discussed in the chapter?
The primary sources of bias in AI models include historical data imbalances, flawed feature selection, and self-reinforcing feedback loops.
Bias in AI models primarily originates from three main sources: historical data imbalances, flawed feature selection, and feedback loops. Historical data often contains past discriminatory practices, such as redlining in mortgage lending, which AI models can replicate if trained on such data. Flawed feature selection can introduce bias when proxies for sensitive attributes, like ZIP codes correlating with race, are used. Feedback loops exacerbate bias by reinforcing existing disparities, such as when AI systems disproportionately flag transactions from certain demographics, leading to reduced access to financial services for those groups.
Key points
- Bias originates from historical data imbalances, flawed feature selection, and feedback loops.
- Historical data can reflect past discriminatory practices, leading AI to replicate these biases.
- Feature selection can introduce bias if proxies for sensitive attributes are included.
- Feedback loops reinforce existing disparities, perpetuating cycles of exclusion.
- AI models trained on biased data may deny services to marginalized groups.
Related questions
AI and ML Governance in Financial Services
Richard Gwashy Young
Routledge, Taylor & Francis Group