EbookQA
ExplanationIntermediate

What are the primary sources of bias in AI models as discussed in the chapter?

The primary sources of bias in AI models include historical data imbalances, flawed feature selection, and self-reinforcing feedback loops.

Bias in AI models primarily originates from three main sources: historical data imbalances, flawed feature selection, and feedback loops. Historical data often contains past discriminatory practices, such as redlining in mortgage lending, which AI models can replicate if trained on such data. Flawed feature selection can introduce bias when proxies for sensitive attributes, like ZIP codes correlating with race, are used. Feedback loops exacerbate bias by reinforcing existing disparities, such as when AI systems disproportionately flag transactions from certain demographics, leading to reduced access to financial services for those groups.

Key points

  • Bias originates from historical data imbalances, flawed feature selection, and feedback loops.
  • Historical data can reflect past discriminatory practices, leading AI to replicate these biases.
  • Feature selection can introduce bias if proxies for sensitive attributes are included.
  • Feedback loops reinforce existing disparities, perpetuating cycles of exclusion.
  • AI models trained on biased data may deny services to marginalized groups.
Source:AI and ML Governance in Financial Services· Model Risk Management (MRM) and Validation· p. 77–90

Related questions

Cover of AI and ML Governance in Financial Services

AI and ML Governance in Financial Services

Richard Gwashy Young

Routledge, Taylor & Francis Group

View this ebook