L3VLUP
Concepts

Bias reproduced at scale

A model trained on a biased outcome reproduces the bias at scale and with a straight face.

1 idea that carry it

  • ArgumentArtificial intelligenceBook

    A model trained on a biased outcome will reproduce it at scale

    A model predicts the past decisions in its training data; if those were biased, the model is a bias machine with a straight face.

    Any model used on people, credit underwriting, hiring tools, and AI governance questions in a bank.

    From Weapons of Math Destruction · Cathy O’Neil