Training Data Is a Mirror, Not a Window
People talk about training data as if it's a window onto reality — a clear view of how the world works. It's not. It's a mirror, and it reflects the world as it was when the data was collected: the unfair parts included.
Historical hiring data reflects who got hired, not who was qualified. Historical lending data reflects who got loans, not who was creditworthy. Historical policing data reflects where police patrolled, not where harm happened. Train on the mirror and the AI learns the reflection — then treats it as truth about the future.
In plain English: your model isn't learning how the world should work. It's learning how it did work, for better and worse.
This changes how you evaluate data. Don't just ask "is this dataset large and clean?" Ask "what history does this dataset carry, and do we want to repeat it?" Sometimes the answer is to rebalance, sometimes to supplement, sometimes to choose different data entirely.
A mirror is useful — but only if you remember you're looking at a reflection, not reality.
I explain frameworks; I don't give legal counsel.
Related consulting: AI governance · All services
I explain frameworks; I don't give legal counsel.
