Bias in AI Systems is systematic skew in model behavior across groups. It sits in the Incentives dimension (INC) of the Human Behavior Taxonomy™ as element HBT-INC-0039, within the Risk family. The core principle: systematic skew in model behavior across groups. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
Scientific Definition
Systematic skew in model behavior across groups.
Plain-English Definition
Systematic skew in model behavior across groups.
Feynman Explanation
The model learned what the data taught it. The data taught it our history.
Core Principle
Systematic skew in model behavior across groups.
Mechanisms
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
The model learned what the data taught it. The data taught it our history.
Examples
- Hiring tools, lending models, recommendation systems.
- Legal, reputational, and effectiveness risk.
Pending editorial review.
Original analysis from The Incentives Lab — how this element behaves inside real payoff structures.
Why this element matters to incentive design
This is one of the elements leaders describe as a values gap. It is a payoff gap. The mechanism underneath it operates in the Incentives dimension — what makes behavior more or less likely?. You can recognize it in the field by its signature: the model learned what the data taught it. The data taught it our history. Every element in the Incentives dimension changes the perceived payoff of an action before the action happens, which is exactly where incentive design has leverage.
How it gets exploited
Left undesigned, legal, reputational, and effectiveness risk. It is amplified whenever legal, reputational, and effectiveness risk. Inside organizations that shows up as legal, reputational, and effectiveness risk. The pattern is the same one Goodhart's Law describes: the measurable proxy attracts the effort, and the purpose behind it quietly loses funding.
How the Lab designs around it
The redesign move is to bias audits. Diverse data. Continuous monitoring. Watch for it at the boundaries: handoffs, promotions, incident reviews, and budget cycles are where this element gets its power.
Famous Experiments
Pending editorial review.
Design Principles
- Bias audits. Diverse data. Continuous monitoring.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Bias audits. Diverse data. Continuous monitoring.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
When the agent acts, who's responsible?
Categorizing AI use cases by risk level.
Testing model behavior on hypothetical alternate inputs.
Adding noise to data to protect individual privacy.
Quantitative measures of model behavior across groups.
Training models across devices without centralizing data.
Bypassing model safety constraints.
Individual speed gains hide collective quality decline.
Malicious instructions hidden in user input or retrieved content.
Adversarial testing of AI systems.
Foundational skills erode through AI offloading.
Concentration risk on a single AI provider.
Where Bias in AI Systems is cited in the corpus
Essays, field guides, and diagnostics from The Incentives Lab that apply this element.
- Field guideIncentives: definition, types, examples
The parent field guide for this element.
- ReferenceThe laws of incentives
Goodhart, Campbell, and the Cobra Effect.
- EssayAI Agents Inherit Your Incentives
How this element propagates into automated systems.
- EssayIncentives Under Crisis
How this element behaves under pressure.
- ReferenceThe Periodic Table of Human Behavior
The full 1,267-element map this page belongs to.
- ReferenceThe incentive glossary
Definitions for every mental model, bias, and fallacy in the corpus.
Questions about Bias in AI Systems
- What is Bias in AI Systems?
- Bias in AI Systems is systematic skew in model behavior across groups. It sits in the Incentives dimension (INC) of the Human Behavior Taxonomy™ as element HBT-INC-0039, within the Risk family. The core principle: systematic skew in model behavior across groups. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
- What is an example of Bias in AI Systems?
- Legal, reputational, and effectiveness risk. The Incentives Lab catalogs everyday, organizational, and historical instances of this element on its Human Behavior Taxonomy™ page (HBT-INC-0039).
- How is Bias in AI Systems exploited?
- Legal, reputational, and effectiveness risk.
- How do you design around Bias in AI Systems?
- Bias audits. Diverse data. Continuous monitoring.
- Which behavioral dimension does Bias in AI Systems belong to?
- Bias in AI Systems is classified in the Incentives dimension (INC) of the Human Behavior Taxonomy™, family "Risk", class "AI-Behavioral Coupling". Its permanent identifier is HBT-INC-0039 and its evidence grade is C.