Automation Bias is favoring suggestions from automated systems over conflicting human judgment. It sits in the Cognition dimension (COG) of the Human Behavior Taxonomy™ as element HBT-COG-0075, within the Decision family. The core principle: favoring suggestions from automated systems over conflicting human judgment. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
Scientific Definition
Favoring suggestions from automated systems over conflicting human judgment.
Plain-English Definition
Favoring suggestions from automated systems over conflicting human judgment.
Feynman Explanation
If the dashboard says it, it must be true.
Core Principle
Favoring suggestions from automated systems over conflicting human judgment.
Mechanisms
Pending editorial review.
Favoring suggestions from automated systems over conflicting human judgment.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
AI-era decision-making is structurally vulnerable to this bias.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
If the dashboard says it, it must be true.
Examples
- Ignoring a sales rep's intuition because the forecast model disagrees.
- AI-era decision-making is structurally vulnerable to this bias.
Pending editorial review.
Original analysis from The Incentives Lab — how this element behaves inside real payoff structures.
Why this element matters to incentive design
This element is common enough to feel like human nature and specific enough to be engineered around. The mechanism underneath it is straightforward: favoring suggestions from automated systems over conflicting human judgment. You can recognize it in the field by its signature: if the dashboard says it, it must be true. Every element in the Cognition dimension changes the perceived payoff of an action before the action happens, which is exactly where incentive design has leverage.
How it gets exploited
Left undesigned, aI-era decision-making is structurally vulnerable to this bias. It is amplified whenever aI-era decision-making is structurally vulnerable to this bias. Inside organizations that shows up as aI-era decision-making is structurally vulnerable to this bias. The pattern is the same one Goodhart's Law describes: the measurable proxy attracts the effort, and the purpose behind it quietly loses funding.
How the Lab designs around it
The redesign move is to pair every model output with the question: 'What would override this?'. Treat it as infrastructure. Once you can see it in your own system, most of the argument about culture resolves itself.
Famous Experiments
Pending editorial review.
Design Principles
- Pair every model output with the question: 'What would override this?'
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Pair every model output with the question: 'What would override this?'
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
Our perception is shaped by what we selectively pay attention to.
Two options seen side-by-side look more different than they are in isolation.
We choose more variety than we'll actually want when picking for the future all at once.
We overestimate the intensity and duration of emotional reactions.
Judging a decision by its outcome rather than by the quality of the process.
How will I feel about this in 10 minutes / 10 months / 10 years?
Inattention or forgetfulness caused by low attention, hyperfocus, or distraction.
Forgetting to compare an offer with the next-best alternative.
Outcomes that could have happened but did not.
Overthinking a situation so that decision-making stalls.
The first number on the table silently sets the range for every number after it.
Tversky & Kahneman's classic: identical outcomes flip from 'risk averse' to 'risk seeking' when framed as lives saved vs. lives lost.
Where Automation Bias is cited in the corpus
Essays, field guides, and diagnostics from The Incentives Lab that apply this element.
- EssayGoodhart's Law in the Real World
How measurable proxies capture judgment.
- EssayThe Perverse Incentives Hiding in Your KPIs
Cognitive shortcuts turned into scorecards.
- EssayAI Agents Inherit Your Incentives
How this element propagates into automated systems.
- ReferenceThe Periodic Table of Human Behavior
The full 1,267-element map this page belongs to.
- ReferenceThe incentive glossary
Definitions for every mental model, bias, and fallacy in the corpus.
Questions about Automation Bias
- What is Automation Bias?
- Automation Bias is favoring suggestions from automated systems over conflicting human judgment. It sits in the Cognition dimension (COG) of the Human Behavior Taxonomy™ as element HBT-COG-0075, within the Decision family. The core principle: favoring suggestions from automated systems over conflicting human judgment. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
- What is an example of Automation Bias?
- AI-era decision-making is structurally vulnerable to this bias. The Incentives Lab catalogs everyday, organizational, and historical instances of this element on its Human Behavior Taxonomy™ page (HBT-COG-0075).
- How is Automation Bias exploited?
- AI-era decision-making is structurally vulnerable to this bias.
- How do you design around Automation Bias?
- Pair every model output with the question: 'What would override this?'
- Which behavioral dimension does Automation Bias belong to?
- Automation Bias is classified in the Cognition dimension (COG) of the Human Behavior Taxonomy™, family "Decision", class "Mental Model". Its permanent identifier is HBT-COG-0075 and its evidence grade is B.