Automation Complacency
Reduced vigilance with automated systems.
"Human-in-the-loop is fine until the human isn't."
What is Automation Complacency? Reduced vigilance with automated systems. Predictable human factor in oversight systems.
Aviation, manufacturing, and now AI agents.
Predictable human factor in oversight systems.
Designed friction. Periodic manual exercises. Active monitoring.
A radiologist uses an AI that flags 99% of tumors. After 6 months, scans the AI marks 'clear' are reviewed for an average of 8 seconds instead of 4 minutes. A tumor the AI missed gets through. Whose failure?
Pick a reaction to Automation Complacency
One tap. We'll point you at the most useful next surface based on how this hits.
The full taxonomy entry
Every concept in the Atlas uses the same structure — so Automation Complacency can be compared, recombined, and cited like an element on a periodic table.
- Business
- Leadership
- Government
- Healthcare
- Education
- Sales
- Marketing
- AI
- Negotiation
- Media
- Public Policy
- Relationships
- Where in our org would Automation Complacency most often show up unnoticed?
- Which metric, ritual, or contract clause quietly rewards Automation Complacency?
- If we removed every payoff for Automation Complacency, what behavior would replace it?
- Who benefits when Automation Complacency persists — and who pays the cost?
- People defend the status quo using the language of automation complacency.
- Decisions cluster around the easiest narrative rather than the strongest evidence.
- New data changes the slide deck but not the decision.
- Anyone naming the pattern is treated as the problem.
Every Atlas entry is a node in a knowledge graph. See the related rail below to follow the connections.
See Automation Complacency through 4 lenses
Each layer of the Incentives OS reframes this concept with its own thinkers, vocabulary, and diagnostic question.
- Layer 8Organizational Psychology
What is the org actually rewarding — versus claiming to reward?
- Layer 11Economics & Mechanism Design
Who pays, who is paid, and what does the price signal hide?
- Layer 13Leadership
What kind of leadership move does this situation actually require?
- Layer 15AI & Alignment
What proxy reward is the AI optimizing — and what is it ignoring?
Do you actually know Automation Complacency?
Three quick questions. Result is saved into your review streak — come back when the term is due to lock it in.
Which best describes Automation Complacency?
Worked example, counter-example & concept map
On-demand AI analysis grounded in the Lab's research. Cached on your device after first run.
When you encounter Automation Complacency, your amygdala tags it as threat before your reasoning brain even knows what happened — and threat wins the first move.
Threat detection, fear, social pain, loss aversion, fast emotional tagging. Loss feels roughly twice as bad as equivalent gain feels good. Social rejection lights up the same circuits as physical pain.
See Amygdala in the Brain Atlas →Picked for you, from the Atlas
Ranked by shared learning paths, overlapping chips, and what you've saved.
Treating AI as more humanlike than it is.
Quantifying uncertainty in model outputs.
Confident outputs that are factually wrong.
Matching trust in a system to its actual reliability.
Written rules about how AI may be used internally.
Innovators → early adopters → majority → laggards, AI-specific.
Send the card, not just the link
A pre-rendered social card with the title, eyebrow, and URL. Copy the link, post it anywhere, or download the SVG for slides.
More definitions to follow
Every term in the Atlas connects to a dozen others. Pick any of these and see where it takes you.
Mental discomfort from holding conflicting beliefs or values.
Celebrating overwork normalizes burnout and crowds out rest, family, and craft.
We say yes more often to people we like.
Ambitious objectives paired with measurable key results.
The sense of where the body is in space.
Trained skill of noticing micro-changes — breathing, skin tone, micro-expressions, voice tempo — in real time.
Rule of capture rewards extraction before competitors do.
The minimum energy needed to start a reaction; same idea for starting habits or initiatives.
Disagreement grows more extreme as the parties think more about the issue.
Underpriced externalities keep dirty energy artificially competitive.
Retroactive extensions privilege legacy estates over public-domain enrichment.
Drawing conclusions about individuals from group-level data.