Scientific Definition
Reduced vigilance with automated systems.
Plain-English Definition
Reduced vigilance with automated systems.
Feynman Explanation
Human-in-the-loop is fine until the human isn't.
Core Principle
Reduced vigilance with automated systems.
Mechanisms
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
Human-in-the-loop is fine until the human isn't.
Examples
- Aviation, manufacturing, and now AI agents.
- Predictable human factor in oversight systems.
Pending editorial review.
Famous Experiments
Pending editorial review.
Design Principles
- Designed friction. Periodic manual exercises. Active monitoring.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Designed friction. Periodic manual exercises. Active monitoring.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
Treating AI as more humanlike than it is.
Quantifying uncertainty in model outputs.
Confident outputs that are factually wrong.
Matching trust in a system to its actual reliability.
Augment when judgment matters. Automate when scale matters.
Written rules about how AI may be used internally.
Innovators → early adopters → majority → laggards, AI-specific.
AI system that takes actions to achieve goals, often across tools.
When the agent acts, who's responsible?
Augmentation strategy vs. substitution strategy.
Logging of AI inputs, outputs, and decisions.
Inventory of models, data, tools, and dependencies in an AI system.