Scientific Definition
Confident incorrect outputs may rank higher than hedged correct ones.
Plain-English Definition
Confident incorrect outputs may rank higher than hedged correct ones.
Feynman Explanation
Truth doesn't trend in LLMs either.
Core Principle
Confident incorrect outputs may rank higher than hedged correct ones.
Mechanisms
Pending editorial review.
Confident incorrect outputs may rank higher than hedged correct ones.
Pending editorial review.
Pending editorial review.
Trust erosion through optimization for the wrong signal.
Pending editorial review.
Pending editorial review.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
Truth doesn't trend in LLMs either.
Examples
- Models trained on human feedback that rewards confident assertions.
- Trust erosion through optimization for the wrong signal.
Pending editorial review.
Famous Experiments
Pending editorial review.
Design Principles
- Reward calibrated uncertainty in model training and evaluation.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Reward calibrated uncertainty in model training and evaluation.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
Autonomous agents deployed before liability frameworks exist.
Individual productivity gains hide collective output degradation.
AI generates content; AI scrapes content; AI trains on its own output.
Models optimized for plausible-sounding answers can hallucinate confidently rather than say 'I don't know.'
Recommenders optimizing engagement produce radicalization as a byproduct.
Outrage outperforms accuracy on every engagement metric.
Discount framing nudges people to buy things they wouldn't otherwise want.
Productivity targets compress visits, raising misdiagnosis and burnout.
A federal mandate intended to lower drug costs for the poor became a profit engine for hospitals and contract pharmacies.
Earn-outs designed to retain founders often demotivate the team they bought.
Funnels rewarded for new logos under-invest in retention and lifetime value.
Free products monetize attention, structurally aligning incentives against user time well spent.