Mental Models · Learning

Overfitting

A model that explains historical data too closely will fail on new data.

"You memorized the test. You did not learn the subject."

Quick answer

What is Overfitting? A model that explains historical data too closely will fail on new data. Complex models often mistake noise for signal.

In the wild

A sales forecast that perfectly matches last year but fails next quarter.

Why it matters in the room

Complex models often mistake noise for signal.

Counter-move

Test models on out-of-sample data and prefer simplicity.

Visual · Pattern

Overfitting — a recurring shape in how people decide.

Live example · Apply Overfitting

Use the model. Pick the move.

A model that explains historical data too closely will fail on new data. You've just seen this: A sales forecast that perfectly matches last year but fails next quarter. Which lever does the model recommend?

● Live

Pick a lever. There are no neutral ones — every incentive funds a behavior somewhere.

How does this land?

Pick a reaction to Overfitting

One tap. We'll point you at the most useful next surface based on how this hits.

Human Behavior Element™ · HBE Spec

The full taxonomy entry

Every concept in the Atlas uses the same structure — so Overfitting can be compared, recombined, and cited like an element on a periodic table.

About the standard →

HBT-M8907

Official name

Overfitting

Mental Models · Learning

Identity

HBT ID

HBT-M8907

Symbol

Official name

Overfitting

Synonyms

Learning

Keywords

Mental Models, Learning, human behavior, incentive design

Version

v1.0

Last updated

Maintained by The Incentives Lab

Classification

Kingdom

Cognition

Domain

Frameworks

Family

Mental Model

Class

Learning

Element

Overfitting

Definition

Scientific

A model that explains historical data too closely will fail on new data.

Plain-English

A model that explains historical data too closely will fail on new data.

Feynman

You memorized the test. You did not learn the subject.

Core principle

A model that explains historical data too closely will fail on new data.

One-sentence summary

Complex models often mistake noise for signal.

Mechanisms

Psychological

A model that explains historical data too closely will fail on new data.

Behavioral econ.

Complex models often mistake noise for signal.

Neurological

Reward, threat, and salience circuits bias attention toward the cue.

Evolutionary

Heuristics that paid off in ancestral environments now misfire in modern systems.

Sociological

Group norms and status incentives reinforce the pattern across a team.

Computational

Models trained on biased human signals will replicate and amplify the pattern.

Systems thinking

Feedback loops between metrics, incentives, and behavior lock the pattern in place.

Signals & signature

Inputs (activators)

A sales forecast that perfectly matches last year but fails next quarter.

Outputs (observable)

Complex models often mistake noise for signal.

Behavioral signature

You see Overfitting when the explanation for a decision sounds reasonable but the outcome keeps repeating.

Behavioral molecules

Often combines with related Atlas entries — see the rail below.

Pathways · before

A goal, metric, or contract clause makes the behavior rational locally.

Pathways · after

Locally rational choices accumulate into a systemic distortion.

Domains where it shows up

Business
Leadership
Government
Healthcare
Education
Sales
Marketing
AI
Negotiation
Media
Public Policy
Relationships

Examples

Everyday

A sales forecast that perfectly matches last year but fails next quarter.

Modern

Complex models often mistake noise for signal.

Historical

A pattern repeatedly documented since the foundational behavioral science literature on mental model.

Famous experiments

See the References block — primary papers in the Atlas link out to the original studies.

Design principles

How to leverage

Complex models often mistake noise for signal.

How to reduce

Test models on out-of-sample data and prefer simplicity.

How to redesign

Test models on out-of-sample data and prefer simplicity.

The Perverse Incentive Lens™

How it's exploited

Organizations weaponize overfitting — sometimes deliberately, often by accident — when metrics reward the symptom rather than the outcome.

Common perverse incentives

Volume metrics, short review windows, bonus cliffs, and contracts that pay on activity rather than impact.

Failure modes

When Overfitting dominates, teams optimize for the dashboard while the real outcome quietly degrades.

Incentive redesign

Test models on out-of-sample data and prefer simplicity.

Ethical considerations

Don't engineer overfitting into customers, employees, or citizens as a manipulation tactic — design for informed choice instead.

Diagnostic questions

Where in our org would Overfitting most often show up unnoticed?
Which metric, ritual, or contract clause quietly rewards Overfitting?
If we removed every payoff for Overfitting, what behavior would replace it?
Who benefits when Overfitting persists — and who pays the cost?

Organizational warning signs

Metrics

A KPI is hit while the underlying outcome stalls or worsens.

Behaviors

People route around the rule rather than challenge it.

Language

'That's just how we do it here.' / 'The system requires it.'

Culture

Naming the pattern is treated as disloyalty.

Red flags

People defend the status quo using the language of overfitting.
Decisions cluster around the easiest narrative rather than the strongest evidence.
New data changes the slide deck but not the decision.
Anyone naming the pattern is treated as the problem.

Intervention playbook

Immediate

Make the perverse payoff visible to the people creating it.

30-day

Run a small pilot that pays for the outcome, not the proxy.

Long-term

Rewrite the comp plan, contract, or ritual so the right behavior becomes the easy behavior.

AI considerations

Detect

Audit training data and reward signals for the same pattern this element describes.

Avoid amplifying

Don't optimize models on metrics that already encode the perverse incentive.

Counteract

Use the model to surface where the pattern is most active, then redesign the incentive — not the model.

Measurement

Metrics

Outcome-to-proxy ratio over time.

Assessment

The Incentives Lab III Diagnostic.

Survey

Calibrated pulse questions on rules vs. outcomes.

Behavioral signals

Where people work around the system.

Observational

Where the dashboard and the lived experience disagree.

Scientific evidence

Evidence grade

Synthesized from the behavioral science literature; see Atlas references.

Replication

Tracked in the Atlas as primary, replicated, or contested.

Intervention confidence

Moderate — patterns generalize, mechanisms vary by context.

Research consensus

Broad agreement on the pattern; ongoing debate on boundary conditions.

Known limitations

Local context, culture, and incentive structure all change the strength of the effect.

Open questions

How does Overfitting interact with AI-mediated decisions at scale?

References

Primary papers

See the Research Center →

Books

Curated in the Magazine →

Meta-analyses

Tracked in the Atlas registry.

Seminal authors

Kahneman, Tversky, Thaler, Ariely, Cialdini, Ostrom, Simon — and the field they built.

Cross references

Every Atlas entry is a node in a knowledge graph. See the related rail below to follow the connections.

Disciplinary layers

See Overfitting through 3 lenses

Each layer of the Incentives OS reframes this concept with its own thinkers, vocabulary, and diagnostic question.

Test yourself · 60 seconds

Do you actually know Overfitting?

Three quick questions. Result is saved into your review streak — come back when the term is due to lock it in.

Question 1 of 3Score: 0/3

Which best describes Overfitting?

Go deeper

Worked example, counter-example & concept map

On-demand AI analysis grounded in the Lab's research. Cached on your device after first run.

Diagnose

Find this pattern in your org →

15-minute III Assessment.

Learn

Master incentive intelligence →

12-week Executive Course.

Engage

Bring the Lab to your team →

Speaking, retainers, training.

How this lands in you

Your nervous system has a region for this.

Primary region

Prefrontal Cortex →

When you encounter Overfitting, your prefrontal cortex has to do extra work to override the automatic response — and that override budget is finite.

Executive control, planning, impulse override, working memory, System 2. First thing to go offline under stress, fatigue, or low blood sugar. Why your 4pm decisions are worse than your 9am ones.

See Prefrontal in the Brain Atlas →

Picked for you, from the Atlas

Ranked by shared learning paths, overlapping chips, and what you've saved.

Another Mental Models

Adaptability Quotient (AQ)

Your capacity to learn, unlearn, and relearn faster than the environment changes.

Another Mental Models

Andragogy (Knowles)

Malcolm Knowles's principles of adult learning: self-direction, experience as resource, readiness, problem-centered orientation, intrinsic motivation.

Another Mental Models

Attention as Trainable Resource (Jha)

Amishi Jha's research: attention is a finite, depletable, but trainable cognitive resource — short daily mindfulness measurably improves it.

Another Mental Models

Beginner's Mind

Approach a situation as if you knew nothing.

Another Mental Models

Bizarreness Effect

Unusual or bizarre material is more memorable than common material.

Another Mental Models

Bloom's Taxonomy

Hierarchy of cognitive learning: Remember → Understand → Apply → Analyze → Evaluate → Create. Benjamin Bloom, 1956 (revised 2001).