Skip to main content
The Incentives Lab
HBT-COG-0408 · Dimension COG · Cognition

Insensitivity to Sample Size

We ignore sample size when judging probability.

Probability·Mental Model·Grade B·draft· enriching…

Scientific Definition

We ignore sample size when judging probability.

Plain-English Definition

We ignore sample size when judging probability.

Feynman Explanation

A five-star review from two customers is not the same as from two thousand.

Core Principle

We ignore sample size when judging probability.

Mechanisms

Psychological

Pending editorial review.

Behavioral Economic

We ignore sample size when judging probability.

Neurological

Pending editorial review.

Evolutionary

Pending editorial review.

Sociological

Pending editorial review.

Computational

Pending editorial review.

Systems

Small samples produce noisy conclusions.

Inputs (Triggers)

Pending editorial review.

Outputs (Behaviors)

Pending editorial review.

Behavioral Signature

A five-star review from two customers is not the same as from two thousand.

Examples

Everyday
  • A small pilot is treated as definitive proof.
Modern (Organizational)
  • Small samples produce noisy conclusions.
Historical

Pending editorial review.

Famous Experiments

Pending editorial review.

Design Principles

  • Require confidence intervals and sample-size reasoning.

Measurement Approaches

Pending editorial review.

Evidence

Evidence Grade
B (A strongest → E speculative)
Replication
★★★☆☆
Intervention Confidence
3 / 5
Consensus
Pending editorial review (HBT v1.0 auto-seed).
Limitations
Pending editorial review (HBT v1.0 auto-seed).
Open Research Questions

Pending editorial review.

Primary References

Pending editorial review.

Signature Section

The Perverse Incentive Lens™

How this behavior is exploited — and how to redesign around it.

Exploitation
Small samples produce noisy conclusions.
Amplifying Incentives
Small samples produce noisy conclusions.
Org Failure Modes
Small samples produce noisy conclusions.
Societal Failure Modes
Pending editorial review (HBT v1.0 auto-seed).
Ethical Considerations
Pending editorial review (HBT v1.0 auto-seed).
Redesign Strategies
Require confidence intervals and sample-size reasoning.
Diagnostic Questions
  • Require confidence intervals and sample-size reasoning.
Warning Signs

Pending editorial review.

Red Flags

Pending editorial review.

Intervention Playbook
Individual
Require confidence intervals and sample-size reasoning.
Team
Pending editorial review (HBT v1.0 auto-seed).
Organization
Pending editorial review (HBT v1.0 auto-seed).
Policy
Pending editorial review (HBT v1.0 auto-seed).
AI Implications
Detection
Pending editorial review (HBT v1.0 auto-seed).
Measurement
Pending editorial review (HBT v1.0 auto-seed).
Mitigation
Pending editorial review (HBT v1.0 auto-seed).
Responsible Use
Pending editorial review (HBT v1.0 auto-seed).

Interactive Mini Network

Click any neighbor to re-center the graph and follow the threads of connection.

HBT-COG-0408 · COG
Insensitivity to Sample Size
ITBRBase Rate FallacyBRBayes' Rule (Updating)BTBayes' TheoremBUBayesian UpdatingBLBeginner's LuckBSBlack SwanCoCoincidenceDiDistributionsErErgodicityFEFermi Estimate

Knowledge Graph Neighbors

Version History

v1.1.0 · 2026-06-28Initial auto-seed from corpus.