Law of Small Numbers is we expect small samples to reflect population properties. It sits in the Cognition dimension (COG) of the Human Behavior Taxonomy™ as element HBT-COG-0431, within the Probability family. The core principle: we expect small samples to reflect population properties. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
Scientific Definition
We expect small samples to reflect population properties.
Plain-English Definition
We expect small samples to reflect population properties.
Feynman Explanation
Three data points do not a trend make. Unless you are in a hurry.
Core Principle
We expect small samples to reflect population properties.
Mechanisms
Pending editorial review.
We expect small samples to reflect population properties.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Small samples create false confidence.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
Three data points do not a trend make. Unless you are in a hurry.
Examples
- A three-month sales trend drives a strategy change.
- Small samples create false confidence.
Pending editorial review.
Original analysis from The Incentives Lab — how this element behaves inside real payoff structures.
Why this element matters to incentive design
This element is common enough to feel like human nature and specific enough to be engineered around. The mechanism underneath it is straightforward: we expect small samples to reflect population properties. You can recognize it in the field by its signature: three data points do not a trend make. Unless you are in a hurry. Every element in the Cognition dimension changes the perceived payoff of an action before the action happens, which is exactly where incentive design has leverage.
How it gets exploited
Left undesigned, small samples create false confidence. It is amplified whenever small samples create false confidence. Inside organizations that shows up as small samples create false confidence. The pattern is the same one Goodhart's Law describes: the measurable proxy attracts the effort, and the purpose behind it quietly loses funding.
How the Lab designs around it
The redesign move is to use confidence intervals and resist overinterpreting small samples. Design against it the way you would design against a known failure mode — assume it will appear, and price the exploit before someone finds it.
Famous Experiments
Pending editorial review.
Design Principles
- Use confidence intervals and resist overinterpreting small samples.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Use confidence intervals and resist overinterpreting small samples.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
As sample size grows, sample averages converge to expected values.
Ignoring general statistics in favor of specific, vivid information.
Posterior = (likelihood × prior) / evidence.
Update beliefs in proportion to the strength of new evidence.
Start with a prior; update with new evidence.
Novices experiencing early success, often due to variance and small samples.
High-impact, hard-to-predict, retrospectively explainable events.
Striking pattern that is statistically expected in large samples.
Reasoning in distributions — ranges and probabilities — rather than points.
Average outcomes across the population differ from outcomes across time for one person.
A rough calculation using order-of-magnitude reasoning.
In quantum mechanics, certain pairs of properties cannot both be precisely known.
Where Law of Small Numbers is cited in the corpus
Essays, field guides, and diagnostics from The Incentives Lab that apply this element.
- EssayGoodhart's Law in the Real World
How measurable proxies capture judgment.
- EssayThe Perverse Incentives Hiding in Your KPIs
Cognitive shortcuts turned into scorecards.
- EssayAI Agents Inherit Your Incentives
How this element propagates into automated systems.
- ReferenceThe Periodic Table of Human Behavior
The full 1,267-element map this page belongs to.
- ReferenceThe incentive glossary
Definitions for every mental model, bias, and fallacy in the corpus.
Questions about Law of Small Numbers
- What is Law of Small Numbers?
- Law of Small Numbers is we expect small samples to reflect population properties. It sits in the Cognition dimension (COG) of the Human Behavior Taxonomy™ as element HBT-COG-0431, within the Probability family. The core principle: we expect small samples to reflect population properties. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
- What is an example of Law of Small Numbers?
- Small samples create false confidence. The Incentives Lab catalogs everyday, organizational, and historical instances of this element on its Human Behavior Taxonomy™ page (HBT-COG-0431).
- How is Law of Small Numbers exploited?
- Small samples create false confidence.
- How do you design around Law of Small Numbers?
- Use confidence intervals and resist overinterpreting small samples.
- Which behavioral dimension does Law of Small Numbers belong to?
- Law of Small Numbers is classified in the Cognition dimension (COG) of the Human Behavior Taxonomy™, family "Probability", class "Mental Model". Its permanent identifier is HBT-COG-0431 and its evidence grade is B.