Model Distillation is train a smaller model to imitate a larger one. It sits in the Incentives dimension (INC) of the Human Behavior Taxonomy™ as element HBT-INC-0179, within the Workflow family. The core principle: train a smaller model to imitate a larger one. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
Scientific Definition
Train a smaller model to imitate a larger one.
Plain-English Definition
Train a smaller model to imitate a larger one.
Feynman Explanation
Compress the wisdom. Keep the speed.
Core Principle
Train a smaller model to imitate a larger one.
Mechanisms
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
Compress the wisdom. Keep the speed.
Examples
- Edge deployments of distilled LLMs.
- Cost and latency optimization.
Pending editorial review.
Original analysis from The Incentives Lab — how this element behaves inside real payoff structures.
Why this element matters to incentive design
Most organizations meet this element as a personnel problem. It is not one. The mechanism underneath it operates in the Incentives dimension — what makes behavior more or less likely?. You can recognize it in the field by its signature: compress the wisdom. Keep the speed. Every element in the Incentives dimension changes the perceived payoff of an action before the action happens, which is exactly where incentive design has leverage.
How it gets exploited
Left undesigned, cost and latency optimization. It is amplified whenever cost and latency optimization. Inside organizations that shows up as cost and latency optimization. The pattern is the same one Goodhart's Law describes: the measurable proxy attracts the effort, and the purpose behind it quietly loses funding.
How the Lab designs around it
The redesign move is to distillation often beats fine-tuning at scale. The test of any redesign here is simple: after the change, can you name what the organization is now doing less of? If not, the payoff structure did not actually move.
Famous Experiments
Pending editorial review.
Design Principles
- Distillation often beats fine-tuning at scale.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Distillation often beats fine-tuning at scale.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
Performance degradation as real-world data shifts.
AI system that takes actions to achieve goals, often across tools.
Designing processes from scratch around AI capability.
The relationship between inputs and outputs changes.
How much input the model can process at once.
Underlying data distribution changes over time.
Vector representation of content for similarity and search.
Evaluation suites that no longer reflect real-world conditions.
Systematic testing of model quality, safety, and capability.
Models learning from examples in the prompt.
How much delay the user experience tolerates.
Multiple specialized agents coordinating on tasks.
Where Model Distillation is cited in the corpus
Essays, field guides, and diagnostics from The Incentives Lab that apply this element.
- Field guideIncentives: definition, types, examples
The parent field guide for this element.
- ReferenceThe laws of incentives
Goodhart, Campbell, and the Cobra Effect.
- EssayAI Agents Inherit Your Incentives
How this element propagates into automated systems.
- CourseIncentives 101
The free ten-part primer on reading a payoff structure.
- ReferenceThe incentive glossary
Definitions for every mental model, bias, and fallacy in the corpus.
- ReferenceThe Periodic Table of Human Behavior
The full 1,267-element map this page belongs to.
Questions about Model Distillation
- What is Model Distillation?
- Model Distillation is train a smaller model to imitate a larger one. It sits in the Incentives dimension (INC) of the Human Behavior Taxonomy™ as element HBT-INC-0179, within the Workflow family. The core principle: train a smaller model to imitate a larger one. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
- What is an example of Model Distillation?
- Cost and latency optimization. The Incentives Lab catalogs everyday, organizational, and historical instances of this element on its Human Behavior Taxonomy™ page (HBT-INC-0179).
- How is Model Distillation exploited?
- Cost and latency optimization.
- How do you design around Model Distillation?
- Distillation often beats fine-tuning at scale.
- Which behavioral dimension does Model Distillation belong to?
- Model Distillation is classified in the Incentives dimension (INC) of the Human Behavior Taxonomy™, family "Workflow", class "AI-Behavioral Coupling". Its permanent identifier is HBT-INC-0179 and its evidence grade is C.