Inference vs. Training Cost is training is a one-time cost. Inference is forever. It sits in the Incentives dimension (INC) of the Human Behavior Taxonomy™ as element HBT-INC-0156, within the Economics family. The core principle: training is a one-time cost. Inference is forever. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
Scientific Definition
Training is a one-time cost. Inference is forever.
Plain-English Definition
Training is a one-time cost. Inference is forever.
Feynman Explanation
Cheap to train, expensive to serve. Pick your poison.
Core Principle
Training is a one-time cost. Inference is forever.
Mechanisms
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
Cheap to train, expensive to serve. Pick your poison.
Examples
- Why model size matters at scale.
- Architecture choice and deployment strategy.
Pending editorial review.
Original analysis from The Incentives Lab — how this element behaves inside real payoff structures.
Why this element matters to incentive design
This is one of the elements leaders describe as a values gap. It is a payoff gap. The mechanism underneath it operates in the Incentives dimension — what makes behavior more or less likely?. You can recognize it in the field by its signature: cheap to train, expensive to serve. Pick your poison. Every element in the Incentives dimension changes the perceived payoff of an action before the action happens, which is exactly where incentive design has leverage.
How it gets exploited
Left undesigned, architecture choice and deployment strategy. It is amplified whenever architecture choice and deployment strategy. Inside organizations that shows up as architecture choice and deployment strategy. The pattern is the same one Goodhart's Law describes: the measurable proxy attracts the effort, and the purpose behind it quietly loses funding.
How the Lab designs around it
The redesign move is to right-size the model for the inference budget, not the training budget. The test of any redesign here is simple: after the change, can you name what the organization is now doing less of? If not, the payoff structure did not actually move.
Famous Experiments
Pending editorial review.
Design Principles
- Right-size the model for the inference budget, not the training budget.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Right-size the model for the inference budget, not the training budget.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
Real cost includes data, ops, monitoring, governance, training.
AI investment outpacing measurable productivity gains.
GPU access and pricing shape what's feasible.
Operating economics shaped by per-token pricing.
A handful of providers shape the entire AI economy.
Cache common prompt prefixes to reduce cost and latency.
Written rules about how AI may be used internally.
Innovators → early adopters → majority → laggards, AI-specific.
AI system that takes actions to achieve goals, often across tools.
When the agent acts, who's responsible?
Augmentation strategy vs. substitution strategy.
Logging of AI inputs, outputs, and decisions.
Where Inference vs. Training Cost is cited in the corpus
Essays, field guides, and diagnostics from The Incentives Lab that apply this element.
- Field guideIncentives: definition, types, examples
The parent field guide for this element.
- ReferenceThe laws of incentives
Goodhart, Campbell, and the Cobra Effect.
- EssayAI Agents Inherit Your Incentives
How this element propagates into automated systems.
- ReferenceThe incentive glossary
Definitions for every mental model, bias, and fallacy in the corpus.
- ReferenceThe Periodic Table of Human Behavior
The full 1,267-element map this page belongs to.
Questions about Inference vs. Training Cost
- What is Inference vs. Training Cost?
- Inference vs. Training Cost is training is a one-time cost. Inference is forever. It sits in the Incentives dimension (INC) of the Human Behavior Taxonomy™ as element HBT-INC-0156, within the Economics family. The core principle: training is a one-time cost. Inference is forever. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
- What is an example of Inference vs. Training Cost?
- Architecture choice and deployment strategy. The Incentives Lab catalogs everyday, organizational, and historical instances of this element on its Human Behavior Taxonomy™ page (HBT-INC-0156).
- How is Inference vs. Training Cost exploited?
- Architecture choice and deployment strategy.
- How do you design around Inference vs. Training Cost?
- Right-size the model for the inference budget, not the training budget.
- Which behavioral dimension does Inference vs. Training Cost belong to?
- Inference vs. Training Cost is classified in the Incentives dimension (INC) of the Human Behavior Taxonomy™, family "Economics", class "AI-Behavioral Coupling". Its permanent identifier is HBT-INC-0156 and its evidence grade is C.