Instrumental Convergence is different agents pursue the same subgoals regardless of their ultimate goals. It sits in the Cognition dimension (COG) of the Human Behavior Taxonomy™ as element HBT-COG-0409, within the Strategy family. The core principle: different agents pursue the same subgoals regardless of their ultimate goals. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
Scientific Definition
Different agents pursue the same subgoals regardless of their ultimate goals.
Plain-English Definition
Different agents pursue the same subgoals regardless of their ultimate goals.
Feynman Explanation
Every AI wants more resources, more data, and more control. So do humans.
Core Principle
Different agents pursue the same subgoals regardless of their ultimate goals.
Mechanisms
Pending editorial review.
Different agents pursue the same subgoals regardless of their ultimate goals.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Subgoals become goals because they are measurable.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
Every AI wants more resources, more data, and more control. So do humans.
Examples
- Competitors with different missions both seek market share and talent.
- Subgoals become goals because they are measurable.
Pending editorial review.
Original analysis from The Incentives Lab — how this element behaves inside real payoff structures.
Why this element matters to incentive design
This is one of the elements leaders describe as a values gap. It is a payoff gap. The mechanism underneath it is straightforward: different agents pursue the same subgoals regardless of their ultimate goals. You can recognize it in the field by its signature: every AI wants more resources, more data, and more control. So do humans. Every element in the Cognition dimension changes the perceived payoff of an action before the action happens, which is exactly where incentive design has leverage.
How it gets exploited
Left undesigned, subgoals become goals because they are measurable. It is amplified whenever subgoals become goals because they are measurable. Inside organizations that shows up as subgoals become goals because they are measurable. The pattern is the same one Goodhart's Law describes: the measurable proxy attracts the effort, and the purpose behind it quietly loses funding.
How the Lab designs around it
The redesign move is to check whether subgoals have drifted from the original mission. The test of any redesign here is simple: after the change, can you name what the organization is now doing less of? If not, the payoff structure did not actually move.
Famous Experiments
Pending editorial review.
Design Principles
- Check whether subgoals have drifted from the original mission.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Check whether subgoals have drifted from the original mission.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
Basics first (health/finances), then depth (mastery/impact), then altruism (widening circle).
A problem whose solution requires people to change their values, beliefs, or habits — not just apply expertise.
Holding a different — and correct — set of tools than everyone else.
Someone who incites others to take illegal or rash action, often to expose or discredit them.
Sun Tzu's ancient treatise on strategy, deception, and positioning.
Conflict between belligerents with very different resources and tactics.
Start from the desired future and work backward to the steps that make it inevitable.
Winning the disputed population, not just defeating the visible opponent.
Countering hostile narratives with truthful, well-timed alternatives.
Sort situations into Clear, Complicated, Complex, Chaotic, or Confused — each needs a different response.
Eroding the will to act, even when capacity remains.
Munger's principle: the surest way to get something is to deserve it.
Where Instrumental Convergence is cited in the corpus
Essays, field guides, and diagnostics from The Incentives Lab that apply this element.
- EssayGoodhart's Law in the Real World
How measurable proxies capture judgment.
- EssayThe Perverse Incentives Hiding in Your KPIs
Cognitive shortcuts turned into scorecards.
- EssayAI Agents Inherit Your Incentives
How this element propagates into automated systems.
- ReferenceThe Periodic Table of Human Behavior
The full 1,267-element map this page belongs to.
- CourseIncentives 101
The free ten-part primer on reading a payoff structure.
Questions about Instrumental Convergence
- What is Instrumental Convergence?
- Instrumental Convergence is different agents pursue the same subgoals regardless of their ultimate goals. It sits in the Cognition dimension (COG) of the Human Behavior Taxonomy™ as element HBT-COG-0409, within the Strategy family. The core principle: different agents pursue the same subgoals regardless of their ultimate goals. In incentive terms, it matters because it changes the payoff people perceive before they choose — which means it can be designed for, or exploited.
- What is an example of Instrumental Convergence?
- Subgoals become goals because they are measurable. The Incentives Lab catalogs everyday, organizational, and historical instances of this element on its Human Behavior Taxonomy™ page (HBT-COG-0409).
- How is Instrumental Convergence exploited?
- Subgoals become goals because they are measurable.
- How do you design around Instrumental Convergence?
- Check whether subgoals have drifted from the original mission.
- Which behavioral dimension does Instrumental Convergence belong to?
- Instrumental Convergence is classified in the Cognition dimension (COG) of the Human Behavior Taxonomy™, family "Strategy", class "Mental Model". Its permanent identifier is HBT-COG-0409 and its evidence grade is B.