Skip to main content
The Incentives Lab
All Layers / Layer 17
Incentives OS · Layer 17

Information Theory

Entropy, signal vs. noise, Bayesian updating, prediction markets, expected value.

What is signal here — and what is noise being treated as signal?

Canonical thinkers

  • Claude Shannon
  • Thomas Bayes
  • Robin Hanson

Seed concepts

Underlined seeds link to their full glossary entry. Plain seeds are pending a definition page.

Typed connections

Full graph →

How this layer reinforces, counteracts, or depends on the rest of the system.

  • Depends on·Layer
    AI & Alignment depends on this layer

    Modern AI is information compression at scale — Shannon's bounds shape what alignment can do.

  • Explains·Layer
    This layer explains Systems Thinking

    Feedback loops are signal channels; noise and delay determine whether the loop stabilizes or oscillates.

Elements in this layer

28 HBEs
COGBayesian Updating

Start with a prior; update with new evidence.

COGBroken Windows Theory

Small visible disorders signal that bigger ones will be tolerated.

INCBusyness as Status

Being visibly busy signals importance regardless of actual output.

INCCollege Prestige Signaling

Employers screen by school name, rewarding admission rather than developed skill.

COGCostly Signaling

Signals whose value depends on being expensive to fake.

INCDifferential Privacy

Adding noise to data to protect individual privacy.

COGEntropy

Systems tend toward disorder unless energy is invested to maintain order.

COGErgodicity

Average outcomes across the population differ from outcomes across time for one person.

IDNExpected Utility (vs. Expected Value)

Decisions optimize utility, not value.

IDNExpected Value

Probability × payoff, summed across outcomes.

INCHomework Volume Signal

More homework signals rigor to parents but often produces burnout, not understanding.

COGImpression Management

Deliberately shaping how others perceive you — through behavior, signal, and context.

COGIncentive Entropy

Without active design, incentives decay toward gameable proxies.

COGInformation Overwhelm Filter

A pre-commitment to gatekeepers (curators, trusted reviewers, criteria) so the flood of content doesn't drown the signal.

INCInnovation Theater

Innovation programs designed to signal innovation, not to produce it.

COGKahneman's Three Conditions for Expert Intuition

Intuition is trustworthy only when the domain is regular, practice is plentiful, and feedback is fast.

COGLaw of Large Numbers

As sample size grows, sample averages converge to expected values.

COGMyelination

Insulation of neural pathways speeds signal transmission with practice.

BIOPrediction Machine (Friston)

The brain is a prediction engine; surprise is the signal to update.

COGRegret Aversion

We choose to minimize the regret we anticipate — not the expected value.

INCReward Hacking

Maximizing the reward signal in unintended ways.

COGRisk Aversion

Preference for certain outcomes over uncertain ones of equal expected value.

SOCSignal-to-Noise Ratio

The ratio of useful information to irrelevant information.

COGSignaling

Costly actions that credibly communicate hard-to-observe traits.

COGVeblen Effect

Demand rises with price because the price itself signals status.

COGVentral Tegmental Area (VTA)

Source of dopamine signals projecting to reward and motivation circuits.

COGWise Effort

Buddhist-derived principle: applying the right amount of effort, neither forcing nor slacking — taught by Shauna Shapiro and Rick Hanson.

COGMarket Signals

Prices & info guide attention