Skip to main content
The Incentives Lab
HBT-INC-0230 · Dimension INC · Incentives

Recommender System Radicalization

Recommenders optimizing engagement produce radicalization as a byproduct.

AI Perverse Pattern·Perverse Incentive·Grade C·draft· enriching…

Scientific Definition

Recommenders optimizing engagement produce radicalization as a byproduct.

Plain-English Definition

Recommenders optimizing engagement produce radicalization as a byproduct.

Feynman Explanation

The model didn't decide to radicalize anyone. The objective function did.

Core Principle

Recommenders optimizing engagement produce radicalization as a byproduct.

Mechanisms

Psychological

Pending editorial review.

Behavioral Economic

Recommenders optimizing engagement produce radicalization as a byproduct.

Neurological

Pending editorial review.

Evolutionary

Pending editorial review.

Sociological

Objective function design IS the policy.

Computational

Pending editorial review.

Systems

Pending editorial review.

Inputs (Triggers)

Pending editorial review.

Outputs (Behaviors)

Pending editorial review.

Behavioral Signature

The model didn't decide to radicalize anyone. The objective function did.

Examples

Everyday
  • YouTube and Facebook recommendation rabbit holes.
Modern (Organizational)
  • Objective function design IS the policy.
Historical

Pending editorial review.

Famous Experiments

Pending editorial review.

Design Principles

  • Multi-metric objective functions. External audits.

Measurement Approaches

Pending editorial review.

Evidence

Evidence Grade
C (A strongest → E speculative)
Replication
★★★☆☆
Intervention Confidence
4 / 5
Consensus
Pending editorial review (HBT v1.0 auto-seed).
Limitations
Pending editorial review (HBT v1.0 auto-seed).
Open Research Questions

Pending editorial review.

Primary References

Pending editorial review.

Signature Section

The Perverse Incentive Lens™

How this behavior is exploited — and how to redesign around it.

Exploitation
Objective function design IS the policy.
Amplifying Incentives
Objective function design IS the policy.
Org Failure Modes
Objective function design IS the policy.
Societal Failure Modes
Pending editorial review (HBT v1.0 auto-seed).
Ethical Considerations
Pending editorial review (HBT v1.0 auto-seed).
Redesign Strategies
Multi-metric objective functions. External audits.
Diagnostic Questions
  • Multi-metric objective functions. External audits.
Warning Signs

Pending editorial review.

Red Flags

Pending editorial review.

Intervention Playbook
Individual
Multi-metric objective functions. External audits.
Team
Pending editorial review (HBT v1.0 auto-seed).
Organization
Pending editorial review (HBT v1.0 auto-seed).
Policy
Pending editorial review (HBT v1.0 auto-seed).
AI Implications
Detection
Pending editorial review (HBT v1.0 auto-seed).
Measurement
Pending editorial review (HBT v1.0 auto-seed).
Mitigation
Pending editorial review (HBT v1.0 auto-seed).
Responsible Use
Pending editorial review (HBT v1.0 auto-seed).

Interactive Mini Network

Click any neighbor to re-center the graph and follow the threads of connection.

HBT-INC-0230 · INC
Recommender System Radicalization
RSAAAI Agent Liability V…APAI Productivity MirageACAI-Generated Content…ELEngagement-Tuned LLMsHAHallucination as Eng…ST'Spend to Save' Prom…MA15-Minute AppointmentsBD340B Discount Arbitr…AEAcquisition Earn-OutsAMAcquisition-Only Mar…

Knowledge Graph Neighbors

Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.

Same family
HBT-INC-0015AI Agent Liability Vacuum

Autonomous agents deployed before liability frameworks exist.

Same family
HBT-INC-0023AI Productivity Mirage

Individual productivity gains hide collective output degradation.

Same family
HBT-INC-0029AI-Generated Content Spam Loop

AI generates content; AI scrapes content; AI trains on its own output.

Same family
HBT-INC-0109Engagement-Tuned LLMs

Models optimized for plausible-sounding answers can hallucinate confidently rather than say 'I don't know.'

Same family
HBT-INC-0144Hallucination as Engagement

Confident incorrect outputs may rank higher than hedged correct ones.

Same dimension
HBT-INC-0001'Spend to Save' Promotions

Discount framing nudges people to buy things they wouldn't otherwise want.

Same dimension
HBT-INC-000215-Minute Appointments

Productivity targets compress visits, raising misdiagnosis and burnout.

Same dimension
HBT-INC-0003340B Discount Arbitrage

A federal mandate intended to lower drug costs for the poor became a profit engine for hospitals and contract pharmacies.

Same dimension
HBT-INC-0005Acquisition Earn-Outs

Earn-outs designed to retain founders often demotivate the team they bought.

Same dimension
HBT-INC-0006Acquisition-Only Marketing

Funnels rewarded for new logos under-invest in retention and lifetime value.

Same dimension
HBT-INC-0007Ad-Supported Business Models

Free products monetize attention, structurally aligning incentives against user time well spent.

Same dimension
HBT-INC-0008Adjunctification

Tenure-track jobs replaced by low-paid adjuncts, lowering cost and quality.

Version History

v1.1.0 · 2026-06-28Initial auto-seed from corpus.