Scientific Definition
Underlying data distribution changes over time.
Plain-English Definition
Underlying data distribution changes over time.
Feynman Explanation
The world moves. Your model stays still.
Core Principle
Underlying data distribution changes over time.
Mechanisms
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
The world moves. Your model stays still.
Examples
- COVID broke many production models overnight.
- Production AI requires ongoing data observability.
Pending editorial review.
Famous Experiments
Pending editorial review.
Design Principles
- Statistical monitoring of input distributions.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Statistical monitoring of input distributions.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
The relationship between inputs and outputs changes.
Evaluation suites that no longer reflect real-world conditions.
Performance degradation as real-world data shifts.
Generated training data that mimics real data.
AI system that takes actions to achieve goals, often across tools.
Designing processes from scratch around AI capability.
How much input the model can process at once.
Vector representation of content for similarity and search.
Systematic testing of model quality, safety, and capability.
Models learning from examples in the prompt.
How much delay the user experience tolerates.
Train a smaller model to imitate a larger one.