Scientific Definition
Systematic testing of model quality, safety, and capability.
Plain-English Definition
Systematic testing of model quality, safety, and capability.
Feynman Explanation
If you don't have evals, you have vibes.
Core Principle
Systematic testing of model quality, safety, and capability.
Mechanisms
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
If you don't have evals, you have vibes.
Examples
- Domain-specific eval suites for every production model.
- AI quality engineering.
Pending editorial review.
Famous Experiments
Pending editorial review.
Design Principles
- Treat evals as core engineering practice, not an afterthought.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Treat evals as core engineering practice, not an afterthought.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
AI system that takes actions to achieve goals, often across tools.
Designing processes from scratch around AI capability.
The relationship between inputs and outputs changes.
How much input the model can process at once.
Underlying data distribution changes over time.
Vector representation of content for similarity and search.
Evaluation suites that no longer reflect real-world conditions.
Models learning from examples in the prompt.
How much delay the user experience tolerates.
Train a smaller model to imitate a larger one.
Performance degradation as real-world data shifts.
Multiple specialized agents coordinating on tasks.