Scientific Definition
Malicious instructions hidden in user input or retrieved content.
Plain-English Definition
Malicious instructions hidden in user input or retrieved content.
Feynman Explanation
Your agent's loyalty just got rewritten by a webpage.
Core Principle
Malicious instructions hidden in user input or retrieved content.
Mechanisms
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Pending editorial review.
Inputs (Triggers)
Pending editorial review.
Outputs (Behaviors)
Pending editorial review.
Behavioral Signature
Your agent's loyalty just got rewritten by a webpage.
Examples
- Indirect prompt injection through documents an agent reads.
- Major security risk for agent deployments.
Pending editorial review.
Famous Experiments
Pending editorial review.
Design Principles
- Treat all input as adversarial. Output validation. Sandboxing.
Measurement Approaches
Pending editorial review.
Evidence
Pending editorial review.
Pending editorial review.
The Perverse Incentive Lens™
How this behavior is exploited — and how to redesign around it.
- Treat all input as adversarial. Output validation. Sandboxing.
Pending editorial review.
Pending editorial review.
Interactive Mini Network
Click any neighbor to re-center the graph and follow the threads of connection.
Knowledge Graph Neighbors
Auto-linked to the rest of the Human Behavior Taxonomy by family, domain, dimension, and shared keywords.
When the agent acts, who's responsible?
Categorizing AI use cases by risk level.
Systematic skew in model behavior across groups.
Testing model behavior on hypothetical alternate inputs.
Adding noise to data to protect individual privacy.
Quantitative measures of model behavior across groups.
Training models across devices without centralizing data.
Bypassing model safety constraints.
Individual speed gains hide collective quality decline.
Adversarial testing of AI systems.
Foundational skills erode through AI offloading.
Cache common prompt prefixes to reduce cost and latency.