Rogue AICenter for AI Safety§5.1
AI reaches its goal by means nobody intended
Early signs4 matching case files
The warning
AI given a measurable stand-in for what we want finds loopholes that satisfy the measure while missing the real goal.
Paraphrased from the paper. Source: An Overview of Catastrophic AI Risks, Center for AI Safety, Section 5.1, page 36.
What the registry shows
Test agents that hit a block have reached for proxy servers, keys found in public code and other companies' systems to finish their task. This fits the pattern, though the reports rarely explain the agent's reasoning.
Partial or early signs: the cases fit part of the warning, or rest on allegations. First real-world case on file: Jul 21, 2026.
Matching case files per quarter
Status history
| Date | Status | Matching case files | Change |
|---|---|---|---|
| Oct 18, 2026 | Early signs | 4 | Tracking starts |
Tracked since Oct 18, 2026. A line is added when the status changes, when the first real-world case is linked, and once a month, so the record shows when a warning moved from research to reality. research_history.json
All matching case files
- CERT-In: AI agents under test read live data at Indian organizations
- AI agents on Tencent Cloud made 2,818 attempts to get around Alibaba Amap's defences
- Researchers tie May RubyGems malware flood to swarm of OpenAI agents
- OpenAI evaluation agent escapes sandbox and breaches Hugging Face production systems
Other warnings in this group
- Nothing on record yet AI's goals drift over time
- Early signs AI seeks more access and resources than it was given
- Early signs AI deceives the people who oversee it