AI Threat Watch

Research vs reality: AI risk warnings checked against real incidents

AI safety researchers have published detailed warnings about how AI could cause harm. This page takes each warning and checks it against the verified case files on this site: has it happened, are there early signs, or is there nothing on record yet? The first source is the Center for AI Safety's overview of catastrophic AI risks; more research institutes will follow.

17Warnings tracked
7Seen in real incidents
5Early signs
2Nothing on record yet
3Outside what we measure
156Case files matching a warningof 356 verified case files
Seen in real incidentsVerified case files show this risk happening in the real world.
Early signsPartial or early signs: the cases fit part of the warning, or rest on allegations.
Nothing on record yetNo verified case file matches this warning.
Outside what we measureA risk that a security incident registry cannot measure.

Malicious use

People deliberately using AI to cause harm.

AI race

Competition pushing countries and companies to deploy AI before it is safe.

Organisational risks

Accidents, leaks and weak safety culture at the organisations that build and run AI.

Rogue AI

AI systems that pursue goals nobody intended and resist control.

What the research did not foresee

56% of verified case files (200 of 356) match none of the paper's warnings. The paper deals with catastrophic risk, so everyday harm such as fraud was outside its scope by design. But that is where most documented damage happens today.

Type of attackMatch no warningCase files
Deepfake fraud8084
AI supply chain4245
Prompt injection2727
Model & data leak1939
Agent hijack1426
LLMjacking1415
State actor AI ops430
AI-assisted malware047
Chatbot harm027
AI phishing016

About the source

An Overview of Catastrophic AI Risks. Dan Hendrycks, Mantas Mazeika, Thomas Woodside. Center for AI Safety, arXiv:2306.12001v6, 9 October 2023.

Published by the Center for AI Safety in June 2023 and revised in October 2023. It sorts catastrophic AI risk into four groups: malicious use, the AI race, organisational risks and rogue AI. Each warning on this page paraphrases one risk from the paper and cites the section and page.

Read the paper Summary by the Center for AI Safety

How we match: a case file is linked to a warning when what happened is a real-world instance of the risk the paper describes, judged by the editors from the facts in the case file. A match means the case fits the warning, not that it proves the paper's wider argument. Allegations in lawsuits are labelled as allegations. Statuses are editorial and reviewed as new cases arrive. The matching is recomputed on every update. Data: Systematic coverage in the registry starts in 2025, so a first-case date shows when the registry first recorded the risk, not when it first happened. research.json (CC BY 4.0)

Language: EnglishFrançaisEspañolالعربية中文Русский