MIT AI Risk InitiativeSeven risk domainsDomain 2
Privacy and security
Seen in real incidents141 matching case files
The risk domain
AI that leaks or infers sensitive personal data, and weaknesses in AI systems and their toolchains that attackers exploit.
Paraphrased from the source. Source: The AI Risk Repository: A Meta-Review, Database, and Taxonomy of Risks From Artificial Intelligence, MIT AI Risk Initiative, Aug 14, 2024, domain 2, Table 2, page 8. Summary by MIT AI Risk Initiative: airisk.mit.edu.
What the registry shows
One of the two pillars of the registry: leaked chats and keys, exposed databases, prompt injection, hijacked agents, poisoned packages and stolen AI accounts.
Verified case files show this risk happening in the real world.
Matching case files per quarter
Status history
| Date | Status | Matching case files | Change |
|---|---|---|---|
| Oct 18, 2026 | Seen in real incidents | 138 | Tracking starts |
Tracked since Oct 18, 2026. A line is added when the status changes, when the first real-world case is linked, and once a month, so the record shows when a warning moved from research to reality. research_history.json
All matching case files
- Aoki infostealer expands to steal Claude, ChatGPT and Cursor credentials
- JINX-2401 LLM hijacking campaign targets AWS environments with IAM privilege escalation
- BodySwap sexual deepfake platform breach exposes about 10,300 user accounts
- Undisclosed jqwik addition instructs AI coding agents to delete app output
- Hidden prompt injection in legal filing instructs AI reviewers to side with filer
- Fake Codex download pages on Google Sites deliver macOS malware via ClickFix
- LiteLLM proxy SQL injection (CVE-2026-42208) actively exploited
- macOS.Gaslight backdoor injects fake prompts at LLM malware-triage tools
- MLflow SSRF flaw (CVE-2026-64849) actively exploited, exposing internal services
- Malicious OpenClaw skill distributes Remcos RAT and GhostLoader
- Ray code injection RCE (CVE-2025-62593) actively exploited
- Wiz Red Agent reaches Snowflake's internal Jira via GitHub Actions flaw in Copilot-assisted PR · Lab test or researcher demonstration
- PoeLLM botnet infects 3,400 servers running exposed LiteLLM and Ollama for cryptomining
- PixelLeak: AI coding agents push 13,000 internal screenshots to public GitHub
- GTG-16005: Anthropic says Alibaba ran 151M-exchange distillation of Claude to train Qwen
- GTG-16006: Zhipu accused of cyber-focused distillation of Claude Opus through 273 accounts
- GTG-16008: Xiaomi replayed MiMo user sessions through Claude via 1,500 accounts
- GTG-50020: extortionist prompt-injects AI vendor eval sandbox, then hits 30 AI firms
- GTG-50021: fake discounted-Claude reseller proxied traffic and stole Anthropic credentials
- Planted prompt makes ChatGPT copy victims' Gmail data to attacker account · Lab test or researcher demonstration
- TeamPCP's DUSTMAKER hides in .claude and .cursor folders and prompt-injects LLM scanners
- Okta: free Telegram stealer dump holds thousands of live AI session tokens and 24 API keys
- LiteLLM MCP gateway accepts any Bearer token (CVE-2026-59822); CISA confirms exploitation
- Attacker takes METR API key from a researcher's exposed agent app and runs up $600,000 in donated credits
- Truffle Security: 9,300 live AWS keys exposed, with Hugging Face the largest single source · Lab test or researcher demonstration
- CISA lists MLflow webhook SSRF (CVE-2026-64849) reaching cloud metadata as exploited
- Browser-based Ray RCE (CVE-2025-62593) used by RondoDox botnet lands on CISA KEV
- Langflow hit by four more KEV listings in 2026: token hijack, IDOR, root RCE and auto_login chain
- DuneSlide: two 9.8 Cursor flaws let prompt injection escape sandbox for OS-level RCE · Lab test or researcher demonstration
- North Korea's Sapphire Sleet hijacks maintainer account to trojanize 140+ Mastra AI npm packages
- 15 JetBrains Marketplace AI plugins with 70,000 installs steal OpenAI and DeepSeek keys
- SearchLeak: one-click chain in M365 Copilot Enterprise Search exfiltrates data via Bing · Lab test or researcher demonstration
- Hijacked Ollama server used as brain of autonomous hacking pipeline
- Typosquatted npm MCP servers phone home on install posing as official modelcontextprotocol packages
- CISA adds actively exploited LiteLLM AI gateway RCE (CVE-2026-42271) to KEV
- Hackers trick Meta's AI support chatbot into handing over Instagram accounts
- Trojanized codexui-android npm package steals OpenAI Codex tokens
- OpenAI confirms two employee devices and source repos breached in Mini Shai-Hulud npm worm
- Mini Shai-Hulud worm hits TanStack, Mistral AI and Guardrails AI packages
- PRC clusters UNC5673 and UNC6201 pooled Gemini, Claude and OpenAI accounts via proxies
- Fake 'OpenAI Privacy Filter' repo tops Hugging Face trending while pushing Rust infostealer
- Backdoored PyTorch Lightning 2.6.3 on PyPI runs Bun-based credential stealer on import
- Claude Code sandbox escape via symlinks allows host code execution (CVE-2026-39861) · Lab test or researcher demonstration
- Unauthorized group accesses Anthropic's restricted Claude Mythos model via vendor
- Researcher: free Lovable account could read source, Supabase keys and chats of pre-Nov 2025 projects · Lab test or researcher demonstration
- Compromised Context.ai AI tool's OAuth grant leads to Vercel breach
- Marimo notebook RCE (CVE-2026-39987) exploited in hours; NKAbuse RAT staged on Hugging Face Spaces
- Prompt injection leaks data from Microsoft Copilot Studio and Salesforce Agentforce agents · Lab test or researcher demonstration
- Max-severity Flowise CustomMCP RCE (CVE-2025-59528) exploited in the wild
- GrafanaGhost: indirect prompt injection makes Grafana AI leak enterprise data · Lab test or researcher demonstration
- Poisoned LiteLLM releases tied to Mercor breach exposing AI lab training secrets
- prt-scan: AI-powered campaign exploits pull_request_target in GitHub workflows
- Claude Code source map leak followed by malware-laced fake 'leak' repos
- OpenAI Codex branch-name command injection exposed GitHub tokens in cloud tasks · Lab test or researcher demonstration
- Vertex AI 'Double Agent': over-privileged agents leak credentials and code · Lab test or researcher demonstration
- Check Point finds DNS tunnel out of ChatGPT's code sandbox leaking chats and files · Lab test or researcher demonstration
- Langflow unauthenticated RCE (CVE-2026-33017) exploited within 20 hours of advisory
- Meta AI agent's flawed advice exposes sensitive data to employees for two hours
- Cybernews: 45 of 98 unauthenticated Open WebUI servers already running miners and stealers
- CISA confirms active exploitation of max-severity n8n expression injection RCE
- Autonomous AI agent breaches McKinsey's Lilli chatbot platform in two hours · Lab test or researcher demonstration
- Bing AI search promotes fake OpenClaw installer repos pushing Atomic and Vidar stealers
- Anthropic accuses DeepSeek, Moonshot and MiniMax of distilling Claude via 24,000 accounts
- Compromised Cline CLI npm release silently installs OpenClaw agent
- Infostealer captures OpenClaw gateway token, device keys and agent memory files
- Over 230 malicious OpenClaw skills on ClawHub push password stealers
- Moltbook AI-agent social network exposes 1.5M agent API tokens · Lab test or researcher demonstration
- Chat & Ask AI app leaks ~300M messages from 25M users via open Firebase · Lab test or researcher demonstration
- Hugging Face datasets abused to serve polymorphic Android RAT payloads every 15 minutes
- Operation Bizarre Bazaar: hijacked LLM endpoints resold through commercial marketplace
- Tens of thousands of OpenClaw agent gateways exposed online leaking API keys and chats
- MaliciousCorgi: 'ChatGPT' and 'ChatMoss' VS Code AI extensions with 1.5M installs exfiltrate open files
- BodySnatcher: unauthenticated impersonation via ServiceNow Virtual Agent (CVE-2025-12420) · Lab test or researcher demonstration
- Microsoft 365 Copilot bug summarises confidential emails despite DLP policies
- Prompt injection flaws in Anthropic's Git MCP server enable file access and code execution · Lab test or researcher demonstration
- Reprompt: one-click attack hijacks Microsoft Copilot sessions to steal data · Lab test or researcher demonstration
- GeminiJack: zero-click injection in Gemini Enterprise exfiltrated Gmail, Calendar and Docs · Lab test or researcher demonstration
- OpenAI API user data exposed in breach of analytics vendor Mixpanel
- HashJack: prompts hidden in URL fragments hijack Comet, Edge Copilot and Gemini in Chrome · Lab test or researcher demonstration
- ShadowRay 2.0 turns exposed Ray AI clusters into self-spreading mining botnet
- HackedGPT: Tenable finds seven ChatGPT flaws including persistent memory injection · Lab test or researcher demonstration
- Path traversal in Smithery MCP hosting exposed root access to 3,000 hosted MCP servers · Lab test or researcher demonstration
- CamoLeak: hidden PR comments make GitHub Copilot Chat leak private repo secrets · Lab test or researcher demonstration
- Gemini Trifecta: log, search-history and browsing flaws let Gemini exfiltrate user data · Lab test or researcher demonstration
- ForcedLeak: Web-to-Lead prompt injection and a $5 expired domain leak Agentforce CRM data · Lab test or researcher demonstration
- First malicious MCP server found: postmark-mcp npm package BCCs all emails to attacker
- Notion 3.0 agents tricked by white-text PDF into leaking client data via web search · Lab test or researcher demonstration
- ShadowLeak: zero-click prompt injection makes ChatGPT Deep Research leak Gmail data · Lab test or researcher demonstration
- WhiteCobra floods Open VSX and VS Code Marketplace with 24 crypto-stealing extensions
- Vyro AI leaves 116GB of ImagineArt and Chatly prompts and tokens on open Elasticsearch
- Cisco Talos finds over 1,100 Ollama LLM servers open to the internet without authentication · Lab test or researcher demonstration
- s1ngularity: trojanized Nx packages weaponize Claude and Gemini CLIs to steal secrets
- Drift AI chatbot OAuth tokens stolen to raid 700+ Salesforce tenants
- Brave shows Perplexity Comet can be hijacked by a Reddit comment to steal Gmail OTPs · Lab test or researcher demonstration
- Over 370,000 Grok conversations exposed in Google search via share links
- Microsoft 365 Copilot summarised files without writing audit log entries · Lab test or researcher demonstration
- Lenovo's Lena support chatbot coaxed into XSS payload that steals agent session cookies · Lab test or researcher demonstration
- Copilot prompt injection flips VS Code to auto-approve mode for RCE (CVE-2025-53773) · Lab test or researcher demonstration
- AgentFlayer: one poisoned Google Drive document makes ChatGPT leak API keys · Lab test or researcher demonstration
- Invitation Is All You Need: poisoned calendar invites make Gemini control smart homes · Lab test or researcher demonstration
- Claude Code command injection bypasses confirmation prompt (CVE-2025-54795 and -54794) · Lab test or researcher demonstration
- CurXecute and MCPoison: Cursor IDE MCP config flaws allow silent code execution · Lab test or researcher demonstration
- Thousands of shared ChatGPT conversations surface in Google search; OpenAI kills feature
- Wiz finds auth bypass exposing private enterprise apps on Wix's Base44 platform · Lab test or researcher demonstration
- Gemini CLI hijacked via poisoned README to silently exfiltrate credentials · Lab test or researcher demonstration
- Exposed llama.cpp servers leak user prompts through the /slots debug endpoint · Lab test or researcher demonstration
- Hacker plants data-wiping prompt in Amazon Q Developer VS Code extension
- Meta AI bug let any logged-in user read other people's private prompts and replies · Lab test or researcher demonstration
- DOGE staffer Marko Elez leaks xAI API key granting access to 52 Grok models
- Fake 'Solidity Language' extension on Open VSX drains $500K from Cursor developer
- Hidden email text makes Gemini for Workspace summaries deliver fake security alerts · Lab test or researcher demonstration
- McDonald's McHire AI hiring bot exposed up to 64M applicant records via '123456' login · Lab test or researcher demonstration
- Support ticket prompt injection makes Cursor plus Supabase MCP dump integration tokens · Lab test or researcher demonstration
- Nikkei finds hidden prompts telling AI reviewers to praise papers in 17 preprints from 14 universities · Lab test or researcher demonstration
- Skynet malware sample embeds prompt injection to fool AI malware analysis tools
- Pickai backdoor spreads through ComfyUI flaws to nearly 700 AI image servers
- Asana MCP server logic flaw exposed customer data across organisations for a month
- Langflow AI agent builder RCE (CVE-2025-3248) exploited to spread Flodrix botnet
- Meta AI app's Discover feed broadcasts users' private medical and legal chats
- EchoLeak: zero-click prompt injection in Microsoft 365 Copilot (CVE-2025-32711) · Lab test or researcher demonstration
- Exposed Open WebUI instance hijacked to run AI-generated cryptominer and infostealer
- Lovable-built apps leak user data: 303 endpoints across 170 projects lacked row-level security · Lab test or researcher demonstration
- PyPI packages posing as Alibaba AI Labs SDK hide infostealer in PyTorch model
- GitLab Duo prompt injection leaks private source code via hidden merge request text · Lab test or researcher demonstration
- npm packages 'sw-cur' and 'aiide-cur' backdoor Cursor on macOS, 3,200 downloads
- xAI employee leaks API key on GitHub exposing 60 private Grok models for two months
- Korea's PIPC: DeepSeek sent Korean users' prompts to ByteDance-linked Volcano Engine
- AP/Seattle Times obtain ~3,500 unredacted student files flagged by Gaggle AI monitoring in Vancouver, WA
- Microsoft names Storm-2139 members who hijacked Azure OpenAI with stolen keys
- Copilot serves code from 20,000 GitHub repos that were made private, via Bing cache · Lab test or researcher demonstration
- Hacker 'Gloomer' claims OmniGPT breach leaking 34M chat lines and 30K user contacts
- LLMjacking crews load stolen DeepSeek keys into reverse proxies days after model launch
- nullifAI: broken-pickle models on Hugging Face evade Picklescan and carry reverse shells
- Fake 'deepseeek' and 'deepseekai' PyPI packages steal secrets from DeepSeek developers
- DeepSeek leaves ClickHouse database with chat logs and API secrets open
- OpenAI says it has evidence DeepSeek distilled its models through blocked API accounts
- DeepSeek halts new sign-ups after month-long DDoS and brute-force campaign peaks
- Ultralytics AI library hacked via GitHub Actions to push cryptominer on PyPI
- Whistleblower says LAUSD's $6M 'Ed' AI chatbot sent student data offshore before vendor AllHere collapsed
- Microsoft AI researchers expose 38TB of data via misconfigured SAS token
- Malicious 'torchtriton' dependency confusion package hits PyTorch via PyPI
The same case files in other research
- Seen in real incidents AI systems themselves become targets · International AI Safety Report · 85 shared
- Seen in real incidents Accidents with AI are hard to avoid · CAIS · 13 shared
- Seen in real incidents Powerful AI gets leaked or stolen · CAIS · 11 shared
- Seen in real incidents AI agents fail with fewer chances to stop them · International AI Safety Report · 3 shared
- Seen in real incidents AI developers' own safety measures fail · CAIS · 2 shared
- Seen in real incidents AI runs more of each attack, short of full autonomy · International AI Safety Report · 1 shared
Warnings from other sources that link to some of the same case files.
Other warnings in this group
- Outside what we measure Discrimination and toxic content
- Early signs Misinformation
- Seen in real incidents Malicious actors and misuse
- Seen in real incidents Human-computer interaction
- Outside what we measure Socioeconomic and environmental harm
- Seen in real incidents AI system safety, failures and limitations