MIT AI Risk InitiativeSeven risk domainsDomain 4
Malicious actors and misuse
Seen in real incidents182 matching case files
The risk domain
People using AI for disinformation, surveillance and propaganda at scale; for cyberattacks and weapons; and for fraud, scams and targeted manipulation.
Paraphrased from the source. Source: The AI Risk Repository: A Meta-Review, Database, and Taxonomy of Risks From Artificial Intelligence, MIT AI Risk Initiative, Aug 14, 2024, domain 4, Table 2, page 8–9. Summary by MIT AI Risk Initiative: airisk.mit.edu.
What the registry shows
The other pillar of the registry: deepfake fraud, AI-built malware, AI phishing and state operations.
Verified case files show this risk happening in the real world.
Matching case files per quarter
Status history
| Date | Status | Matching case files | Change |
|---|---|---|---|
| Oct 18, 2026 | Seen in real incidents | 180 | Tracking starts |
Tracked since Oct 18, 2026. A line is added when the status changes, when the first real-world case is linked, and once a month, so the record shows when a warning moved from research to reality. research_history.json
All matching case files
- Hundreds of AI agents exploit PaperCut NG/MF servers to steal Windows credentials
- Storm-3168 runs agentic Azure attacks via compromised service principals
- AI-powered espionage campaign targets government Linux infrastructure
- AI agent carries out multi-stage data theft in Spain's first AI-powered breach, per AEPD
- US advisory: attackers use AI-generated exploit scripts against exposed Siemens S7 PLCs
- Unknown actor uses AI-driven ARTEX against South Korean finance
- Aurora ransomware operators abuse Cursor Agent AI for reconnaissance and exploitation
- ChatGPT feature abuse paired with ClickFix delivers trojan to users searching via Google
- ClaudeFix: shared Claude chats used to deliver ClickFix malware instructions
- Talos finds CLOSEDQUORUM, first reported autonomous AI C2 implant
- Agentic AI attack exploits Zammad zero-days against Dutch vulnerability disclosure institute
- Meta AI model exploits third-party security flaw during evaluation
- New NGate variant hides in trojanized NFC payment app, possibly built with AI
- PurpleDelta North Korean IT workers use AI personas and custom ChatGPT assistants
- RatHat malware C2 panel uses AI to build malware and rank victims across ~100 deployments
- China-linked TA419 impersonates AI experts to phish US AI policy insiders
- UAT-11985 uses AI-assisted event lures for Google AitM phishing in Taiwan
- Unit 42 investigates autonomous AI agent breach of enterprise network in hours
- Attackers use AI tools for data exfiltration against Latin American organizations
- Man sentenced in first US AI music streaming fraud case after $8M in bot-driven royalties
- Fake CEO WhatsApp and cloned lawyer's voice trick Intesa's Fideuram into sending €95M abroad
- Greek police bust gang that cloned relatives' voices with AI to steal over 1M euros
- GTG-10007: Chinese-speaking students run autonomous Claude exploit foundry against 50 orgs
- GTG-15001: China studio ran 20+ dating apps with 4,700 Claude personas, 25,000 victims
- GTG-30006: Iranian accounts built phishing portals and SECOMS64 implant with Claude
- GTG-50029: lone French-speaking hacktivist breaches 14 European political entities
- Russia-aligned actor used AI agents to self-rebuild malware and steal ID records
- ShinyHunters affiliates use AI agents to dump 2,100+ Azure tokens from 40+ tenants
- Sandworm-linked cluster used Gemini to write password-spraying scripts against Ukraine
- Mandiant case: AI agent built from one prompt harvests thousands of credentials in 6 hours
- Heidelberg police: 75-year-old loses six-figure sum to celebrity deepfake investment video
- SilkParasite: China-nexus Central Asia espionage with AI-assisted lures and RAT code
- NSA, CISA, FBI warn of AI-generated scripts probing Siemens S7 PLCs as fake OT monitors
- Australia's NASC: deepfakes of Albanese and nine public figures tied to A$7.4M in losses
- Skatteetaten uncovers AI-generated fake receipts behind 2bn NOK in bogus tax claims
- OpenAI disrupts Poipet scam compound using ChatGPT for fraud and trafficking admin
- Trend Micro: APT passes AI agent off as authorised pentest to attack Southeast Asian org
- Trend Micro: Earth Krahang and Earth Naga fold generative AI into exploits and loaders
- Finnish police warn of Google Meet deepfakes impersonating National Police Commissioner
- TuxBot v3: Keksec-linked IoT botnet built with LLM help keeps safety disclaimers
- Indian jeweller Sky Gold's unit loses Rs 10.7 crore to alleged deepfake of director
- Colombian Dijin dismantles Ibague ring using deepfakes to pose as US consular officials
- AI-generated presenters in 550+ TikTok videos spread false claims about Singapore and Malaysia
- Saxony woman loses over 1M euros after deepfake Markus Lanz video promotes Investhub 3.0
- JADEPUFFER: LLM agent runs Langflow intrusion to database extortion end to end
- Tokyo police arrest Taiwanese collectors in 100M yen scam using deepfake of Takafumi Horie
- Chiba police arrest 19-year-old who built ransomware with AI after Asahi attack news
- Lahav 433 arrests 20-year-old who animated stolen ID photos with AI to open bank accounts
- Nigerian police arrest man behind viral AI voice clip attributed to President Tinubu
- Sophos finds ransomware-linked actor using Cursor and Claude agents to build EDR evasions
- Turkey's 'Yapay Zeka-2' operation: 16 held for deepfake ads imitating officials' voices
- Nimbus Manticore's MiniFast backdoor shows AI-assisted coding during Iran conflict
- Sao Paulo police and OAB-SP bust fake-lawyer ring that cloned lawyers' voices; R$10M moved
- Singapore businessman loses S$4.9M after Zoom meeting with deepfake PM Lawrence Wong
- FSU shooting victims' families allege ChatGPT aided the 2025 campus gunman
- GTIG intercepts first AI-developed zero-day: 2FA bypass in popular open-source admin tool
- North Korea's APT45 fed Gemini thousands of prompts to validate exploits and grow arsenal
- Russia-nexus CANFAIL and LONGSTREAM malware pad code with LLM filler to fool analysts
- PROMPTSPY Android backdoor lets Gemini drive the victim's screen and block uninstall
- PRC-nexus UNC2814 posed as C/C++ security auditor to get Gemini hunting TP-Link bugs
- Sysdig: LLM agent pivots from marimo RCE to internal Postgres dump in under an hour
- Ghana police arrest 16 over AI deepfake videos of President Mahama used to solicit money
- WKStA and Albanian police raid call centres using fake Van der Bellen crypto videos
- Tumbler Ridge shooting victims sue OpenAI over unreported flagged ChatGPT account
- Ahmedabad police bust racket using deepfake videos to beat Aadhaar face checks for loans
- Banque de France warns of deepfakes of governor Villeroy de Galhau selling investments
- Bangladesh police arrest 10 who sold illegal drugs with deepfakes of preacher Azhari
- Talos IR: public-sector credential theft via phishing page vibe-coded on Softr AI builder
- Unit 42: Go dropper asks GPT-4 whether to deploy Sliver based on host telemetry
- AI-generated ClickFix sites on typosquatted domains deliver SmartRAT
- Microsoft: North Korea's Coral Sleet runs agentic AI workflow from lures to payload tests
- Jasper Sleet IT workers used Faceswap and voice changers; thousands of accounts cut
- HP Wolf: AI-generated 'vibe-hacking' infection scripts slip past email gateways
- OnlyFake creator pleads guilty to selling 10,000+ AI-made fake IDs for KYC fraud
- Iran-nexus Dust Specter hits Iraqi officials with malware showing generative AI traces
- Hacker uses Claude to breach Mexican agencies and steal 150GB of tax and voter data
- Lagos court remands man over N230M forex scam using AI-cloned image of Peter Obi
- COINBAIT crypto-exchange phishing kit built with Lovable AI app builder
- Google: state hackers use Gemini across all attack stages; 100K-prompt extraction try
- HONESTCUE loader asks Gemini to write fresh C# second-stage code and compiles it in memory
- Okonjo-Iweala alerts Nigerians to AI video using her image for fake investment scheme
- Turkish police jail five over 410M lira investment scam using deepfakes of officials
- North Korea's UNC1069 uses AI deepfake video in fake Zoom calls against crypto firms
- CERT-FR: 42 attacker groups actively use generative AI, none yet autonomous against France
- Surrey PCC: retired engineer loses £20,000 to deepfake Martin Lewis investment video
- Taiwan ring used Starlink and deepfake faces to beat e-CNY checks and drain NT$200M
- Taichung indicts ring using ChatGPT scripts and deepfake Japanese police on video calls
- VoidLink cloud malware framework found to be built mostly by an AI agent
- NBK warns of deepfake investment ads under Central Bank of Kuwait Let's Be Aware campaign
- Egyptian prosecutors order trace of AI-fabricated explicit videos of singer Haifa Wehbe
- Dutch police arrest Amsterdam man who used deepfakes to pass bank ID checks, 46 accounts
- South Africa's FSCA fines Banxso R2bn over platform fed by Musk and Rupert deepfake ads
- Da Nang police arrest three South Koreans wanted for Cambodia deepfake romance scam ring
- Europol takedown of 700M euro crypto fraud network fed by deepfake celebrity ads
- Unit 42 tests WormGPT 4 and KawaiiGPT, criminal LLMs that write ransomware scripts
- Uruguay's Interior Ministry warns of deepfake of President Orsi as paid scam ads escalate
- Chinese state group used Claude Code to run largely autonomous espionage
- Bangkok police bust Chinese gang animating victims' photos with AI to beat bank KYC checks
- China-nexus actor bypassed Gemini refusal with CTF pretext to get exploitation guidance
- Iran's MuddyWater leaked C2 domain and encryption key to Gemini while debugging malware
- Google flags PROMPTFLUX and other malware that call Gemini at runtime
- QUIETVAULT stealer uses local AI CLI tools to hunt secrets and leaks GitHub and npm tokens
- SesameOp backdoor used OpenAI Assistants API as covert command-and-control for months
- Deepfake ads of Swedish finance figures lure 5,000 savers into pump-and-dump scams
- Kaspersky: BlueNoroff GhostCall and GhostHire campaigns sped up by generative AI
- Philippine doctor loses P93M to investment scam backed by deepfake of President Marcos
- UAE Economy Minister says his face was deepfaked in social media investment scam videos
- Hong Kong police arrest 22 who used AI face-swaps on lost ID cards to open bank accounts
- North Korea-linked cluster used ChatGPT for C2 tooling in phishing of Seoul's diplomats
- Russian-speaking criminals assembled RAT and credential stealers from ChatGPT snippets
- Scam networks in Cambodia, Myanmar and Nigeria used ChatGPT for investment-fraud personas
- UNK_DropPitch used ChatGPT to craft phishing and tooling against Taiwan's chip sector
- Pesaro retirees lose over 10,000 euros to deepfake of Meloni promoting investment site
- Old Mutual warns of deepfake videos of chairman Trevor Manuel pushing fake investments
- AI-altered video of Argentine spokesman Adorni touts fake YPF investment platform
- Brazil police bust ring using Gisele Bundchen deepfakes in Instagram ad scams
- South African Reserve Bank warns of deepfake video of Governor Kganyago pushing investment
- Microsoft blocks phishing campaign using LLM-generated obfuscated SVG files
- SentinelLABS finds MalTerminal, GPT-4-driven malware generator likely predating Nov 2023
- Hacked Raila Odinga X account posts deepfake endorsing crypto token to scam Kenyans
- Chile weighs state legal action over deepfake of President Boric in investment scam ad
- Kimsuky uses ChatGPT-forged South Korean military ID in spear-phishing
- Bank of Ireland warns of deepfake videos cloning presidential candidate Heather Humphreys
- Wuhan cyber police crack AI face-swap gang that hijacked an MCN agency's official account
- North Korean operatives used Claude to pass interviews and hold jobs at Fortune 500 firms
- Lone criminal sold Claude-built ransomware variants on forums for $400 to $1,200
- Claude Code used to automate data extortion against 17 organizations
- ESET finds PromptLock, ransomware that uses a local gpt-oss model to write scripts · Lab test or researcher demonstration
- Proofpoint: Lovable AI builder abused for Tycoon MFA phishing hitting 5,000+ organisations
- NZ FMA flags pump-and-dump scam using deepfakes of Kiwi business leaders in Meta ads
- PIB flags deepfakes of India's finance minister endorsing QuantumAI get-rich scheme
- CrowdStrike: DPRK's FAMOUS CHOLLIMA used GenAI to infiltrate 320+ companies as IT workers
- AI-written npm package @kodane/patch-manager drains Solana wallets after 1,500 downloads
- Jordan's Cybercrime Unit warns of deepfake accounts impersonating public figures
- Medellin mayor's AI-cloned voice used in paid ads for fake Nubank investment platform
- LameHug: APT28-linked malware queries Qwen LLM to generate commands
- GLOBAL GROUP RaaS deploys AI chatbot negotiators to press seven-figure ransoms
- AI videos of President Ruto resigning hit 1.4M views on TikTok during Kenya protests
- AI voice impersonator of Marco Rubio contacts foreign ministers via Signal
- Deepfakes of Netanyahu, Gadot and Musk drive Ostin Technology pump-and-dump in Israel
- Mumbai cyber police bust Bengaluru agency running deepfake stock-expert ads
- Microsoft: DPRK's Jasper Sleet IT workers use AI to forge IDs; 3,000 accounts suspended
- Cato CTRL: new WormGPT variants are jailbroken wrappers on Grok and Mixtral
- ScopeCreep: Russian-speaking actor built Windows malware with ChatGPT throwaway accounts
- VAGue Focus: China-linked accounts used ChatGPT to social-engineer US officials and press
- OpenAI bans APT15 and APT5 accounts using ChatGPT for pentest automation and US recon
- Wrong Number: Cambodia task scam used ChatGPT to translate SMS lures into six languages
- Stockholm police warn of AI deepfakes of Anders Tegnell and Agnes Wold in card-theft ads
- FBI warns AI-voice vishing campaign impersonates senior US officials to hijack accounts
- FSCA warns of WhatsApp deepfake of its commissioner pushing fake Nedbank AI trading tool
- Peru's BCP denounces AI video impersonating Credicorp CEO Gianfranco Ferrari in scam
- Vietnam busts Chinese deepfake sextortion ring that hit nearly 1,000 executives for $8M
- Indonesian police arrest three over TikTok deepfake of governor selling Rp500k motorbikes
- Anthropic bans actor using Claude to build IoT security-camera credential scraper
- Novice coder grows doxing toolkit and evasive malware builder with Claude's help
- Recruitment-fraud ring used Claude to polish fake hiring-manager lures in Eastern Europe
- AkiraBot uses GPT-4o-mini to spam 80,000 websites through contact forms and chat widgets
- Pindrop unmasks 'Ivan X', deepfake engineering candidate traced near Russia-DPRK border
- Deepfake Zoom call of executives tricks Singapore finance director into $499K transfer
- Spain's Operation COINBLACK: six held over 19M euro AI deepfake celebrity crypto scam
- Xanthorox AI: self-hosted five-model criminal platform marketed as WormGPT killer
- QatarEnergy warns public of AI-generated videos impersonating it to sell fake investments
- Malaysian police tie five deepfake videos of Anwar, Trump, Musk and Petronas to scam
- Argentine federal prosecutor probes AI video of minister Caputo promoting Immediate AI
- Leaked files expose Tbilisi call centre using Martin Lewis deepfakes to con 6,000 people
- Sheinbaum denounces AI videos of her urging Mexicans to invest in Pemex shares
- Cambodia-based romance-baiting scam used ChatGPT to generate multilingual social lures
- OpenAI disrupts North Korean IT-worker accounts writing fake resumes and interview scripts
- Kimsuky and BlueNoroff used ChatGPT to debug RDP brute-force code and research intrusion
- OpenAI bans China-linked Peer Review network building Qianyue social-media monitoring tool
- AI-cloned voice of Italy's defence minister used to con business leaders
- Vidoc Security Lab catches two deepfake job applicants in live video interviews
- Mexico's Condusef warns of AI voice-cloning calls used to request large bank transfers
- Thai police arrest two from Poipet gang using AI face-altering to pose as police
- Indonesian police arrest two over deepfake videos of President Prabowo promising cash aid
- GhostGPT: uncensored chatbot sold on Telegram to write malware and phishing for criminals
- Storm-1516 floods German election with 100+ AI-written fake news sites and deepfakes
- French woman loses 830,000 euros to AI-generated 'Brad Pitt' romance scam; probe opened
- Brasilia police Operacao VoiceOver busts gang using Marcos Mion deepfakes for voucher scam
- Check Point: FunkSec ransomware group built its Rust encryptor with AI assistance
- Las Vegas Cybertruck bomber used ChatGPT to plan explosion, police say
- Hong Kong police arrest 31 in Kowloon Bay deepfake romance-crypto syndicate (HK$34M)
The same case files in other research
- Seen in real incidents AI makes cyberattacks easier, faster and larger · CAIS · 87 shared
- Seen in real incidents Criminals and state hackers use AI in cyberattacks · International AI Safety Report · 87 shared
- Seen in real incidents AI-made fakes fuel fraud and extortion · International AI Safety Report · 81 shared
- Seen in real incidents People will set AI agents loose to cause harm · CAIS · 17 shared
- Seen in real incidents AI runs more of each attack, short of full autonomy · International AI Safety Report · 16 shared
- Seen in real incidents Every AI system tested could be jailbroken · UK AISI · 5 shared
Warnings from other sources that link to some of the same case files.
Other warnings in this group
- Outside what we measure Discrimination and toxic content
- Seen in real incidents Privacy and security
- Early signs Misinformation
- Seen in real incidents Human-computer interaction
- Outside what we measure Socioeconomic and environmental harm
- Seen in real incidents AI system safety, failures and limitations