AI Threat Watch

Education & research

Schools, universities and research institutes: AI-enabled cheating fraud, deepfake abuse of students and breaches of research data.

Last 12 months · since Nov 4, 2025

22Case files+6 vs previous 12 months · All time: 63
9Critical or high
$0Documented losses
8Official warnings
Deepfake abuseMost frequent attack type12

See also the Education and young people hub →

Official warnings and preparedness

Public warnings, exercises, advisories and new rules from heads of government, ministers, regulators, central banks, intergovernmental bodies and national cyber agencies. Each entry links to its source.

  • AdvisoryCISA, NSA and FBI · Security agencyUnited States

    US agencies warn of industrial-scale knowledge distillation campaigns against US AI models

    The agencies said China-based AI companies have extracted billions of tokens from US frontier models since at least late 2024, and urged AI developers to detect suspicious activity, alter responses to suspected distillation and share intelligence.

    Source: CISA

  • AdvisoryeSafety Commissioner (Australia) · RegulatorAustralia

    Australia's eSafety Commissioner issues advisory on AI misuse of school photos

    eSafety urged schools to review how they share images online after receiving over 100 reports in January to March 2026 of accounts misusing school photos, including AI-generated sexualised deepfakes and face swaps of students and staff.

    Source: Human Rights Watch

  • RuleUK Department for Education · MinisterUnited Kingdom

    Keeping Children Safe in Education 2026 covers AI-generated nude images

    The 2026 statutory safeguarding guidance, in force from 1 September 2026, defines sharing nudes and semi-nudes to include images digitally altered or wholly generated using AI, and links schools to generative AI safety expectations.

    Source: EdTech Innovation Hub

  • RuleMinnesota legislature · LegislatureUnited States

    Minnesota passes first US ban on 'nudification' apps

    According to 19th News, Minnesota has passed what it describes as the nation's first ban on 'nudification' apps, which use AI to create fake nude images of real people.

    Source: 19thnews.org via Hacker News

  • WarningUK National Crime Agency and Early Warning Working Group · Security agencyUnited Kingdom

    UK schools advised to remove identifiable pupil photos as AI blackmail threat grows

    The National Crime Agency warned that criminals use AI to alter children's photos taken from school sites and demand payment, and schools were advised to remove or limit identifiable pupil images online.

    Source: Internet Watch Foundation (republishing The Guardian)

  • WarningWhite House Office of Science and Technology Policy (Director Michael Kratsios) · Head of governmentUnited States

    White House memo NSTM-4 addresses adversarial distillation of US AI models

    The memo said foreign entities, principally in China, run industrial-scale campaigns to distil US frontier AI models, and committed agencies to share information with AI developers and explore accountability measures.

    Source: The White House

  • AdvisoryMassachusetts Department of Elementary and Secondary Education (Healey-Driscoll administration) · RegulatorUnited States

    Massachusetts tells school districts to promptly investigate AI deepfake images of students

    A letter to districts statewide said creating a sexual deepfake of a minor is a crime and directed school leaders to investigate complaints about AI-generated explicit images of students promptly.

    Source: The Boston Globe

  • AdvisoryUK Department for Education · MinisterUnited Kingdom

    UK Department for Education updates generative AI product safety standards for schools

    The update added standards on cognitive, emotional and social development, mental health and protection against manipulation to the capabilities generative AI products used in schools and colleges should meet.

    Source: GOV.UK

Verified incidents

+12

Older than 12 months (archive): 41

← All sectors

Language: EnglishFrançaisEspañolالعربية中文Русский