AI Threat Watch

Case evolv-ftc-school-weapons-scannerAI misfireUnited States

FTC acts against Evolv over AI weapons scanners that missed a knife used to stab a student at a school

The FTC alleged Evolv deceptively claimed its AI-powered Evolv Express scanners would detect all weapons, citing an October 2022 case in which a seven-inch knife went undetected at a school and was used to stab a student. Evolv must let certain K-12 customers cancel contracts and is barred from unsupported claims about AI detection.

HighHarm caused by AIStatus: ResolvedVerified case file

Open in the interactive mapCite this case

Reported
Nov 26, 2024
Location
United States
Target
K-12 schools using Evolv Express AI weapons scanners (800+ schools)
Severity
High
Verification
Confirmed by victim, vendor or authority
Triggered by
Evolv Technologies
Actor type
AI product design / safeguards
Sector
Education & research
Reported loss
None reported
CVE
None

What happened

The FTC alleged Evolv deceptively claimed its AI-powered Evolv Express scanners would detect all weapons, citing an October 2022 case in which a seven-inch knife went undetected at a school and was used to stab a student. Evolv must let certain K-12 customers cancel contracts and is barred from unsupported claims about AI detection.

Impact: Student stabbed with a knife the scanner missed; schools locked into multi-year contracts; up to 50% false alarm rate after sensitivity raised

Who triggered it

Actor: Evolv Technologies

Attribution: US Federal Trade Commission complaint and stipulated order

Motive: Commercial (overstated AI capabilities)

How it happened

Attack vector: AI weapons screening at school entrances

Root cause: Scanners missed weapons and produced high false alarms while marketed as AI-accurate

Timeline

  1. Scanner misses a knife later used to stab a student at a school (month only reported)
  2. FTC announces complaint and proposed settlement

Response

Proposed order lets K-12 customers who signed April 2022 to June 2023 cancel; no monetary relief

Current status: Resolved

Sources (open in a new tab)

Cite this case

FTC acts against Evolv over AI weapons scanners that missed a knife used to stab a student at a school. AI Threat Watch, case evolv-ftc-school-weapons-scanner, Nov 26, 2024. https://aithreat.io/cases/evolv-ftc-school-weapons-scanner/

Permanent link: https://aithreat.io/cases/evolv-ftc-school-weapons-scanner/

Related cases

The same type of incident, most recent first.

This case file in other languages: EnglishFrançaisEspañolالعربية中文Русский