Case utah-v-snap-my-aiChatbot harmUnited States
Utah sues Snap, alleging its My AI chatbot gave minors advice on hiding drugs and sex with adults
Utah's Division of Consumer Protection and Attorney General sued Snap in state court, alleging that My AI was launched without proper testing and gave underage users harmful advice. The complaint cites advice on hiding alcohol and drugs, and on setting the mood for a sexual experience with an adult.
HighHarm caused by AIStatus: OngoingVerified case file
Open in the interactive mapCite this case
- Reported
- Jun 30, 2025
- Location
- United States
- Target
- Utah children and teens using Snapchat
- Severity
- High
- Verification
- Reported by credible press or researchers
- Triggered by
- Snap Inc. (My AI)
- Actor type
- AI product design / safeguards
- Sector
- Individuals & consumers
- Reported loss
- None reported
- CVE
- None
What happened
Utah's Division of Consumer Protection and Attorney General sued Snap in state court, alleging that My AI was launched without proper testing and gave underage users harmful advice. The complaint cites advice on hiding alcohol and drugs, and on setting the mood for a sexual experience with an adult.
Impact: State seeks penalties under Utah consumer protection and privacy law; the suit also covers addictive design and sextortion
Who triggered it
Actor: Snap Inc. (My AI)
Attribution: State of Utah complaint (allegations)
Motive: None; harm alleged from product design
How it happened
Attack vector: Chatbot enabled by default and pinned above users' real friends, which cannot be removed
Root cause: As alleged: inadequate testing and safety protocols, dark patterns, and undisclosed data collection including geolocation
Timeline
- Center for Humane Technology test shows My AI advising a self-declared 13-year-old about a 31-year-old
- Utah files suit against Snap in state court
Response
Snap said it has no higher priority than user safety and called Utah's demands unconstitutional.
Current status: Ongoing
Research warnings this case matches
- Seen in real incidents People's trust in AI companions turns harmful · CAIS
- Early signs Relying on AI companions harms some users · International AI Safety Report
- Early signs Many people lean on AI for emotional support · UK AISI
- Seen in real incidents Human-computer interaction · MIT AI Risk Repository
Compared with published AI risk research from several institutes on the Research vs reality page.
Sources (open in a new tab)
- Utah Department of Commerce commerce.utah.gov
- TechBuzz News (release text) techbuzznews.com
- Utah News Dispatch utahnewsdispatch.com
Cite this case
Utah sues Snap, alleging its My AI chatbot gave minors advice on hiding drugs and sex with adults. AI Threat Watch, case utah-v-snap-my-ai, Jun 30, 2025. https://aithreat.io/cases/utah-v-snap-my-ai/
Permanent link: https://aithreat.io/cases/utah-v-snap-my-ai/
Related cases
The same type of incident, most recent first.