Middle school boys used an AI app to create deepfake nude images of three female classmates and shared them with other students, causing psychological harm to the victims.
In early October 2023, at Mountain View Middle School in Goffstown, New Hampshire, 8th grade boys aged 13-14 used an AI application to create deepfake nude images and videos of three female classmates. The AI app required only a regular photo to 'undress' the person through artificial intelligence. The boys then shared these explicit deepfake images with other students. A student came forward to report the incident after hearing about the images being circulated among classmates. The principal contacted the parents of the three victim girls in early October to notify them. The incident caused significant psychological distress to the victims, with one girl not wanting to attend school and having difficulty facing her peers. Parents criticized the school district for taking a month to notify the broader parent community about the AI-related incident. The district sent an email from Superintendent Brian Balke addressing the incident but citing confidentiality requirements that limited specific details about student discipline and outcomes. The affected mothers called for better education about AI dangers and accountability for the perpetrators.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed