Young girls in Spain, aged 11-17, received AI-generated nude images of themselves created using the ClothOff app, which were then circulated on social media and messaging platforms, causing psychological distress and in some cases being used for extortion.
In September 2023, over 20 girls aged 11-17 in Almendralejo, Spain, discovered that AI-generated nude images of themselves had been created and circulated among their peers. The images were created using the ClothOff app, which uses artificial intelligence to digitally remove clothing from photos. The perpetrators, who were also minors aged 12-14, obtained clothed photos of the girls from their social media accounts and processed them through the app for approximately 10 euros to generate 25 realistic fake nude images. The manipulated images were then shared via WhatsApp and Telegram groups across at least four of the town's five middle schools. One mother, Dr. Miriam Al Adib, publicized the incident on Instagram, leading to more victims coming forward. Spanish police launched an investigation and identified 11 boys involved in either creating or distributing the images. At least one case involved attempted extortion, where a boy demanded money from a girl and sent her a fake nude image when she refused. The incident caused significant psychological distress to the victims, with some girls reportedly afraid to leave their homes.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed