Researchers discovered a deepfake ecosystem on Telegram where bots generate non-consensual fake nude images of women, with over 100,000 images created and shared by July 2020.
Security firm Sensity discovered a deepfake ecosystem on the messaging app Telegram centered around bots that generate fake nude images on request. The bots use DeepNude software, which employs generative adversarial networks (GANs) to create non-consensual pornographic images. Users primarily create fake nudes of women they know using images taken from social media, then share and trade these images in various Telegram channels. By July 2020, more than 100,000 images had been generated and shared in public Telegram channels. The ecosystem includes over 100,000 members across seven connected channels, with approximately 70% of users from Russia and neighboring countries. The bots are free to use but generate watermarked images, with users paying around $1.28 for 100 unwatermarked images over seven days. The system includes gamification elements where users can vote on images and earn tokens for premium features. Sensity reported that a limited number of bot-generated images appeared to feature underage targets. Despite contact attempts, Telegram did not respond to inquiries about permitting this content on their platform.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed