A deepfake face-swapping app called Facemega advertised on Meta platforms using sexually suggestive videos featuring the faces of actresses Emma Watson and Scarlett Johansson without consent, promoting the creation of nonconsensual sexual content.
In March 2023, a deepfake face-swapping app called Facemega ran over 230 advertisements across Meta's platforms including Facebook, Instagram, and Messenger. The ads featured sexually suggestive videos where the faces of actresses Emma Watson (127 ads) and Scarlett Johansson (74 ads) were swapped onto other women's bodies without consent. The videos showed women appearing to initiate sexual acts, with some ads including the recognizable Pornhub intro sound. The app, developed by Chinese company Wondershare through subsidiary Ufoto Limited, charged $8 per week and included categories like 'Hot' featuring scantily clad individuals. Despite terms of service prohibiting sexually explicit content and impersonation, the app was designed to enable users to create deepfake videos by uploading any person's photo. After NBC News contacted Meta and Apple for comment, both platforms removed the ads and app respectively on Tuesday. The app remained available on Google Play with a 'Teen' rating. A journalism student's screen recording of one ad received over 10 million views on Twitter, highlighting concerns about the technology's potential for harassment and nonconsensual pornography creation.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed