The FBI warned of increasing use of AI-generated deepfake videos in sextortion schemes targeting minors and adults, where malicious actors create fake sexually explicit content using victims' photos to demand payments or real explicit material.
The FBI issued a public alert in 2023 about the growing use of artificial intelligence to create deepfake videos for sextortion schemes. Malicious actors obtain photos from victims' social media accounts or other online sources and use AI-powered deepfake software to create realistic sexually explicit videos featuring the victims' likenesses. The FBI reported an uptick in cases as of April 2023 where victims, including minors and non-consenting adults, had their photos manipulated into explicit content that was then used for harassment or extortion. The scammers typically demand either payment (money or gift cards) or real sexually explicit images from victims, threatening to share the fake content with family, friends, or employers if demands are not met. The deepfake creation tools have become increasingly accessible and sophisticated, with some requiring only a single photo to generate realistic videos. While many legitimate deepfake services include safeguards against inappropriate use, these protections are often easily circumvented, and unrestricted services exist in underground markets. Victims often remain unaware their images have been manipulated until someone else brings it to their attention or they discover the content online themselves.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed