AI-generated deepfake technology was used to create fraudulent advertisements featuring a doctor and TV host promoting unregistered medicine, while criminal groups used similar technology to generate over 40 billion euros in investment fraud profits.
The report describes incidents where AI-generated deepfake technology was used to create fraudulent content featuring real people without their consent. Doctor Spas Spaskov and TV host Simeon Ivanov were depicted in fake advertisements promoting an unregistered medicine, created by altering real TV footage with changed audio. The fake publication was reported by public television and removed. Criminal groups controlled by Gal Barak and Ilan Tsoria allegedly generated over 40 billion euros in profits through investment scams using deepfakes of celebrities in call center operations. The report also describes an experiment where journalist Nadya Obretenova consented to having her likeness replicated using AI for cybersecurity demonstration purposes. The technology allows real-time video calls where a man wearing a wig can appear as the target person through AI face-swapping applications like Viber. Cybersecurity experts note that fake videos of political leaders like Zelensky and Putin have been used in hybrid warfare, with Putin's deepfake initially fooling many people when it declared peace with Ukraine. The report indicates that deepfake technology is becoming increasingly sophisticated and accessible, making detection more difficult.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
