A network of 17 TikTok accounts used AI text-to-speech technology to create hyper-realistic narration for conspiracy theory videos that received 336 million views and spread false information about public figures.
In September 2023, NewsGuard identified a network of 17 TikTok accounts that leveraged AI text-to-speech software, primarily ElevenLabs, to generate approximately 5,000 videos containing conspiracy content. Since June 2023, these videos accumulated 336 million views and 14.5 million likes. The AI-generated narration spread baseless claims including that Barack Obama was connected to his chef's death, that Oprah Winfrey is a 'sex trader,' and that Jamie Foxx was paralyzed by COVID-19 vaccines. The accounts used deceptive branding to resemble mainstream news outlets like E! News and Yahoo News. ElevenLabs confirmed with 98% certainty that their technology was used to create the audio. The AI voices were so realistic that only occasional glitches revealed their artificial nature. TikTok removed three accounts for impersonation violations and one video for manipulated media policy violations, while restricting algorithmic promotion of four videos for misinformation. The incident demonstrates how AI voice technology enables rapid, cheap production of convincing false content that reaches massive audiences.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed