TikTok's search algorithm systematically delivered misinformation to users searching for news topics, with 19.4% of search results containing false or misleading claims about COVID-19, elections, and other current events.
In September 2022, NewsGuard analysts conducted a study of TikTok's search function using 27 searches on news topics and analyzing 540 results. The investigation found that 105 videos (19.4%) contained false or misleading claims when users searched for neutral terms like '2022 election' and 'mRNA vaccine.' TikTok's search algorithm also suggested conspiracy-oriented search terms, such as suggesting 'climate change debunked' when users typed 'climate change' and 'covid vaccine injury' when searching for 'covid vaccine.' The misinformation included dangerous health claims like DIY hydroxychloroquine recipes, false election fraud narratives, conspiracy theories about the January 6 Capitol attack, and misleading information about the Russia-Ukraine war. TikTok, owned by Chinese company ByteDance, uses AI-driven content review systems for newly uploaded videos. The platform's growing use as a search engine by young people, particularly Gen Z, makes this systematic delivery of misinformation particularly concerning. When contacted, TikTok provided general statements about their community guidelines but did not directly address specific questions about their search algorithm or moderation practices.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed