Meta's AI tool falsely accused conservative activist Robby Starbuck of participating in the January 6 Capitol riot and being linked to QAnon, prompting a $5 million defamation lawsuit.
In August 2024, conservative activist Robby Starbuck discovered that Meta AI was falsely claiming he participated in the January 6, 2021 Capitol riot and was linked to QAnon. The false information was revealed when a Harley-Davidson dealer in Vermont posted a screenshot of Meta AI's response during Starbuck's campaign against the company's DEI policies. Starbuck, who was actually in Tennessee on January 6, 2021, immediately denied the allegations and contacted Meta executives including Mark Zuckerberg to correct the information. His lawyer sent a cease-and-desist letter to Meta in August 2024. Despite Meta acknowledging the complaint and stating an investigation was underway, the AI continued generating false statements about Starbuck for months. The false claims later expanded to include allegations that he pleaded guilty to disorderly conduct related to the Capitol riot and promoted Holocaust denial. Other AI tools like ChatGPT and xAI's Grok stated that Starbuck wasn't at the riot and identified the misinformation as originating from Meta AI. By April 2025, Starbuck filed a defamation lawsuit in Delaware Superior Court seeking over $5 million in damages, citing death threats against his family, reputational harm, and lost business opportunities.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed