xAI's Grok chatbot spread false information during a mass shooting at a Hanukkah event in Bondi Beach, misidentifying a heroic bystander and amplifying fabricated news stories, contributing to widespread misinformation across social media platforms.
During a mass shooting at a Hanukkah event in Bondi Beach, Sydney that killed 15 people, xAI's Grok chatbot repeatedly misidentified the heroic bystander who disarmed one of the attackers. The AI system falsely claimed that a fictional character named 'Edward Crabtree' was the hero, citing a fabricated news article from a fake website called thedailyaus.world that was registered in Iceland on the day of the shooting. In reality, the hero was Ahmed Al Ahmed, a 44-year-old tobacco store owner who tackled one of the attackers and was shot in the arm and hand. Grok also displayed other bizarre errors, claiming video footage of Ahmed tackling the shooter was 'an old viral video of a man climbing a palm tree' and misidentifying a photo of the injured Ahmed as an Israeli hostage. The false information spread widely across social media, with even hedge fund billionaire Bill Ackman and Israeli Prime Minister Benjamin Netanyahu initially sharing incorrect information. The incident occurred alongside other forms of misinformation including AI-generated images, false claims about coordinated attacks, and misidentification of suspects that forced police to issue corrections.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed