Google's AI Overview feature incorrectly stated that an Air India plane crash involved an Airbus A330 when it was actually a Boeing 787, spreading misinformation about the aircraft type in search results following the tragic incident.
Google's AI Overview feature generated incorrect information about a tragic Air India Flight 171 plane crash that killed more than 200 passengers and crew. When users searched for information about Airbus plane crashes, the AI Overview incorrectly stated that the Air India crash involved an Airbus A330, when it was actually a Boeing 787. The misinformation appeared in search results with the AI displaying confidence in its incorrect statements. Multiple searches produced inconsistent results, with some AI overviews stating Boeing, some stating Airbus, and some containing a mixture of both manufacturers. Google acknowledged the error and manually removed the incorrect response after being contacted about the issue. The company stated that the accuracy rate for AI Overviews is comparable to other search features like Featured Snippets, and that they use examples like this to improve their systems.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed