Google's AI Overview tool provided incorrect information about restaurant specials at Stefanina's Wentzville, causing customers to demand non-existent deals and creating conflicts with restaurant staff.
Google deployed an AI-powered tool called AI Overview designed to enhance search results for users seeking information about local businesses. The system was intended to provide quick answers and information about restaurant specials and menu items. However, at Stefanina's Wentzville restaurant in Missouri, the AI tool began generating and displaying false information about deals and specials that did not exist. One specific example mentioned was the AI claiming the restaurant offered a large pizza for the same price as a small pizza. The system also generated incorrect menu items. When customers arrived at the restaurant expecting these non-existent deals, they became angry with restaurant employees who could not honor the AI-generated specials. The restaurant owner Eva Gannon stated that as a small business, they could not afford to honor these false promotions. The restaurant was forced to post warnings on social media asking customers not to rely on Google AI for information about their specials and directing them to use the restaurant's official Facebook page or website instead. Google's own documentation acknowledges that AI Overview results may sometimes be inaccurate due to the tool making mistakes or misunderstanding data.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed