Google's AI-generated search summary incorrectly described Canadian fiddler Ashley MacIsaac as a sex offender by blending his biography with that of another man with the same last name, resulting in a cancelled concert and safety concerns.
Google's AI-generated search summary system incorrectly described Cape Breton fiddler Ashley MacIsaac as having convictions related to internet luring and sexual assault. The error occurred when the AI system blended MacIsaac's biography with that of another man from Newfoundland and Labrador bearing the same last name. This misinformation led to the cancellation of a concert at Sipekne'katik First Nation near Halifax, after the First Nation's leadership read the false information online. MacIsaac, a Juno Award-winning musician, has no such criminal record - his only publicly available legal issue was a cannabis possession charge over two decades ago for which he received a discharge. The incident left MacIsaac worried for his personal safety and concerned about potential lost work opportunities he may not even be aware of. He also expressed concern about potential impacts on his ability to enter the U.S. for concerts given increased social media scrutiny from border agents. The Sipekne'katik First Nation subsequently apologized to MacIsaac, acknowledging the error was caused by AI misinformation. Google later amended the search results, with spokesperson Wendy Manton stating they use such examples to improve their systems.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed