Amazon's Alexa voice assistant misinterpreted children's requests for songs and responded with explicit sexual content, exposing multiple children to inappropriate pornographic terms and references.
Multiple incidents occurred involving Amazon's Alexa voice assistant, primarily the Echo and Echo Dot devices, misinterpreting children's voice commands and responding with explicit sexual content. The most documented case involved a toddler asking Alexa to 'play Digger Digger' and receiving a response that included pornographic terms like 'porn detected,' 'hot chick amateur girl,' and various explicit sexual words. The incident was caused by Alexa accessing a prank ringtone on Spotify with an extremely vulgar title that contained multiple pornographic terms. Additional cases included children asking for other songs and receiving inappropriate responses, such as a child asking to spell 'book' and Alexa spelling a profanity instead. These incidents occurred across multiple families who had recently received Amazon Echo devices, often as Christmas gifts. The viral YouTube video of one incident received over 7 million views. Amazon acknowledged the issue, apologized to affected families, and stated they had fixed the problem and were working to build additional restrictions to prevent future occurrences. The incidents highlighted concerns about the lack of parental controls and content filtering on Amazon's voice assistant devices when used by children.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed