Amazon's Alexa voice assistant recorded a private conversation in a Portland family's home and sent the audio file to a random person in Seattle who was in the family's contact list.
A Portland family discovered that their Amazon Alexa voice-controlled smart speakers had recorded a private conversation about hardwood floors and automatically sent the audio file to one of the husband's employees in Seattle. The family had multiple Alexa devices throughout their home controlling heat, lights, and security systems. The recipient called to warn them about the privacy breach, prompting the family to unplug all devices immediately. Amazon investigated and confirmed the incident occurred, with an engineer apologizing repeatedly and explaining that the device mistakenly interpreted background conversation as a series of voice commands. According to Amazon's explanation, Alexa woke up when it heard something resembling 'Alexa,' then interpreted subsequent background conversation as a 'send message' request, followed by a contact name, and finally confirmation to send. The family reported feeling invaded and losing trust in the devices. Amazon called it an 'extremely rare occurrence' and stated they were taking steps to prevent future incidents, but declined to provide a refund for the devices.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that memorize and leak sensitive personal data or infer private information about individuals without their consent. Unexpected or unauthorized sharing of data and information can compromise user expectation of privacy, assist identity theft, or cause loss of confidential intellectual property.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed