Amazon's Just Walk Out technology in Fresh stores failed to accurately track customer purchases, requiring over 1,000 human reviewers in India to manually verify transactions, with 70% of purchases needing human review by 2022.
Amazon deployed Just Walk Out technology in over 30 Amazon Fresh grocery stores starting in 2016, which used computer vision cameras and sensors to automatically track customer purchases without traditional checkout. The system required customers to scan QR codes when entering and exiting stores. However, the technology failed to meet accuracy targets, with 700 out of 1,000 sales requiring human review by 2022, far exceeding Amazon's internal goal of less than 50 reviews per 1,000 sales. The system relied on more than 1,000 people in India watching and labeling videos to ensure accurate checkouts, with receipts often taking hours to arrive. One customer reported that the system failed to detect when he grabbed three items simultaneously from a shelf, resulting in him being charged for only one of three bags of frozen vegetables and one of two bags of grapes. Amazon announced in 2024 that it was phasing out Just Walk Out technology from Fresh stores due to these performance issues and high operational costs, replacing it with Dash Carts and traditional self-checkout counters. The company also cut hundreds of jobs in its Physical Stores Technology team as part of this transition.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed