A Tesla Model 3's Autopilot system misidentified red and orange letters on gas station flags as traffic lights, causing the car's display to show intermittent red and yellow traffic light signals while stationary.
A Tesla Model 3 equipped with Autopilot technology experienced a malfunction where the system incorrectly interpreted visual elements from the environment. The incident was captured on video by a Reddit user and posted to the r/teslamotors subreddit. While the vehicle was stationary at what appears to be a gas station, the Autopilot system's display showed traffic lights changing intermittently from red to yellow and back to red. Investigation revealed that the system was misidentifying the round 'o' letters in red and orange colors on vertical flags displaying the word 'coop' as traffic lights. As the flags moved in the wind, the system's perception of these letters as traffic signals caused the erratic display behavior. The incident occurred during Tesla's rollout of its Full Self-Driving Beta to select Tesla owners. Tesla CEO Elon Musk had recently described the new Full Self-Driving Beta update as a 'quantum leap' compared to previous versions, though release notes emphasized that the system 'may do the wrong thing at the worst time' and drivers must keep their hands on the wheel. The malfunction was described as 'thankfully non-dangerous' and serves as a reminder of the current limitations of Tesla's autonomous driving technology.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed