Tesla's Full Self-Driving beta feature included an 'Assertive' mode that performed rolling stops at intersections without coming to a complete stop, violating U.S. traffic laws and increasing collision risk for 53,822 vehicles until the feature was voluntarily recalled.
Tesla deployed a Full Self-Driving (FSD) beta feature with three driving profiles - 'Chill,' 'Average,' and 'Assertive' - that controlled vehicle behaviors including following distance, lane changes, and stop sign behavior. The 'Assertive' profile specifically allowed vehicles to perform 'rolling stops' at all-way-stop intersections, traveling at speeds up to 5.6 mph without coming to a complete stop when certain conditions were met, including no detected moving cars, pedestrians, or bicyclists near the intersection. This feature was first introduced in firmware release 2020.40.4.10 on October 20, 2020, affecting 53,822 vehicles in the FSD beta population. Rolling stops are generally illegal in the U.S. and increase collision risk. After meetings with NHTSA on January 10 and 19, 2022, Tesla voluntarily recalled the feature on January 20, 2022, and began disabling the rolling stop functionality through over-the-air firmware updates starting with release 2021.44.30.15 in early February 2022. Tesla reported no known collisions, injuries, or fatalities related to this specific rolling stop functionality as of January 27, 2022.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed