A self-driving car from team SIT Acronis Autonomous in the Roborace Season Beta 1.1 abruptly drove directly into a wall during round one of the race.
During round one of the Roborace Season Beta 1.1 race, team SIT Acronis Autonomous experienced a significant failure when their self-driving car abruptly drove directly into a wall. The incident occurred while the car was rounding a gentle curve and was not racing against other vehicles at the time, indicating that track conditions were not a contributing factor. Another team, Autonomous Racing Graz, also experienced problems with their vehicle becoming 'lost' on the track due to positioning issues, which cut their race short. The race was still ongoing at the time of reporting, with three remaining competitors. The incident highlights the challenges of deploying AI systems in high-speed racing environments where there is less time for decision-making and hazard response compared to road-oriented autonomous vehicles. The Roborace initiative aims to help teams learn from such failures to improve their AI systems for better performance in racing conditions.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
No population impact data reported.