An autonomous delivery van in Xi'an, China dragged an electric scooter for several blocks after its wheel became entangled with debris from a previous accident, continuing to drive despite having a locked wheel.
On April 8, 2024, an autonomous delivery van developed by Jiushi Intelligent Technology Co. was involved in an incident in Xi'an, China. The driverless van, which relies entirely on cameras and sensors to navigate urban environments, encountered an electric scooter that was lying in the road after an earlier accident. While attempting to navigate around the debris, the van's left front wheel became entangled with the scooter's front wheel. Despite the wheel being completely locked and not spinning, the autonomous system continued driving, dragging the scooter along a major road for a distance before eventually stopping. The incident was captured on video and shared widely on social media, generating over 50,000 views and raising safety concerns about autonomous vehicles. The next day, April 9, another van from the same company rear-ended a Lynk&Co 08 SUV, though this second incident occurred while the vehicle was in manual mode being remotely controlled. The manufacturer stated this was the first such incident and promised to improve their algorithm to better detect irregularly shaped obstacles. No injuries were reported in either incident.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
No population impact data reported.
