An Xpeng P7 vehicle with NGP automatic navigation assisted driving system collided with a truck when the AI system failed to identify the distance and presence of the vehicle ahead, causing slight injuries to the driver.
On September 23, an Xpeng P7 vehicle equipped with NGP (Navigation Guided Pilot) automatic navigation assisted driving system was involved in a collision with a truck in China. The vehicle was traveling at approximately 60 km/h when the incident occurred. The driver was using the NGP mode and trusted the system to automatically slow down when approaching the truck ahead. However, the Xpilot automatic driving assistance system failed to recognize the large truck in front of the vehicle, specifically a flatbed truck with an extended tail section that was not carrying cargo. The P7 is equipped with 31 sensors including ultrasonic sensors, high-definition millimeter wave radars, and advanced driver assistance cameras designed to detect the surrounding environment. According to Xpeng Motors officials, the system's front vehicle identification, seat belt vibration reminder, vehicle warning, and AEB functions were working normally before the collision. The accident resulted in slight injuries to the driver. Experts suggest the failure may have been caused by the visual camera's inability to properly identify the unusual shape of the empty flatbed truck. This type of incident involving autonomous driving systems failing to recognize unusually shaped vehicles has occurred multiple times with other manufacturers including Nio and Tesla.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed