Firefighters in Manila responded to a false emergency call about a burning truck after being sent an AI-generated photo that appeared realistic, resulting in the deployment of four fire trucks to a non-existent fire.
On Thursday morning in Parola, Manila, firefighters responded to a reported burning truck incident after receiving what appeared to be a realistic photograph of the emergency. Four fire trucks, including units from the Bureau of Fire Protection, were dispatched to the location. Upon arrival, firefighters discovered that the truck was actually intact and unburned. According to Recto Volunteer fire chief Samuel Fenix, the photo that prompted the emergency response was AI-generated but looked extremely realistic. The AI-generated image had been shared through their follower network, with someone sending it to an alert follower who then reported it as an emergency. The incident demonstrates how convincing AI-generated imagery can deceive emergency responders and lead to unnecessary resource deployment.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that inadvertently generate or spread incorrect or deceptive information, which can lead to inaccurate beliefs in users and undermine their autonomy. Humans that make decisions based on false beliefs can experience physical, emotional or material harms
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed