On March 22, 2003, a U.S. Patriot missile system misidentified a UK Tornado fighter jet as an Iraqi anti-radiation missile and shot it down, killing two RAF crew members instantly in a friendly fire incident.
On March 22, 2003, during the early days of the U.S.-led invasion of Iraq, an American Patriot missile battery fired an interceptor missile at what its computer system identified as an incoming Iraqi anti-radiation missile. The Patriot system's phased array radar detected and tracked a UK Tornado GR4 fighter jet (ZG710) returning to Ali Al Salem Air Base in Kuwait at 23:48 hours. The aircraft was flown by Flight Lieutenants Kevin Main and David Williams. The Patriot's automated computer system classified the approaching aircraft as an anti-radiation missile based on its flight profile and the lack of an identification-friend-or-foe (IFF) response. The American crew, operating with about one minute to decide, followed the system's recommendation and fired the missile in self-defense. The Patriot missile struck the Tornado directly, killing both crew members instantly and destroying the aircraft. A subsequent RAF Board of Inquiry found that multiple factors contributed to the tragedy: the Patriot's broad classification criteria for anti-radiation missiles, inadequate rules of engagement, the crew's lack of direct communication with battalion headquarters, and the failure of the Tornado's IFF system. The Patriot system was manufactured by Raytheon and featured automated operations with human override capabilities, designed to respond quickly to incoming threats.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed