BackSudden loss of control
Sudden loss of control
Risk Domain
AI systems acting in conflict with human goals or values, especially the goals of designers or users, or ethical standards. These misaligned behaviors may be introduced by humans during design and development, such as through reward hacking and goal misgeneralisation, or may result from AI using dangerous capabilities such as manipulation, deception, situational awareness to seek power, self-proliferate, or achieve other goals.
"Sudden loss of control, also known as an AI takeover [115], is a scenario where an AI rapidly achieves superintelligence through “fast takeoff” or recursive self-improvement. This poses an existential risk [116], [117]."(p. 9)
Entity— Who or what caused the harm
Intent— Whether the harm was intentional or accidental
Timing— Whether the risk is pre- or post-deployment
Other risks from Chin (2025) (5)
CBRN
4.2 Cyberattacks, weapon development or use, and mass harmHumanIntentionalPost-deployment
Cyber offense
4.2 Cyberattacks, weapon development or use, and mass harmOtherIntentionalPost-deployment
Gradual loss of control
5.2 Loss of human agency and autonomyOtherUnintentionalOther
Environmental risk
6.6 Environmental harmOtherUnintentionalPre-deployment
Geopolitical risk
6.4 Competitive dynamicsOtherUnintentionalOther