AI systems that develop, access, or are provided with capabilities that increase their potential to cause mass harm through deception, weapons development and acquisition, persuasion and manipulation, political strategy, cyber-offense, AI development, situational awareness, and self-proliferation. These capabilities may cause mass harm due to malicious human actors, misaligned AI systems, or failure in the AI system.
"There is growing concern that AI-based systems can discover and exploit vulnerabilities in software or cyberinfrastructure [354]."(p. 19)
Other risks from Leech et al. (2024) (13)
Harm caused by incompetent systems
7.3 Lack of capability or robustnessHarm caused by unaligned competent systems
7.1 AI pursuing its own goals in conflict with human goals or valuesHarm caused by unaligned competent systems > Specification gaming
7.1 AI pursuing its own goals in conflict with human goals or valuesHarm caused by unaligned competent systems > Emergent goals
7.1 AI pursuing its own goals in conflict with human goals or valuesHarm caused by unaligned competent systems > Deceptive alignment
7.2 AI possessing dangerous capabilitiesWithin-country issues: domestic inequality
6.1 Power centralization and unfair distribution of benefits