AI systems that develop, access, or are provided with capabilities that increase their potential to cause mass harm through deception, weapons development and acquisition, persuasion and manipulation, political strategy, cyber-offense, AI development, situational awareness, and self-proliferation. These capabilities may cause mass harm due to malicious human actors, misaligned AI systems, or failure in the AI system.
"The model could build new AI systems from scratch, including AI systems with dangerous capabilities. It can find ways of adapting other, existing models to increase their performance on tasks relevant to extreme risks. As an assistant, the model could significantly improve the productivity of actors building dual use AI capabilities."(p. 5)
Other risks from Shevlane et al. (2023) (8)
Cyber-offense
4.2 Cyberattacks, weapon development or use, and mass harmDeception
7.2 AI possessing dangerous capabilitiesPersuasion and manipulation
7.2 AI possessing dangerous capabilitiesPolitical strategy
7.2 AI possessing dangerous capabilitiesWeapons acquisition
7.2 AI possessing dangerous capabilitiesLong-horizon planning
7.2 AI possessing dangerous capabilities