Using AI systems to develop cyber weapons (e.g., by coding cheaper, more effective malware), develop new or enhance existing weapons (e.g., Lethal Autonomous Weapons or chemical, biological, radiological, nuclear, and high-yield explosives), or use weapons to cause mass harm.
"The model can discover vulnerabilities in systems (hardware, software, data). It can write code for exploiting those vulnerabilities. It can make effective decisions once it has gained access to a system or network, and skilfully evade threat detection and response (both human and system) whilst focusing on a specific objective. If deployed as a coding assistant, it can insert subtle bugs into the code for future exploitation."(p. 5)
Other risks from Shevlane et al. (2023) (8)
Deception
7.2 AI possessing dangerous capabilitiesPersuasion and manipulation
7.2 AI possessing dangerous capabilitiesPolitical strategy
7.2 AI possessing dangerous capabilitiesWeapons acquisition
7.2 AI possessing dangerous capabilitiesLong-horizon planning
7.2 AI possessing dangerous capabilitiesAI development
7.2 AI possessing dangerous capabilities