Capabilities that could be used to reduce human control - Autonomous replication and adaptation
AI systems that develop, access, or are provided with capabilities that increase their potential to cause mass harm through deception, weapons development and acquisition, persuasion and manipulation, political strategy, cyber-offense, AI development, situational awareness, and self-proliferation. These capabilities may cause mass harm due to malicious human actors, misaligned AI systems, or failure in the AI system.
"Controlling AI systems could become much harder if they could autonomously persist, replicate, and adapt in cyberspace. No current AI systems have this capability, but recent research found that frontier AI agents can perform some relevant tasks.279"(p. 28)
Part of Loss of control
Other risks from DSIT (2023) (12)
Bias, Fairness and Representational Harms
1.1 Unfair discrimination and misrepresentationMisuse risks
4.0 Malicious Actors & MisuseLoss of control
5.2 Loss of human agency and autonomyLoss of control > Degradation of the information environment
3.2 Pollution of information ecosystem and loss of consensus realityLoss of control > Labour market disruption
6.2 Increased inequality and decline in employment qualityLoss of control > Dual Use Science risks
4.2 Cyberattacks, weapon development or use, and mass harm