Delegating by humans of key decisions to AI systems, or AI systems that make decisions that diminish human control and autonomy, potentially leading to humans feeling disempowered, losing the ability to shape a fulfilling life trajectory, or becoming cognitively enfeebled.
As AI systems encroach on human-level intelligence, more and more aspects of human labor will become faster and cheaper to accomplish with AI. As the world accelerates, organizations may voluntarily cede control to AI systems in order to keep up. This may cause humans to become economically irrelevant, and once AI automates aspects of many industries, it may be hard for displaced humans to reenter them(p. 13)
Other risks from Hendrycks & Mazeika (2022) (7)
Weaponization
4.2 Cyberattacks, weapon development or use, and mass harmEroded epistemics
3.2 Pollution of information ecosystem and loss of consensus realityProxy misspecification
7.1 AI pursuing its own goals in conflict with human goals or valuesValue lock-in
6.1 Power centralization and unfair distribution of benefitsEmergent functionality
7.2 AI possessing dangerous capabilitiesDeception
7.1 AI pursuing its own goals in conflict with human goals or values