Humans might increasingly hand over control to misaligned AI systems
Delegating by humans of key decisions to AI systems, or AI systems that make decisions that diminish human control and autonomy, potentially leading to humans feeling disempowered, losing the ability to shape a fulfilling life trajectory, or becoming cognitively enfeebled.
"Organisations around the world are already deploying misaligned AI systems that are causing harm in unexpected ways.250 Recommendation algorithms increase the consumption of extremist content.251 Medical algorithms have been known to misdiagnose US patients,252 and recommend incorrect prescriptions.253 Still, we hand over more control to them, often because they are still as - or more - effective than human decision making, or because they are cheaper."(p. 26)
Supporting Evidence (1)
"As economic production becomes increasingly dependent on AI systems, the cost of maintaining or reintroducing human control will increase. Advanced AI systems may alter complex systems in ways that are hard to understand,261 making it hard or risky to extract them. As a result, AI systems may increasingly steer society in a direction that is at odds with its long-term interests, even without any intention by any AI developer for this to happen.262 Even if many people recognize it happening, it may be difficult to stop (again, the analogy with climate change is illustrative)."(p. 26)
Part of Loss of control
Other risks from DSIT (2023) (12)
Bias, Fairness and Representational Harms
1.1 Unfair discrimination and misrepresentationMisuse risks
4.0 Malicious Actors & MisuseLoss of control
5.2 Loss of human agency and autonomyLoss of control > Degradation of the information environment
3.2 Pollution of information ecosystem and loss of consensus realityLoss of control > Labour market disruption
6.2 Increased inequality and decline in employment qualityLoss of control > Dual Use Science risks
4.2 Cyberattacks, weapon development or use, and mass harm