Skip to main content
This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .

Societal manipulation

Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review

Meek et al. (2016)

Sub-category
Risk Domain

AI systems acting in conflict with human goals or values, especially the goals of designers or users, or ethical standards. These misaligned behaviors may be introduced by humans during design and development, such as through reward hacking and goal misgeneralisation, or may result from AI using dangerous capabilities such as manipulation, deception, situational awareness to seek power, self-proliferate, or achieve other goals.

"A sufficiently intelligent AI could possess the ability to subtly influence societal behaviors through a sophisticated understanding of human nature"(p. 688)

Other risks from Meek et al. (2016) (17)