Skip to main content
Home/Risks/Meek et al. (2016)/Societal manipulation

Societal manipulation

Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review

Meek et al. (2016)

Sub-category
Risk Domain

AI systems acting in conflict with human goals or values, especially the goals of designers or users, or ethical standards. These misaligned behaviors may be introduced by humans during design and development, such as through reward hacking and goal misgeneralisation, or may result from AI using dangerous capabilities such as manipulation, deception, situational awareness to seek power, self-proliferate, or achieve other goals.

"A sufficiently intelligent AI could possess the ability to subtly influence societal behaviors through a sophisticated understanding of human nature"(p. 688)

Other risks from Meek et al. (2016) (17)