AI's persuasive capabilities are misused to gain influence and promote harmful ideologies
A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values
Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.
"As AI capabilities advance, they may be used to develop sophisticated persuasion tools, such as those that tailor their communication to specific users to persuade them of certain claims [42]. While these tools could be used for social good— such as New York Times’ chatbot that helps users to persuade people to get vaccinated against Covid-19 [27]—there are also many ways they could be misused by self-interested groups to gain influence and/or to promote harmful ideologies."(p. 6)
Part of Worsened epistemic processes for society
Other risks from Clarke2023 (19)
Worsened conflict
6.4 Competitive dynamicsWorsened conflict > AI enables development of weapons of mass destruction
4.2 Cyberattacks, weapon development or use, and mass harmWorsened conflict > AI enables automation of military decision-making
5.2 Loss of human agency and autonomyWorsened conflict > AI-induced strategic instability
5.2 Loss of human agency and autonomyWorsened conflict > Resource conflicts driven by AI development
6.4 Competitive dynamicsIncreased power concentration and inequality
6.1 Power centralization and unfair distribution of benefits