Threats to human institutions and life
Using AI systems to develop cyber weapons (e.g., by coding cheaper, more effective malware), develop new or enhance existing weapons (e.g., Lethal Autonomous Weapons or chemical, biological, radiological, nuclear, and high-yield explosives), or use weapons to cause mass harm.
"This group comprises 11% of the articles and centers on risks stemming from AI systems designed with malicious intent or that can end up in a threat to human life. It can be divided into two key themes: threats to law and democracy, and transhumanism."(p. 12)
Supporting Evidence (2)
Threats to law and democratic values: "This theme underscores the ethical dilemmas AI poses to democratic values and human rights. One subset of research revolves around methodologies and frameworks for assessing AI's impact on fundamental rights...Another research line is concerned with AI's societal impact."(p. 12)
Transhumanism: "This category highlights the inherent uncertainty of transhumanism, which seeks to surpass biological limitations by merging humans with AI technologies.This advancement raises inquiries regarding the distinction between humans and machines, the potential outcomes of this integration, and the ethical reflections concerning improved human capabilities via AI enhancements. The ethical concern revolves around the exploration of this unfamiliar domain of human–AI fusion, which raises critical questions about identity, selfgovernance, parity, and the plausible advantages and drawbacks linked to surpassing biological restrictions. N"(p. 13)
Part of Design of AI
Other risks from Giarmoleo et al. (2024) (9)
Design of AI
6.1 Power centralization and unfair distribution of benefitsDesign of AI > Algorithm and data
1.1 Unfair discrimination and misrepresentationDesign of AI > Balancing AI's risks
7.3 Lack of capability or robustnessDesign of AI > Uniformity in the AI field
6.1 Power centralization and unfair distribution of benefitsHuman-AI interaction
5.1 Overreliance and unsafe useHuman-AI interaction > Building a human-AI environment
7.1 AI pursuing its own goals in conflict with human goals or values