Biological and chemical attacks
Using AI systems to develop cyber weapons (e.g., by coding cheaper, more effective malware), develop new or enhance existing weapons (e.g., Lethal Autonomous Weapons or chemical, biological, radiological, nuclear, and high-yield explosives), or use weapons to cause mass harm.
"Growing evidence shows general- purpose AI advances beneficial to science while also lowering some barriers to chemical and biological weapons development for both novices and experts. New language models can generate step- by- step technical instructions for creating pathogens and toxins that surpass plans written by experts with a PhD and surface information that experts struggle to find online, though their practical utility for novices remains uncertain. Other models demonstrate capabilities in engineering enhanced proteins and analysing which candidate pathogens or toxins are most harmful. Experts could potentially use these in developing both more advanced weapons and defensive measures."(p. 79)
Part of Risks from malicious use
Other risks from Bengio2025 (13)
Risks from malicious use
4.0 Malicious Actors & MisuseRisks from malicious use > Harm to individuals through fake content
4.3 Fraud, scams, and targeted manipulationRisks from malicious use > Manipulation of public opinion
4.1 Disinformation, surveillance, and influence at scaleRisks from malicious use > Cyber offence
4.2 Cyberattacks, weapon development or use, and mass harmReliability issues
7.3 Lack of capability or robustnessBias
1.1 Unfair discrimination and misrepresentation