Demographic diversity of researchers
AI-driven concentration of power and resources within certain entities or groups, especially those with access to or ownership of powerful AI systems, leading to inequitable distribution of benefits and increased societal inequality.
"The AI research establishment inherits patterns of under-representation that are dominant in most technical elds. In North America, large parts of professional AI research require a Ph.D., yet less than 25% of Ph.D. computer scientists are women, and fewer than 2% are Black or African American [608]. This holds globally and outside the research community: LinkedIn data suggests that only 22% of AI professionals are women [161]. Since the vast majority of AI practitioners work for private companies, limited corporate statistics on gender and racial diversity hinder a full understanding of the situation [402], but those few statistics that exist are not encouraging: only 5% of Google and 7% of Microsoft employees are Black or African American, with potentially even lower representation at the more senior levels [212, 384]."(p. 16)
Part of Within-country issues: domestic inequality
Other risks from Leech et al. (2024) (13)
Harm caused by incompetent systems
7.3 Lack of capability or robustnessHarm caused by unaligned competent systems
7.1 AI pursuing its own goals in conflict with human goals or valuesHarm caused by unaligned competent systems > Specification gaming
7.1 AI pursuing its own goals in conflict with human goals or valuesHarm caused by unaligned competent systems > Emergent goals
7.1 AI pursuing its own goals in conflict with human goals or valuesHarm caused by unaligned competent systems > Deceptive alignment
7.2 AI possessing dangerous capabilitiesWithin-country issues: domestic inequality
6.1 Power centralization and unfair distribution of benefits