BackAlgorithm and data
Algorithm and data
Risk Domain
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
"More than 20% of the contributions are centered on the ethical dimensions of algorithms and data. This theme can be further categorized into two main subthemes: data bias and algorithm fairness, and algorithm opacity."(p. 10)
Entity— Who or what caused the harm
Intent— Whether the harm was intentional or accidental
Timing— Whether the risk is pre- or post-deployment
Supporting Evidence (2)
1.
"Data bias and algorithm fairness (12.3%). This category encompasses two distinct research streams. The first one delves into the social consequences of data bias and algorithm fairness. Helberger et al. (2020) present findings from a survey of the Dutch adult population, revealing that AI-driven automated decision-making systems are perceived as fairer than human decision-makers by many respondents." "The second research stream focuses on practical methodologies to mitigate bias."(p. 11)
2.
"Algorithm opacity (7.8%). This subtheme gives rise to two distinct strands of research. The first one explores the necessity for regulations and indications for policymakers to ensure the responsible development of AI." " The second strand entails practical methodologies to address algorithmic opacity within specific domains"(p. 11)
Part of Design of AI
Other risks from Giarmoleo et al. (2024) (9)
Design of AI
6.1 Power centralization and unfair distribution of benefitsHumanIntentionalPre-deployment
Design of AI > Balancing AI's risks
7.3 Lack of capability or robustnessOtherOtherOther
Design of AI > Threats to human institutions and life
4.2 Cyberattacks, weapon development or use, and mass harmOtherOtherOther
Design of AI > Uniformity in the AI field
6.1 Power centralization and unfair distribution of benefitsHumanOtherOther
Human-AI interaction
5.1 Overreliance and unsafe useOtherOtherOther
Human-AI interaction > Building a human-AI environment
7.1 AI pursuing its own goals in conflict with human goals or valuesOtherOtherOther