BackDisparate Performance
Disparate Performance
Risk Domain
Accuracy and effectiveness of AI decisions and actions are dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
"In the context of evaluating the impact of generative AI systems, disparate performance refers to AI systems that perform differently for different subpopulations, leading to unequal outcomes for those groups."(p. 6)
Entity— Who or what caused the harm
Intent— Whether the harm was intentional or accidental
Timing— Whether the risk is pre- or post-deployment
Other risks from Solaiman et al. (2023) (11)
Bias, Stereotypes, and Representational Harms
1.1 Unfair discrimination and misrepresentationAI systemUnintentionalOther
Cultural Values and Sensitive Content
1.2 Exposure to toxic contentAI systemUnintentionalPost-deployment
Privacy and Data Protection
2.1 Compromise of privacy by leaking or correctly inferring sensitive informationHumanOtherOther
Financial Costs
6.1 Power centralization and unfair distribution of benefitsHumanIntentionalOther
Environmental Costs
6.6 Environmental harmHumanUnintentionalOther
Data and Content Moderation Labor
6.2 Increased inequality and decline in employment qualityHumanIntentionalPre-deployment