Skip to main content
This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .

Discriminative data bias

AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks

Schnitzer et al. (2024)

Category
Risk Domain

Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.

"Discriminative data bias describes the systematic discrimination of groups of persons in the form of data shortcomings, such as distributional representation or incorrectness. Data bias can manifest in the model and lead to unfair decisions if not appropriately treated. Note, that the term bias is often used in other contexts, such as data representation. However, these issues are treated by other AI hazards in this list."(p. 9)

Other risks from Schnitzer et al. (2024) (24)