Skip to main content
This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
BackHomogenization or correlated failures in model derivatives

Homogenization or correlated failures in model derivatives

Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems

Gipiškis et al. (2024)

Sub-category
Risk Domain

AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.

"Homogenization refers to common methodologies and models used across down- stream GPAI systems, which may lead to uniform failures and amplification of biases [176, 30]. This risk arises when numerous downstream AI systems are built upon a few large-scale foundation models."(p. 51)

Supporting Evidence (1)

1.
"This may be caused by centralization of AI advancements within a few compa- nies, as well as flaws from algorithmic monoculture, where dataset sources and collection methods are similar across numerous AI models. Homogenization in models may lead to consistent and arbitrary rejection, mis- treatment, scrutiny, or misclassification of specific users of groups, as well as the spread of implicit perspectives (e.g. bias towards a particular political group) across multiple application domains."(p. 51)

Part of Impacts of AI (Bias)

Other risks from Gipiškis et al. (2024) (144)