Quality of training data
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
"The quality of training data is another challenge faced by generative AI. The quality of generative AI models largely depends on the quality of the training data (Dwivedi et al., 2023; Su & Yang, 2023). Any factual errors, unbalanced information sources, or biases embedded in the training data may be reflected in the output of the model. Generative AI models, such as ChatGPT or Stable Diffusion which is a text-to-image model, often require large amounts of training data (Gozalo-Brizuela & Garrido-Merchan, 2023). It is important to not only have high-quality training datasets but also have complete and balanced datasets."(p. 288)
Part of Technology concerns
Other risks from Nah et al. (2023) (17)
Technology concerns
7.3 Lack of capability or robustnessTechnology concerns > Hallucination
3.1 False or misleading informationTechnology concerns > Explainability
7.4 Lack of transparency or interpretabilityTechnology concerns > Authenticity
6.3 Economic and cultural devaluation of human effortTechnology concerns > Prompt engineering
7.4 Lack of transparency or interpretabilityRegulations and policy challenges
6.5 Governance failure