Governance of autonomous intelligence systems

The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration

Wirtz, Weyerer & Sturm (2020)

Source DOI

Sub-category

Risk Domain

6Socioeconomic & Environmental

6.5Governance failure

Inadequate regulatory frameworks and oversight mechanisms that fail to keep pace with AI development, leading to ineffective governance and the inability to manage AI risks appropriately.

"Governance of autonomous intelligence systemaddresses the question of how to control autonomous systems in general. Since nowadays it is very difficult to conceive automated decisions based on AI, the latter is often referred to as a ‘black box’ (Bleicher, 2017). This black box may take unforeseeable actions and cause harm to humanity."(p. 820)

Entity— Who or what caused the harm

Human

Due to a decision or action made by humans

AI system

Due to a decision or action made by an AI system

Other

Due to some other reason or is ambiguous

Intent— Whether the harm was intentional or accidental

Intentional

Due to an expected outcome from pursuing a goal

Unintentional

Due to an unexpected outcome from pursuing a goal

Other

Without clearly specifying the intentionality

Timing— Whether the risk is pre- or post-deployment

Pre-deployment

Occurring before the AI is deployed

Post-deployment

Occurring after the AI model has been trained and deployed

Other

Without a clearly specified time of occurrence

Supporting Evidence (1)

"Situations can get even worse when the AI becomes autonomous enough to pursue its own goals, even if this means harm to individuals or humanity (Lin et al., 2008). Examples like this give rise to the questions of transparency and accountability for AI systems.:(p. 820)

Part of AI Law and Regulation