Skip to main content
MIT AI Risk Initiative
BackHuman-AI interaction
Home/Risks/Giarmoleo et al. (2024)/Human-AI interaction
Uniformity in the AI field
Building a human-AI environment

Human-AI interaction

What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review

Giarmoleo et al. (2024)

SourceDOI
Category
Risk Domain
5Human-Computer Interaction
5.1Overreliance and unsafe use

Users anthropomorphizing, trusting, or relying on AI systems, leading to emotional or material dependence and inappropriate relationships with or expectations of AI systems. Trust can be exploited by malicious actors (e.g., to harvest personal information or enable manipulation), or result in harm from inappropriate use of AI in critical situations (e.g., medical emergency). Overreliance on AI systems can compromise autonomy and weaken social ties.

"ethical concerns associated with the interaction between humans and AI"(p. 14)

Entity— Who or what caused the harm

Human

Due to a decision or action made by humans

AI system

Due to a decision or action made by an AI system

Other

Due to some other reason or is ambiguous

Intent— Whether the harm was intentional or accidental

Intentional

Due to an expected outcome from pursuing a goal

Unintentional

Due to an unexpected outcome from pursuing a goal

Other

Without clearly specifying the intentionality

Timing— Whether the risk is pre- or post-deployment

Pre-deployment

Occurring before the AI is deployed

Post-deployment

Occurring after the AI model has been trained and deployed

Other

Without a clearly specified time of occurrence

Sub-categories (4)

Building a human-AI environment

"This category encompasses nearly 17% of the articles and addresses the overall imperative of establishing a harmonious coexistence between humans and machines, and the key concerns that gives rise to this need."

7.1 AI pursuing its own goals in conflict with human goals or values
OtherOtherOther

Privacy protection

"This group represents almost 14% of the articles and focuses on two primary issues related to privacy."

2.1 Compromise of privacy by leaking or correctly inferring sensitive information
OtherOtherOther

Building an AI able to adapt to humans

"This category involves almost 9% of the articles and deals with ethical concerns arising from AI's capacity to interact with humans in the workplace."

6.2 Increased inequality and decline in employment quality
OtherOtherOther

Attributing the responsibility for AI's failures

"This section, constituting almost 8% of the articles, addresses the implications arising from AI acting and learning without direct human supervision, encompassing two main issues: a responsibility gap and AI's moral status."

7.4 Lack of transparency or interpretability
OtherOtherOther

Other risks from Giarmoleo et al. (2024) (9)

Design of AI

6.1 Power centralization and unfair distribution of benefits
HumanIntentionalPre-deployment

Design of AI > Algorithm and data

1.1 Unfair discrimination and misrepresentation
HumanIntentionalPre-deployment

Design of AI > Balancing AI's risks

7.3 Lack of capability or robustness
OtherOtherOther

Design of AI > Threats to human institutions and life

4.2 Cyberattacks, weapon development or use, and mass harm
OtherOtherOther

Design of AI > Uniformity in the AI field

6.1 Power centralization and unfair distribution of benefits
HumanOtherOther

Human-AI interaction > Building a human-AI environment

7.1 AI pursuing its own goals in conflict with human goals or values
OtherOtherOther
View all 9 risks from this paper →