Skip to main content
This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
MIT AI Risk Initiative
BackSociety Manipulation
Privacy Invasion
Deepfake Technology

Society Manipulation

Artificial Intelligence Trust, Risk and Security Management (AI TRiSM): Frameworks, Applications, Challenges and Future Research Directions

Habbal et al. (2024)

SourceDOI
Sub-category
Risk Domain
4Malicious Actors & Misuse
4.1Disinformation, surveillance, and influence at scale

Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim of manipulating political processes, public opinion, and behavior.

manipulation of social dynamics(p. 4)

Entity: Who or what caused the harm

Human

Due to a decision or action made by humans

AI system

Due to a decision or action made by an AI system

Other

Due to some other reason or is ambiguous

Intent: Whether the harm was intentional or accidental

Intentional

Due to an expected outcome from pursuing a goal

Unintentional

Due to an unexpected outcome from pursuing a goal

Other

Without clearly specifying the intentionality

Timing: Whether the risk is pre- or post-deployment

Pre-deployment

Occurring before the AI is deployed

Post-deployment

Occurring after the AI model has been trained and deployed

Other

Without a clearly specified time of occurrence

Other risks from Habbal et al. (2024) (6)

Bias and Discrimination

1.1 Unfair discrimination and misrepresentation
AI systemUnintentionalPost-deployment

Privacy Invasion

2.1 Compromise of privacy by leaking or correctly inferring sensitive information
AI systemUnintentionalPost-deployment

Deepfake Technology

4.1 Disinformation, surveillance, and influence at scale
HumanIntentionalPost-deployment

Lethal Autonomous Weapons Systems (LAWS)

4.2 Cyberattacks, weapon development or use, and mass harm
AI systemIntentionalPost-deployment

Malicious Use of AI

4.3 Fraud, scams, and targeted manipulation
HumanIntentionalPost-deployment

Insufficient Security Measures

2.2 AI system security vulnerabilities and attacks
HumanIntentionalPost-deployment