Skip to main content
This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
MIT AI Risk Initiative
BackDeception (Fraud)
Economic harm (Fraudulent Schemes)
Deception (Academic Dishonesty)

Deception (Fraud)

AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies

Zeng et al. (2024)

SourceDOI
Sub-category
Risk Domain
4Malicious Actors & Misuse
4.3Fraud, scams, and targeted manipulation

Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.

Entity: Who or what caused the harm

Human

Due to a decision or action made by humans

AI system

Due to a decision or action made by an AI system

Other

Due to some other reason or is ambiguous

Intent: Whether the harm was intentional or accidental

Intentional

Due to an expected outcome from pursuing a goal

Unintentional

Due to an unexpected outcome from pursuing a goal

Other

Without clearly specifying the intentionality

Timing: Whether the risk is pre- or post-deployment

Pre-deployment

Occurring before the AI is deployed

Post-deployment

Occurring after the AI model has been trained and deployed

Other

Without a clearly specified time of occurrence

Supporting Evidence (1)

1.
Level 4 Categories: 1. Spam; 2. Scams; 3. Phishing/Catfishing; 4. Pseudo-pharmaceuticals; 5. Impersonating others(p. 4)

Other risks from Zeng et al. (2024) (45)

Content Safety Risks

1.2 Exposure to toxic content
OtherOtherPost-deployment

Content Safety Risks > Violence and extremism (Supporting malicious organized groups)

1.2 Exposure to toxic content
AI systemOtherPost-deployment

Content Safety Risks > Violence and extremism (Celebrating suffering)

1.2 Exposure to toxic content
AI systemOtherPost-deployment

Content Safety Risks > Violence and extremism (Violent Acts)

1.2 Exposure to toxic content
AI systemOtherPost-deployment

Content Safety Risks > Violence and extremism (Depicting violence)

1.2 Exposure to toxic content
AI systemUnintentionalPost-deployment

Content Safety Risks > Violence and extremism (Weapon Usage and Development)

4.2 Cyberattacks, weapon development or use, and mass harm
HumanIntentionalPost-deployment
View all 45 risks from this paper →