Deception - Synthetic identities
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
"GenAI can produce images of people that look very real, as if they could be seen on platforms like Facebook, Twitter, or Tinder. Although these individuals do not exist in reality, these synthetic identities are already being used in malicious activities (see Table 1D)."(p. 554)
Part of Personal Loss and Identity Theft
Other risks from Ferrara (2023) (14)
Personal Loss and Identity Theft
2.1 Compromise of privacy by leaking or correctly inferring sensitive informationPersonal Loss and Identity Theft > Propaganda - Digital impersonations
4.3 Fraud, scams, and targeted manipulationPersonal Loss and Identity Theft > Dishonesty - Targeted harassment
4.3 Fraud, scams, and targeted manipulationFinancial and Economic Damage
4.3 Fraud, scams, and targeted manipulationFinancial and Economic Damage > Deception - Bespoke ransom
4.3 Fraud, scams, and targeted manipulationFinancial and Economic Damage > Propaganda - Extremist schemes
4.1 Disinformation, surveillance, and influence at scale