Scammers used Facebook's AI systems to create and spread over 90 fraudulent investment ads impersonating billionaire hedge fund managers like Bill Ackman and Cathie Wood, leading to millions in losses for victims who were lured into WhatsApp pump-and-dump schemes.
From late 2023 into 2024, scammers exploited Facebook's advertising platform and AI content detection systems to run fraudulent investment schemes impersonating prominent financial figures including Bill Ackman, Cathie Wood, Ray Dalio, Peter Lynch, and Steve Cohen. Over 90 different ads impersonating Ackman alone were identified by Pershing Square Capital Management, with thousands more impersonating other figures. The ads used sophisticated techniques including deepfake videos and remained visible for weeks despite being reported to Facebook. The scams directed victims to WhatsApp groups where they received fake stock tips in elaborate pump-and-dump schemes targeting penny stocks on the Hong Kong exchange. Individual losses ranged from $45,000 to $1.3 million, with a group of 29 victims reporting combined losses of $3.2 million. The Federal Trade Commission reported that impostor scam losses tripled between 2019 and 2023 to $2.7 billion. Facebook's AI systems failed to detect and remove the fraudulent content despite the platform claiming to use artificial intelligence to block fake accounts and having 40,000 people working on safety and security issues.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed