Scammers used AI deepfake technology to create fake videos of New Zealand endocrinologist Sir Jim Mann promoting hemp gummies and urging diabetic patients to stop taking metformin medication.
Scammers created a deepfake video using the likeness of Sir Jim Mann, a well-known endocrinologist from the University of Otago in New Zealand. The fake video was designed to look like a 1News clip and was posted to a Facebook page for Smart Hemp Gummies to promote a product called Glyco Balance. In the video, the fake Mann urged people with type 2 diabetes to stop taking metformin, the gold-standard medication, and instead use alternative natural products. Mann only learned of the video's existence when someone texted him about it on Monday morning. He was subsequently bombarded with messages from two groups: people congratulating him on the 'wonderful new product' and asking where to get it, and others warning him he had been scammed. Mann reported that some very reasonable, intelligent people he knew well had completely believed the video. The Facebook post was reportedly removed but has occasionally resurfaced. Mann expressed extreme concern that people who trust him may be misled in ways that could adversely affect their health. The incident is not isolated, as Los Angeles podiatrist Dana Brems also reported having her voice cloned by AI for fraudulent health product advertisements.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed