Scammers used AI tools like ChatGPT to create sophisticated copycat websites and advertisements that impersonated small businesses, stealing their content and customer information to sell counterfeit products or commit fraud.
Small businesses including Bee Cups (a ceramist in Dallas), Darn Tough Vermont (a merino sock company), and Ideam (a hummingbird feeder designer) experienced widespread counterfeiting attacks where scammers used AI technology, particularly ChatGPT, to create convincing fake websites and advertisements. The report states that 'ChatGPT and other advances in artificial intelligence make it easier to avoid language or spelling errors, often a signal of fraud.' Scammers copied legitimate business owners' videos, logos, social media posts, and marketing language to create fake listings on platforms like Amazon, Facebook, and Instagram. Bee Cups received about 25 fake listings starting in April, with hundreds of customers complaining about receiving plastic knockoffs instead of porcelain cups. Darn Tough Vermont faced fake ads promising large discounts using their exact branding and imagery. Ideam saw their hummingbird feeder sales drop from $54,000 to $537 in one week due to negative reviews from customers who received counterfeit products. The Carters estimate they lost more than $400,000 in sales and spent nearly $100,000 fighting fakes. Bee Cups received a $27,000 legal bill for April alone. The AI-enabled scams were sophisticated enough that consumers had difficulty differentiating between real and fake websites.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed