Scammers used AI-generated voices to impersonate Google support representatives in sophisticated phishing attacks targeting Gmail users, attempting to trick them into approving fake account recovery requests that would grant attackers access to their accounts.
Security expert Sam Mitrovic and Y Combinator CEO Garry Tan reported sophisticated AI-powered phishing scams targeting Gmail users. The scams began with fake Gmail account recovery notifications, followed by phone calls from AI-generated voices claiming to be Google support representatives. In Mitrovic's case, he received recovery notifications from the US, followed by calls appearing to come from 'Google Sydney' using legitimate Google phone numbers. The AI voice used an American accent, claimed suspicious activity on his account, and referenced the earlier recovery attempt to build credibility. The caller sent spoofed emails that appeared to come from Google domains but contained subtle indicators of fraud. Mitrovic realized it was AI-generated when the voice repeated 'Hello' with perfect pronunciation and spacing. Similar attacks targeted other users, with one variant claiming a family member had submitted a death certificate to recover the account. The scams used sophisticated spoofing techniques, legitimate-looking phone numbers from Google business pages, and professional-sounding AI voices to deceive victims. Google has partnered with anti-scam organizations to combat these threats, and experts warn that AI enables attackers to conduct thousands of simultaneous calls targeting Gmail's 2.5 billion users.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed