A criminal gang in Hangzhou used AI face-swapping technology to bypass facial recognition systems, accessing user accounts to steal personal information and sell it to fraud groups, earning nearly 200,000 yuan before being arrested.
In June 2024, Hangzhou police discovered a criminal gang using AI face-swapping technology to breach platform login authentication systems. The perpetrators first stole users' personal photos, then input these photos into an overseas 'multimodal specialized large model' AI system. They used text prompts to generate videos showing facial movements commonly used in face recognition systems, such as 'open mouth', 'turn head left', and 'blink eyes'. The gang had two main objectives: to spy on users' personal privacy and to sell personal information to fraud groups. Through this method, they illegally obtained nearly 200,000 yuan in profits. After investigation by Hangzhou police, four suspects were identified: Hu Mouyun (male, 26), Hu Mouliang (male, 23), Zhang Mouguo (male, 29), and Wu Mouhao (male, 29). In August 2024, a special task force arrested all four suspects in Anhui, Guizhou, and Zhejiang provinces, and they were criminally detained according to law. Police noted that personal information leakage typically occurs through four channels: intimate relationship fraud, online/offline theft, illegal collection through product tools, and abuse of professional positions.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
No population impact data reported.