Ping An, China's largest insurer, deployed facial recognition AI to analyze micro-expressions and determine customer trustworthiness for insurance decisions, potentially discriminating against marginalized groups.
Ping An, China's largest insurance company, has implemented artificial intelligence using facial recognition software to analyze customers' micro-expressions to assess their truthfulness and determine insurance eligibility and terms. The AI system also evaluates customers' body-mass index and general well-being to set health insurance premiums, with higher costs for those deemed overweight. The system is designed to identify customers who are likely to make insurance claims, which the company seeks to avoid to maximize profits. The report suggests this technology could disproportionately impact marginalized groups, including ethnic minorities like Uyghurs and economically disadvantaged populations, who may be more likely to require insurance services due to systemic discrimination and precarious living conditions. The system represents a shift toward using AI to differentiate between profitable and unprofitable customers, potentially excluding those who most need insurance coverage. The incident is presented as a cautionary example of how AI could be misused in insurance markets, particularly in contexts where regulatory protections against discrimination are limited.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
No population impact data reported.