Health insurance companies used unregulated AI algorithms to automatically deny Medicare Advantage claims for elderly patients, cutting off payment for medically necessary care based on algorithmic predictions rather than individual patient needs.
Health insurance companies, particularly through Medicare Advantage plans, have deployed AI algorithms to predict when they can cut off payment for elderly patients' medical care. The investigation focused on NaviHealth's nH Predict algorithm, which uses patient data to generate precise predictions about recovery timelines and discharge dates. The system was used by major insurers including UnitedHealthcare, Humana, and Blue Cross Blue Shield plans to manage over 31 million Medicare Advantage beneficiaries. Specific cases included Frances Walter, an 85-year-old with a shattered shoulder whose algorithm predicted 16.6 days of care, leading to payment denial on day 17 despite her inability to dress herself or walk. Another case involved Dolores Millam, whose algorithm predicted 15 days of nursing home care after leg surgery, with payment terminated despite her inability to bear weight and requiring 24-hour assistance. The denials forced patients to spend life savings or go without care, with appeals processes lasting up to 2.5 years. Federal inspectors found insurers were using internal criteria beyond Medicare's rules, and appeals showed most denials were eventually overturned, indicating systematic inappropriate use of AI predictions.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
AI system
Due to a decision or action made by an AI system
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed