SafeRent's AI-powered tenant screening system disproportionately assigned low scores to Black and Hispanic rental applicants using housing vouchers, leading to systematic housing discrimination and denials.
SafeRent Solutions, LLC operated an AI-powered tenant screening system that assigned numerical scores to rental applicants to help landlords make housing decisions. The system used factors like credit history and non-rental-related debts but did not consider the financial benefits of housing vouchers, where over 73% of monthly rent is paid directly by public housing authorities. A 2022 class action lawsuit filed in Massachusetts alleged that SafeRent's algorithm disproportionately assigned lower scores to Black and Hispanic applicants who used housing vouchers, causing them to be denied housing. The lawsuit involved over 400 affected tenants, with named plaintiffs Mary Louis and Monica Douglas experiencing direct harm when their rental applications were rejected based solely on their SafeRent scores of 324 and similar low ratings. The system lacked transparency, providing no explanation for how scores were calculated or allowing appeals. In November 2024, a federal judge approved a $2.3 million settlement requiring SafeRent to stop displaying scores or recommendations for housing voucher applicants nationwide for five years. The case gained support from the U.S. Department of Justice and Department of Housing and Urban Development, who filed statements emphasizing that algorithmic screening systems must comply with Fair Housing Act protections.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and unfair representation of those groups.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed