Microsoft's Copilot AI chatbot generated a training scenario using the real name and details of a sexual harassment victim during a workplace safety course at her former prison workplace.
A psychosocial safety trainer named Charlotte Ingham used Microsoft's Copilot chatbot to generate examples of workplace hazards for a training course at Bunbury prison. The AI generated a scenario that included the full name 'Bronwyn Hendry' and real details from an active Federal Court case involving alleged sexual harassment and bullying at that same prison. Ms Hendry is the actual complainant in the ongoing case against the Department of Justice and senior prison staff. The trainer was unaware the scenario contained real information, believing it to be fictional. When the ABC independently tested Copilot with similar prompts, it reproduced real names and case details while claiming the scenario was 'entirely fictional, but draws from real-world incidents'. Microsoft confirmed that Copilot may include names and scenarios available through search when prompted to create case studies. The Department of Justice had commissioned the training but stated they were unaware Ms Hendry's name would be used. Ms Hendry described the incident as 'very triggering' and 'contradictory' given she is actively fighting to prove her case in Federal Court. The incident occurred during an ongoing WorkSafe investigation into bullying and sexual harassment at the prison.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that memorize and leak sensitive personal data or infer private information about individuals without their consent. Unexpected or unauthorized sharing of data and information can compromise user expectation of privacy, assist identity theft, or cause loss of confidential intellectual property.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed