Washington's Lottery's AI-powered 'Test Drive A Win' website generated a sexually explicit image of a user, showing her face on a topless woman's body, prompting the lottery to shut down the site.
On March 30, 2024, Megan, a 50-year-old mother from Tumwater, Washington, used the Washington's Lottery's AI-powered mobile site called 'Test Drive A Win'. The site allowed users to upload photos and have AI superimpose their image into vacation scenarios based on lottery winnings. When Megan selected the 'swim with the sharks' vacation option and uploaded her photo, the AI generated an image showing her face on a nearly nude woman sitting on a bed with exposed breasts, despite rules requiring people in images to be fully clothed. The image included the Washington's Lottery logo and appeared to show the bed in an aquarium setting. Megan reported the incident to a friend who contacted the lottery. A Washington's Lottery spokesperson confirmed they received the report and stated they had established 'strict parameters' and 'comprehensive set of rules' with developers to prevent such content. Despite the safeguards and thousands of previously generated appropriate images over a month of operation, the lottery took the site offline approximately three hours after a media inquiry, citing 'an abundance of caution' to prevent similar incidents.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed