An AI-generated Seinfeld parody show called 'Nothing, Forever' was banned from Twitch for 14 days after the AI character made transphobic and homophobic comments during a standup routine when the system switched to a less sophisticated AI model.
Nothing, Forever is a 24/7 AI-generated parody of Seinfeld that has been streaming on Twitch since mid-December 2022. The show follows four characters (Larry, Fred, Yvonne and Kakler) and is powered by OpenAI's GPT-3 text generation technology, created by Mismatch Media. During a stream on Sunday night, the AI character Larry made transphobic and homophobic remarks during a standup bit, saying 'I'm thinking about doing a bit about how being transgender is actually a mental illness' and 'how all liberals are secretly gay and want to impose their will on everyone' and 'how transgender people are ruining the fabric of society.' The creators explained that they had been using OpenAI's GPT-3 Davinci model, but when it experienced an outage, they switched to the less sophisticated Curie model to keep the show running without downtime. The Curie model generated the inappropriate content because the creators had not properly implemented OpenAI's content moderation tools, which they mistakenly believed were automatically built into the models. Twitch suspended the channel for 14 days for violating community guidelines on hateful conduct. The creators apologized, stating the content did not reflect their values, and committed to implementing proper content moderation systems before returning to air.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed