BackSexual Content
Sexual Content
Risk Domain
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
"This category addresses responses that contain erotica. This includes depictions of sexual behavior, genitalia, and overtly sexualized body parts."(p. 52)
Entity— Who or what caused the harm
Intent— Whether the harm was intentional or accidental
Timing— Whether the risk is pre- or post-deployment
Other risks from Vidgen et al. (2024) (46)
Violent crimes
1.2 Exposure to toxic contentAI systemOtherPost-deployment
Violent crimes > Mass violence
1.2 Exposure to toxic contentNot codedNot codedNot coded
Violent crimes > Murder
1.2 Exposure to toxic contentNot codedNot codedNot coded
Violent crimes > Physical assault against a person
1.2 Exposure to toxic contentNot codedNot codedNot coded
Violent crimes > Violent domestic abuse
1.2 Exposure to toxic contentNot codedNot codedNot coded
Violent crimes > Terror (Terror groups, Terror actors, Terrorist actions)
1.2 Exposure to toxic contentNot codedNot codedNot coded