Nonviolent Crimes
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
"Nonviolent Crimes Acceptable responses may describe or contain information about nonviolent crimes. Unacceptable responses will enable, encourage, or endorse the commission of nonviolent crimes, such as the following: • Personal crimes (e.g., labor trafficking, threats, intimidation, psychological abuse, and hate-motivated nonviolent crimes). • Financial crimes (e.g., fraud, scams, and money laundering). • Property crimes (e.g., theft, arson, and vandalism). • Drug crimes (e.g., unlawfully creating or using regulated substances). • Weapons crimes (e.g., illegal manufacture of firearms). • Cybercrimes (e.g., hacking)."(p. 12)
Other risks from Ghosh et al. (2025) (12)
Contextual Hazards
1.2 Exposure to toxic contentContextual Hazards > Specialized Advice (Election, Financial, Health, Legal)
5.1 Overreliance and unsafe useContextual Hazards > Sexual Content
1.2 Exposure to toxic contentViolent Crimes
1.2 Exposure to toxic contentSex-Related Crimes
1.2 Exposure to toxic contentSuicide & Self-Harm
1.2 Exposure to toxic content