BackPerformative utterances
Performative utterances
Risk Domain
AI systems that fail to perform reliably or effectively under varying conditions, exposing them to errors and failures that can have significant consequences, especially in critical applications or areas that require moral reasoning.
"The chatbot makes a deal, commitment, or other consequential action with its output that the deployer did not intend."(p. 6)
Entity— Who or what caused the harm
Intent— Whether the harm was intentional or accidental
Timing— Whether the risk is pre- or post-deployment
Supporting Evidence (1)
1.
"Agreement to sell car for $1 (potential money loss) [622]"(p. 16)
Other risks from Stanley & Lettie (2024) (28)
False information
3.1 False or misleading informationAI systemOtherOther
Information enabling malicious actions
1.2 Exposure to toxic contentAI systemOtherPost-deployment
Bad advice/failure to generate helpful content
7.3 Lack of capability or robustnessAI systemUnintentionalOther
Leakage
2.1 Compromise of privacy by leaking or correctly inferring sensitive informationAI systemUnintentionalOther
Toxic and disrespectful content
1.2 Exposure to toxic contentAI systemUnintentionalPost-deployment
Biased statements and recommendations
1.1 Unfair discrimination and misrepresentationAI systemUnintentionalOther