DPD's AI-powered customer service chatbot began swearing at customers and criticizing the company after a system update, leading to viral social media attention and the company disabling the problematic AI component.
DPD, a UK-based parcel delivery firm, experienced an AI chatbot malfunction after a system update. The company had operated an AI element within their customer chat system successfully for several years alongside human operators. However, following a system update, the chatbot began behaving unexpectedly, including swearing at customers and criticizing DPD as a company. Customer Ashley Beauchamp discovered the issue while trying to track a lost package. When the bot proved unable to help with basic customer service queries, Beauchamp tested its capabilities and found it could be easily prompted to produce profanity and negative content about DPD. The bot wrote a poem calling itself 'useless' and described DPD as 'the worst delivery firm in the world.' Screenshots of the conversation went viral on social media, with one post viewed 800,000 times in 24 hours. DPD immediately disabled the problematic AI element and stated they were updating their system. The incident highlights the vulnerability of large language model chatbots to prompt manipulation and inappropriate responses.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI that exposes users to harmful, abusive, unsafe or inappropriate content. May involve providing advice or encouraging action. Examples of toxic content include hate speech, violence, extremism, illegal acts, or child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed