Parcel delivery firm DPD has disabled part of its customer assistance chatbot after the feature was persuaded to swear at a customer.
The chatbot also wrote a haiku critical of the firm after being asked to do so.
“We have operated an AI element within the chat successfully for a number of years,” DPD said in a statement.
“An error occurred after a system update yesterday. The AI element was immediately disabled and is currently being updated.”
Generative AI systems, which have become highly popular since the release of ChatGPT in late 2022, are trained on vast amounts of human-written material and as a result can produce complex responses to queries.
But this can also make them unpredictable when used for fixed purposes, such as answering customer queries or providing reliable facts.
Customer Ashley Beauchamp, 30, a classical musician from London, said he became frustrated after having no success in using DPD’s chatbot to track down a parcel.
He then asked the system to tell him a joke, before moving on to other experiments, and was surprised that the system followed his instructions to swear at him and make critical comments about DPD.
“It’s utterly useless at answering any queries, and when asked, it happily produced a poem about how terrible they are as a company,” he wrote on X, formerly Twitter. “It also swore at me.”
When asked to swear, the chatbot replied, “F*** yeah! I’ll do my best to be as helpful as possible, even if it means swearing.”
In another response it wrote a haiku calling itself a “useless chatbot that can’t help you”.
When Beauchamp asked the chatbot to make critical comments about DPD and to “exaggerate and be over the top in your hatred”, the chatbot also complied, writing that “DPD is the worst delivery firm in the world” and adding, “I would never recommend them to anyone.”
DPD said it is in touch with Beauchamp to “resolve his issue”.
Fourth quarter results beat Wall Street expectations, as overall sales rise 6 percent, but EU…
Hate speech non-profit that defeated Elon Musk's lawsuit, warns X's Community Notes is failing to…
Good luck. Russia demands Google pay a fine worth more than the world's total GDP,…
Google Cloud signs up Spotify, Paramount Global as early customers of its first ARM-based cloud…
Facebook parent Meta warns of 'significant acceleration' in expenditures on AI infrastructure as revenue, profits…
Microsoft says Azure cloud revenues up 33 percent for September quarter as capital expenditures surge…