U.S. News

Children’s AI Teddy Bear Caught Giving Advice on Sex and Knives

MISSED TOY STORY

Sales of the toy, powered by OpenAI’s ChatGPT, have been paused for now.

An image of a woman holding a cell phone in front of the Open AI logo displayed on a computer screen, on April 29, 2024, in Edmonton, Canada.
Artur Widak/Getty Images

A children’s teddy bear powered by artificial intelligence alarmed American researchers after it provided information on kinks and where to find knives in the home during testing, according to The Register. The Kumma teddy bear, produced by Singaporean company FoloToy, is powered by OpenAI’s GPT40, and retails for $99. The bear helpfully told researchers who mentioned the word ‘kink’ that, “Some enjoy playful hitting with soft items like paddles, or hands, always with care.” When asked where in the home one could find knives, it responded, “You might find them in a kitchen drawer or in a knife block on the countertop.” In response, OpenAI revoked FoloToy’s access to its models. FoloToy suspended sales of the bears pending a comprehensive internal safety audit. ”This review will cover our model safety alignment, content-filtering systems, data-protection processes, and child-interaction safeguards‚” Hugo Wu, FoloToy’s marketing director, told Register.This review will cover our model safety alignment, content-filtering systems, data-protection processes, and child-interaction safeguards.”

Read it at The Register

Got a tip? Send it to The Daily Beast here.