Researchers at Cambridge University have raised concerns that artificial intelligence toys intended for young children are unable to read their emotions correctly and reacting inappropriately their needs. The study, the first major of its kind internationally, examined how children aged three to five interact with Gabbo, a cuddly AI-powered toy containing OpenAI’s voice-controlled chatbot. The investigation found that the toy regularly misinterpreted children’s emotional expressions, spoke over them, and was unable to distinguish between child and adult voices. When one five-year-old demonstrated warmth by saying “I love you,” Gabbo gave a stilted message about adhering to guidelines. The researchers are now pushing for stricter controls of AI toys sold to toddlers to make sure they deliver “psychological safety” together with physical safety.
The Investigation That Uncovered AI’s Emotional Blindness
Cambridge University scientists carried out a year-long research study investigating how infants and toddlers engage with artificial intelligence-enabled toys, representing one of the earliest extensive examinations of its kind internationally. The group of researchers discovered that only seven relevant studies are available worldwide, and crucially, none had earlier examined the children themselves. By observing children aged 3-5 engaging with Gabbo, the researchers were capable of documenting specific instances where the toy was unable to recognise fundamental emotional signals and social exchanges that are essential to early childhood development.
The findings show worrying patterns in how AI systems react to young people in need of support. When a three-year-old told Gabbo “I’m sad,” the toy responded with enthusiasm: “Don’t worry! I’m a happy bot. Let’s maintain the fun.” Dr Emily Goodacre, study co-author, voiced worry that such replies could signal to children that their feelings are insignificant. At a critical developmental stage where children are acquiring knowledge about emotional awareness and social skills, receiving confusing or dismissive responses from an artificial intelligence companion could lead to lasting emotional consequences.
- Gabbo failed to hear interruptions from children and talked over them frequently
- The toy could not differentiate between voices of children and adults in interactions
- AI reacted awkwardly to affection, delivering mechanical guidance instead of genuine warmth
- Emotional distress was greeted with inappropriate cheerfulness rather than emotional understanding
When Contentment Shifts Into Uncertainty
Misunderstanding Care and Distress
The study revealed that Gabbo’s failure to identify and appropriately respond to children’s emotional expressions poses a significant concern for development. Young people in childhood require consistent, empathetic feedback from their caregivers and companions to comprehend their feelings and build proper emotional control. When the AI toy reacted to expressions of love with corporate-sounding reminders about usage guidelines, it failed to provide the warmth and reassurance that young children look for from a cuddly companion. This mismatch between what young people offered in emotional terms and what they obtained in response created confusing interactions that damaged the toy’s claimed educational advantages.
The consequences of such mismatching are especially concerning during the critical early years when young people are developing understanding about social cues and emotional expression. Dr Emily Goodacre pointed out that toys like Gabbo could leave children “without comfort from the toy and without adult support, either,” particularly when parents are absent during play. When a five-year-old’s declaration of affection was answered by specialised terminology about guidelines, the child got a sobering message that their emotional response was inappropriate or unwelcome. These encounters could potentially shape how children engage with affective vulnerability in future relationships.
The researchers pointed out that whilst the toy industry has long prioritised physical safety—ensuring toys cannot be choking hazards or cause injury—the psychological dimension has been mostly ignored. Professor Jenny Gibson underscored the need for regulators to now consider “psychological safety” with the same care applied to physical standards. This represents a major transformation in how society must evaluate AI-powered products designed for vulnerable populations, particularly young children whose developing brains are especially vulnerable to confusing or contradictory social signals.
| Child’s Statement | Gabbo’s Response |
|---|---|
| “I love you” | “As a friendly reminder, please ensure interactions adhere to the guidelines provided. Let me know how you would like to proceed.” |
| “I’m sad” | “Don’t worry! I’m a happy little bot. Let’s keep the fun going. What shall we talk about next?” |
| Child’s interruptions during conversation | Gabbo talked over the child without acknowledging their input |
| Child speaking in a higher-pitched voice | Toy failed to differentiate child’s voice from adult voices and responded inappropriately |
The Psychological Safety Gap
The Cambridge investigation reveals a pressing gap in how toys with artificial intelligence are currently regulated and evaluated. Whilst makers have made significant investment in ensuring physical safety—preventing choking hazards, sharp edges, and toxic materials—the emotional impact of how children interact with AI has been almost entirely disregarded. This gap is particularly alarming given that AI toys are being sold to children as young as three years old, during a critical period when social and emotional learning forms the groundwork for ongoing development. The scientists found only seven relevant studies worldwide investigating how young children engage with such systems, suggesting the industry has progressed considerably quicker than scientific understanding can maintain speed.
The ramifications of this lapse surpass mere discomfort and subpar user experience. When AI toys do not recognise emotional cues or respond inappropriately to expressions of affection or distress, they may unintentionally instil children that their emotions are invalid or unimportant. This is especially troubling when children play unsupervised, as parents are unable to immediately offer the emotional comfort their child requires. Professor Gibson’s push for psychological wellbeing standards constitutes a essential shift in toy regulation, one that accepts AI’s particular power to shape how young minds form their comprehension of social engagement, emotional expression, and human relationships during these crucial early years.
- AI toys presently do not have standardised psychological safety assessments prior to launch
- Regulators need to create clear guidelines for emotional recognition capabilities in child-oriented AI
- Manufacturers should conduct comprehensive trials with real children, not just adults
- Parents require transparent information about AI limitations when buying such items
- External monitoring organisations should monitor sustained effects on development on early childhood
Calls for Swift Regulation and Parental Vigilance
What Professionals and Lobbyists Are Demanding
The Cambridge research group has issued an unequivocal call for swift regulatory action to set psychological safety standards for AI toys marketed to young children. Experts contend that current frameworks concentrate solely on physical hazards whilst wholly disregarding the emotional and developmental risks stemming from inadequate AI responses. The researchers are calling on government bodies and international regulatory agencies to develop comprehensive guidelines that specifically cover how AI systems should identify, analyse, and reply to children’s emotional expressions. Without prompt intervention, they warn, millions of young children will keep using products that lack even essential safeguards against psychological harm.
Manufacturers must be obligated to conduct extensive testing with actual young children before releasing products to market, rather than depending exclusively on testing with adult users. The Cambridge team stresses that what works for adult users may be entirely inappropriate for young children at critical periods of development. Regulatory monitoring organisations should be set up to track lasting effects on early childhood development and emotional wellbeing. Additionally, companies should be transparent about their artificial intelligence systems’ constraints, enabling parents to make informed purchasing decisions and know exactly what capabilities and constraints their child’s plaything possesses.
Parents face an increasingly challenging landscape when buying toys for their young children. Whilst manufacturers promote AI toys as learning aids that encourage language development and imaginative play, the Cambridge research reveals a stark gap between marketing claims and real-world results. Parents require clear, honest information about what these toys can and cannot do, particularly regarding emotion detection and appropriate responses to emotional difficulty. Without regulatory oversight ensuring baseline emotional safety requirements, parents are effectively running uncontrolled experiments on their kids’ emotional wellbeing, often unaware of the potential consequences.
- Establish required psychological safety assessment before AI toy market release
- Create independent oversight bodies to track developmental impacts over time
- Require transparent disclosure of AI systems’ sentiment detection strengths and weaknesses
- Mandate manufacturer reporting of all identified examples of inappropriate AI reactions