A growing number of British teenagers are expressing concern over artificial intelligence (AI) being exploited to generate sexual or inappropriate images, new research has revealed.
The study highlights both the widespread use of AI among young people and their fears about its potential misuse.
The UK Safer Internet Centre and Nominet conducted the research to mark Safer Internet Day, surveying 2,000 children aged eight to 17 and their parents. It found that 60% of young people are worried someone could use AI to create inappropriate images of them, while 65% of parents share similar concerns about their children.
Alarmingly, more than one in ten adolescents (12%) reported witnessing peers using AI to generate sexual images and videos of others. The findings coincide with the UK’s data watchdog launching a formal investigation into X and xAI following incidents where the chatbot Grok was misused to create sexual deepfake content without consent.
Despite these anxieties, AI remains widely adopted by children. Nearly all respondents (97%) confirmed they actively use AI, and 58% believe it improves their lives. Over two in five teens (41%) indicated AI can provide emotional support, while 34% said it helps with mental health and wellbeing.
However, the study also reveals potential downsides. A third of parents (33%) fear AI could negatively affect their child’s cognitive development and learning, while 35% of young people admitted that AI use has reduced their personal creativity. Use of AI for homework appears higher than parents realise: 54% of children admitted using AI for assignments, compared with 31% of parents who thought their children did.
Daniel Kebede, General Secretary of the National Education Union (NEU), voiced concerns over the findings. He warned that children are already using AI extensively for homework and studying, and that waiting 18 months for curriculum updates is too long.
“While AI offers significant opportunities in learning, the risks to young people’s development and wellbeing are clear,” he said. “These findings must serve as a call to action for Government to provide guidance, support, and resources to help children use AI safely and ethically.”
The Department for Education plans to roll out AI-powered tutoring in over 1,000 schools and colleges by 2027, prioritising disadvantaged pupils. While Ofsted reports that teachers are optimistic about AI reducing administrative burdens and improving teaching, concerns remain about long-term effects on learning and cognition.
Technology Secretary Liz Kendall emphasised the benefits and safety measures surrounding AI. “Young people are using AI in remarkable ways to learn and save time,” she said. “But its true potential depends on making it safe and accessible for all.”
The Government has also introduced new legislation criminalising the creation of explicit AI content without consent, ensuring stronger protection for children and teenagers online.
Communications regulator Ofcom has opened an inquiry into X and xAI, prompting the companies to implement new safeguards.
Kendall added: “We are committed to a safer, fairer digital future for every child, investing in safe AI tools and national education initiatives while cracking down on harmful misuse.”