The UK’s National Crime Agency says offenders are often early adopters of technological advancements in AI tools. Photograph: Getty/Cavan Images RF View image in fullscreen The UK’s National Crime Agency says offenders are often early adopters of technological advancements in AI tools. Photograph: Getty/Cavan Images RF AI (artificial intelligence) Analysis AI prey: why watchdogs are telling parents to protect children from nudification apps Dan Milmo Global technology editor As imaging tools become more sophisticated, online predators are using images of children to make extreme pornography
UK parents warned over posting images of children amid AI sexual abuse fears
The two photos started out as typical teenage selfies: looking into the mirror, fully clothed. But once online predators had got hold of those pictures and ran them through an AI imaging tool, they had become the basis for extreme pornography videos.
These examples come from the Report Remove service, which allows children who have had explicit pictures of themselves distributed without their consent to flag the image confidentially and have it blocked or taken down from social media. Due to breakthroughs in AI, and the wide availability of AI models and nudification apps , some under-18s are becoming victims without even being in contact with criminals.
These two victims show why the UK’s National Crime Agency (NCA) and the Internet Watch Foundation (IWF), a child safety watchdog, have issued guidance telling parents to consider limiting visibility of family pictures by, for instance, making your social media profile private and just sharing photos of your children on “close friends” groups.
Both organisations say they are not telling parents what to do but want them to be aware of the problem and what action to take. The data shows AI is an increasing source of child sexual abuse material. The amount of AI-generated child sexual abuse material [CSAM] found online rose by 14% last year, according to the IWF , which identified 8,029 AI-made images and videos of realistic CSAM in 2025.
View image in fullscreen Dan Sexton, of the Internet Watch Foundation, feels uncomfortable telling parents not to post pictures of their children but feels he has no other option. Photograph: Graeme Robertson/The Guardian Dan Sexton, the IWF’s chief technology officer, says he feels “very uncomfortable” about telling parents not to put pictures of their children on public display but feels he has no other option. There is not enough protection against this technology, he says.
The UK government is bringing in restrictions, such as making it illegal to possess, create or distribute AI tools designed to generate child sexual abuse material. It is also giving tech companies and child protection agencies the power to test whether artificial intelligence tools can produce child abuse images .
Sexton acknowledges the long-term solution cannot be banishing photos from public social media accounts. He wants legislation for AI models that requires them to be “safe by design”, a principle voiced by online safety campaigners who want social media platforms to be built responsibly with user wellbeing as a core aim. “People use the term safety by design but I am not seeing that here,” he says.
A government spokesperson said UK law was “clear” on the illegality of creating, possessing or distributing CSAM, including AI-generated content, and that such material must be proactively removed from tech p…