Home » From deepfakes to grooming: UN warns of escalating AI threats to children

From deepfakes to grooming: UN warns of escalating AI threats to children

by NNW Bureau
0 comments

Cosmas Zavazava, Director of the Telecommunication Development Bureau at the International Telecommunications Union (ITU) – one of the key agencies that drafted the statement, which includes guidelines and recommendations – catalogues a dizzying array of ways that children are targeted. 

This extends from grooming to deepfakes, the embedding of harmful features, cyberbullying and inappropriate content: “We saw that, during the COVID-19 pandemic, many children, particularly girls and young women, were abused online and, in many cases, that translated to physical harm,” he says.

Organisations that advocate for children report that predators can use AI to analyse a child’s online behaviour, emotional state, and interests to tailor their grooming strategy. 

AI is also enabling offenders to generate explicit fake images of real children, driving a new form of sexual extortion.

The Childlight Global Child Safety Institute, an independent global institute established to gather the most reliable data available on child sexual exploitation and abuse, found in a 2025 report that technology‑facilitated child abuse cases in the US increased from 4,700 in 2023 to more than 67,000 in 2024.

Australia leads the way 

UN Member States are taking stronger measures, as they learn about the scale and severity of the problem.

At the end of 2025, Australia became the first nation in the world to ban social-media accounts for children under 16, on the basis that the risks from the content they share far outweighs the potential benefits.

The Government there cited a report it had commissioned, which showed that almost two-thirds of children aged between 10 and 15 had viewed hateful, violent or distressing content and more than half had been cyberbullied. Most of this content was seen on social media platforms.

Several other countries, including Malaysia, the UK, France and Canada, look set to follow Australia’s lead, preparing regulations and laws for similar bans or restrictions. 

AI-illiteracy

And, at the beginning of 2026, a wide variety of UN bodies with a stake in child safety put their names to a Joint Statement on Artificial Intelligence and the Rights of the Child, published on 19 January, which pulls no punches in its description of the risks – and society’s collective inability to cope with them.

The statement identifies a lack of AI literacy among children, teachers, parents and caregivers, as well as a dearth of technical training for policymakers and governments on AI frameworks, data protection methods and child rights impact assessments.

READ MORE: https://news.un.org/en/story/2026/01/1166827

You may also like