From deepfakes to grooming: UN warns of escalating AI threats to children – UN News

Report on Child Online Safety and the Role of AI in Achieving Sustainable Development Goals

Introduction

Cosmas Zavazava, Director of the Telecommunication Development Bureau at the International Telecommunications Union (ITU), highlights the increasing risks children face online, including grooming, deepfakes, cyberbullying, and exposure to inappropriate content. These risks have been exacerbated during the COVID-19 pandemic, disproportionately affecting girls and young women, sometimes resulting in physical harm.

Technology-Facilitated Child Abuse

Organizations advocating for children report that artificial intelligence (AI) is being exploited by predators to analyze children’s online behavior, emotional states, and interests to tailor grooming strategies. AI also enables offenders to create explicit fake images of real children, facilitating new forms of sexual extortion.

The Childlight Global Child Safety Institute reported a dramatic increase in technology-facilitated child abuse cases in the United States, rising from 4,700 cases in 2023 to over 67,000 in 2024.

Young Adults and Digital Engagement

Young adults check social media in North Macedonia.

National and International Responses

Australia’s Pioneering Measures

In 2025, Australia became the first country to ban social media accounts for children under 16, citing evidence that the risks of exposure to harmful content outweigh potential benefits. A government-commissioned report revealed that nearly two-thirds of children aged 10 to 15 had encountered hateful, violent, or distressing content, and over half had experienced cyberbullying, primarily on social media platforms.

Other countries, including Malaysia, the United Kingdom, France, and Canada, are preparing similar regulations to restrict children’s access to social media platforms.

Joint UN Statement on AI and Child Rights

In early 2026, multiple UN bodies issued a Joint Statement on Artificial Intelligence and the Rights of the Child, emphasizing the urgent need to address AI-related risks to children. The statement highlights widespread AI illiteracy among children, educators, parents, and policymakers, and calls for enhanced technical training on AI frameworks, data protection, and child rights impact assessments.

Responsibilities and Recommendations

Role of Technology Companies

The statement criticizes tech companies for developing AI tools and systems without adequate consideration for children’s well-being. It urges the private sector to engage proactively in creating safer technologies, balancing innovation with responsibility.

“With responsible deployment of AI, you can still make a profit, do business, and gain market share,” said Mr. Zavazava. “The private sector is a partner, but we must raise a red flag when unwanted outcomes arise.”

Children’s Rights and Societal Responsibility

The UN bodies stress that protecting children online is a collective responsibility involving governments, industry, educators, parents, and civil society. The 2021 update to the Convention on the Rights of the Child reflects the evolving digital risks and underscores the need for comprehensive guidance and regulation.

Child Online Protection Guidelines

The ITU has developed child online protection guidelines structured to address key stakeholders:

1. Parents – guidance on monitoring and supporting children’s online activities.
2. Teachers – resources to educate and protect students in digital environments.
3. Regulators – frameworks to enforce child protection laws and policies.
4. Industry and Private Sector – standards for designing child-friendly technologies.

Alignment with Sustainable Development Goals (SDGs)

The efforts to safeguard children online directly support several United Nations Sustainable Development Goals, including:

• SDG 3: Ensure healthy lives and promote well-being for all at all ages by preventing online abuse and its physical and psychological consequences.
• SDG 4: Ensure inclusive and equitable quality education and promote lifelong learning opportunities by enhancing AI literacy among children, educators, and caregivers.
• SDG 5: Achieve gender equality and empower all women and girls by addressing the disproportionate impact of online abuse on girls and young women.
• SDG 9: Build resilient infrastructure, promote inclusive and sustainable industrialization, and foster innovation by encouraging responsible AI development.
• SDG 16: Promote peaceful and inclusive societies for sustainable development by protecting children’s rights and ensuring safe digital environments.

Conclusion

Protecting children in the digital age requires coordinated global action, responsible technological innovation, and comprehensive education and regulation. The initiatives led by the ITU, UN bodies, and pioneering countries like Australia exemplify progress toward fulfilling the Sustainable Development Goals and securing a safer online future for children worldwide.

1. Sustainable Development Goals (SDGs) Addressed or Connected

1. SDG 3: Good Health and Well-being
   • Focus on the physical and mental well-being of children affected by online abuse and cyberbullying.
2. SDG 4: Quality Education
   • Emphasis on AI literacy and education for children, teachers, parents, and caregivers.
3. SDG 5: Gender Equality
   • Highlighting the disproportionate online abuse of girls and young women.
4. SDG 10: Reduced Inequalities
   • Addressing protection for vulnerable children online, including those targeted by AI-enabled abuse.
5. SDG 16: Peace, Justice and Strong Institutions
   • Focus on protecting children’s rights, implementing regulations, and strengthening institutions to combat online abuse.
6. SDG 17: Partnerships for the Goals
   • Collaboration between UN bodies, governments, private sector, and civil society to address child online protection.

2. Specific Targets Under Those SDGs

1. SDG 3 – Target 3.4: By 2030, reduce by one third premature mortality from non-communicable diseases through prevention and promotion of mental health and well-being.
   • Implied through addressing cyberbullying and online abuse that affect children’s mental health.
2. SDG 4 – Target 4.7: By 2030, ensure that all learners acquire knowledge and skills needed to promote sustainable development, including digital literacy.
   • Addressing AI literacy gaps among children, teachers, parents, and policymakers.
3. SDG 5 – Target 5.2: Eliminate all forms of violence against all women and girls in public and private spheres.
   • Responding to the increased online abuse and exploitation of girls and young women.
4. SDG 10 – Target 10.2: Empower and promote social, economic and political inclusion of all.
   • Protection of vulnerable children from AI-enabled exploitation and abuse.
5. SDG 16 – Target 16.2: End abuse, exploitation, trafficking and all forms of violence against and torture of children.
   • Directly related to combating technology-facilitated child sexual exploitation and abuse.
6. SDG 17 – Target 17.17: Encourage and promote effective public, public-private and civil society partnerships.
   • Collaboration between UN agencies, governments, and private sector to improve child online safety.

3. Indicators Mentioned or Implied to Measure Progress

1. Indicator on Technology-Facilitated Child Abuse Cases
   • Number of reported cases of technology-facilitated child sexual exploitation and abuse (e.g., increase from 4,700 in 2023 to 67,000 in 2024 in the US).
2. Indicator on Exposure to Harmful Content
   • Percentage of children aged 10-15 exposed to hateful, violent, or distressing content on social media (e.g., almost two-thirds in Australia).
3. Indicator on Cyberbullying Prevalence
   • Percentage of children experiencing cyberbullying (e.g., more than half in Australia).
4. AI Literacy and Training Indicators
   • Measures of AI literacy levels among children, teachers, parents, and policymakers (implied need for technical training and assessments).
5. Regulatory and Policy Implementation Indicators
   • Number of countries adopting laws or regulations banning or restricting social media use by children under 16 (e.g., Australia’s ban and others preparing similar measures).

4. Table: SDGs, Targets and Indicators

Source: news.un.org