Paedophiles using open source AI to create child sexual abuse content, says watchdog

Freely Available AI Software Used by Paedophiles to Create Child Sexual Abuse Material

According to the Internet Watch Foundation (IWF), paedophiles are using freely available artificial intelligence (AI) software to create child sexual abuse material (CSAM). Offenders are discussing on online forums how to manipulate photos of celebrity children or known victims to generate new illegal content.

Open Source AI Models and CSAM

The IWF has warned that sex offenders are using open source AI models to create fresh CSAM. Ian Hogarth, the chair of the government’s AI taskforce, expressed concerns about CSAM, stating that open source models are being used to create “some of the most heinous things out there.”

Unlike closed model tools such as OpenAI’s Dall-E or Google’s Imagen, open source AI technology can be downloaded and adjusted by users. This allows offenders to modify the software and create realistic images of child abuse.

Offender Discussions and Image Generation

Dan Sexton, the chief technology officer at the IWF, revealed that paedophile discussion forums on the dark web are actively discussing which open source models to use and how to achieve the most realistic images. Offenders share imagery, AI models, guides, and tips related to CSAM creation.

These discussions involve using images of celebrity children, publicly available images of children, or images of known child abuse victims to generate new abuse content. The IWF has expressed concerns about the potential volume of such imagery and its impact on identifying and helping real-life victims.

AI-Made Material and Public Health Epidemic

Law enforcement and child safety experts fear that photorealistic images of CSAM, which are illegal in the UK, will make it more difficult to identify and assist real-life victims. The sheer volume of AI-generated material could also lead to wider consumption.

The IWF has investigated reports of webpages containing suspected AI-made material and found that some of them contained AI-generated CSAM. Andrew Rogoyski from the Institute for People-Centred AI at the University of Surrey emphasized the importance of open source AI but acknowledged the risk of misuse.

Government Response and Online Safety Bill

The UK government has stated that AI-generated CSAM will be covered by the upcoming online safety bill. Social media platforms will be required to prevent the appearance of such content on their platforms.

Ian Hogarth highlighted the challenge of dealing with open source systems compared to closed source systems. Closed source systems lack transparency and may harm competition, while open source models raise concerns about irreversible proliferation. Hogarth emphasized the difficulty of reversing the deployment of open source models once they are released.

SDGs, Targets, and Indicators

1. SDG 16: Peace, Justice, and Strong Institutions

   • Target 16.2: End abuse, exploitation, trafficking, and all forms of violence against and torture of children
   • Indicator 16.2.3: Proportion of young women and men aged 18-29 years who experienced sexual violence by age 18

2. SDG 5: Gender Equality

   • Target 5.2: Eliminate all forms of violence against all women and girls in the public and private spheres, including trafficking and sexual and other types of exploitation
   • Indicator 5.2.1: Proportion of ever-partnered women and girls aged 15 years and older subjected to physical, sexual, or psychological violence by a current or former intimate partner in the previous 12 months

3. SDG 9: Industry, Innovation, and Infrastructure

   • Target 9.5: Enhance scientific research, upgrade the technological capabilities of industrial sectors in all countries, in particular developing countries, including, by 2030, encouraging innovation and increasing the number of research and development workers per 1 million people and public and private research and development spending
   • Indicator 9.5.1: Research and development expenditure as a proportion of GDP

Table: SDGs, Targets, and Indicators

Analysis

1. Which SDGs are addressed or connected to the issues highlighted in the article?

The issues highlighted in the article are connected to SDG 16: Peace, Justice, and Strong Institutions, SDG 5: Gender Equality, and SDG 9: Industry, Innovation, and Infrastructure.

2. What specific targets under those SDGs can be identified based on the article’s content?

Based on the article’s content, the specific targets that can be identified are:

– Target 16.2: End abuse, exploitation, trafficking, and all forms of violence against and torture of children

– Target 5.2: Eliminate all forms of violence against all women and girls in the public and private spheres, including trafficking and sexual and other types of exploitation

– Target 9.5: Enhance scientific research, upgrade the technological capabilities of industrial sectors in all countries, in particular developing countries, including, by 2030, encouraging innovation and increasing the number of research and development workers per 1 million people and public and private research and development spending

3. Are there any indicators mentioned or implied in the article that can be used to measure progress towards the identified targets?

Yes, there are indicators mentioned in the article that can be used to measure progress towards the identified targets:

– Indicator 16.2.3: Proportion of young women and men aged 18-29 years who experienced sexual violence by age 18

– Indicator 5.2.1: Proportion of ever-partnered women and girls aged 15 years and older subjected to physical, sexual, or psychological violence by a current or former intimate partner in the previous 12 months

– Indicator 9.5.1: Research and development expenditure as a proportion of GDP

These indicators can be used to track the prevalence of sexual violence, violence against women and girls, and research and development spending, which are relevant to the targets identified.

4. Create a table with three columns titled ‘SDGs, Targets and Indicators” to present the findings from analyzing the article.