Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

AI image generators trained with child abuse content: study

Dec 21, 2023 - businessinsider.com
A study by Stanford University Cyber Policy Center revealed that the LAION-5B database, used to train AI image generators, contained over 3,200 suspected images of child sexual abuse. The database, which has been used by several AI companies, including Stability AI, is a public archive of around five billion images. The report warns that the presence of these images could allow AI tools to create new child abuse content, adding to concerns about a surge in AI-generated child sexual abuse content.

In response, the LAION database has been taken offline for the removal of the illegal content. Stability AI, which developed the popular image generator Stable Diffusion, stated that it has introduced filters to prevent the creation of illegal content and that its models were trained only on a filtered subset of LAION-5B. However, an earlier version of Stable Diffusion, which can generate explicit content, is still available on the open web.

Key takeaways:

  • The LAION-5B database, used to train AI image generators, was found to contain over 3,200 images of suspected child abuse, with over 1,000 confirmed as child sexual abuse material.
  • The presence of these images in the dataset raises concerns that AI tools could be used to create new child abuse content.
  • Stability AI, which uses the LAION database for its image generator Stable Diffusion, has introduced filters to prevent users from creating illegal content and only trains its models on a filtered subset of LAION-5B.
  • LAION, the German non-profit behind the dataset, is temporarily removing its datasets from the internet to remove illegal content.
View Full Article

Comments (0)

Be the first to comment!