laion

What changed

The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.

Timeline

1. 15 Sept 2024Child Sexual Abuse Material Taints Image Generators
   Incident82%

   • Investigation Finds AI Image Generation Models Trained on Child Abusehttps://cyber.fsi.stanford.edu/news/investigation-finds-ai-image-generation-models-trained-child-abuse
   • AI image training dataset found to include child sexual abuse imageryhttps://www.theverge.com/2023/12/20/24009418/generative-ai-image-laion-csam-google-stability-stanford
   • AI Incident Database - Incident 624https://incidentdatabase.ai/cite/624/

   Investigation Finds AI Image Generation Models Trained on Child AbuseAI image training dataset found to include child sexual abuse imageryAI Incident Database - Incident 624
2. 3 July 2023Stable Diffusion Exhibited Biases for Prompts Featuring Professions
   Incident82%

   • AI Image Generators Routinely Display Gender and Cultural Biashttps://www.gizmodo.com.au/2022/11/ai-image-generators-routinely-display-gender-and-cultural-bias/
   • Tweet: at Leonardonclthttps://twitter.com/Leonardonclt/status/1667143605801156611
   • AI Incident Database - Incident 529https://incidentdatabase.ai/cite/529/

   AI Image Generators Routinely Display Gender and Cultural BiasTweet: at LeonardoncltAI Incident Database - Incident 529
3. 17 May 2023Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training
   Incident82%

   • Lensa, the AI portrait app, has soared in popularity. But many artists question the ethics of AI art.https://www.nbcnews.com/tech/internet/lensa-ai-artist-controversy-ethics-privacy-rcna60242
   • The Alt-Right Manipulated My Comic. Then A.I. Claimed It.https://www.nytimes.com/2022/12/31/opinion/sarah-andersen-how-algorithim-took-my-work.html
   • AI Incident Database - Incident 421https://incidentdatabase.ai/cite/421/

   Lensa, the AI portrait app, has soared in popularity. But many artists question the ethics of AI art.The Alt-Right Manipulated My Comic. Then A.I. Claimed It.AI Incident Database - Incident 421
4. 3 May 2023Stable Diffusion's Training Data Contained Copyrighted Images
   Incident82%

   • Getty Images is suing the creators of AI art tool Stable Diffusion for scraping its contenthttps://www.theverge.com/2023/1/17/23558516/ai-art-copyright-stable-diffusion-getty-images-lawsuit
   • Stable Diffusion litigationhttps://stablediffusionlitigation.com
   • AI Incident Database - Incident 451https://incidentdatabase.ai/cite/451/

   Getty Images is suing the creators of AI art tool Stable Diffusion for scraping its contentStable Diffusion litigationAI Incident Database - Incident 451
5. 8 Feb 2023Private Medical Photos Were Reportedly Found in LAION-5B AI Training Dataset
   Incident78%

   • Artist finds private medical record photos in popular AI training data sethttps://arstechnica.com/information-technology/2022/09/artist-finds-private-medical-record-photos-in-popular-ai-training-data-set/
   • AI Incident Database - Incident 465https://incidentdatabase.ai/cite/465/

   Artist finds private medical record photos in popular AI training data setAI Incident Database - Incident 465
6. 4 Jan 2023Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women
   Incident82%

   • ‘Magic Avatar’ App Lensa Generated Nudes From My Childhood Photoshttps://www.wired.com/story/lensa-artificial-intelligence-csem/
   • Lensa’s viral AI art creations were bound to hypersexualize usershttps://www.polygon.com/23513386/ai-art-lensa-magic-avatars-artificial-intelligence-explained-stable-diffusion
   • AI Incident Database - Incident 423https://incidentdatabase.ai/cite/423/

   ‘Magic Avatar’ App Lensa Generated Nudes From My Childhood PhotosLensa’s viral AI art creations were bound to hypersexualize usersAI Incident Database - Incident 423
7. 25 Aug 2022Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn
   Incident78%

   • Deepfakes: Uncensored AI art model prompts ethics questionshttps://techcrunch.com/2022/08/24/deepfakes-for-all-uncensored-ai-art-model-prompts-ethics-questions/
   • AI Incident Database - Incident 314https://incidentdatabase.ai/cite/314/

   Deepfakes: Uncensored AI art model prompts ethics questionsAI Incident Database - Incident 314

PSF mapping