theverge.com: Child Sexual Abuse Material Taints Image Generators
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
AI Incident Database · Incident 624Operator lens (high): inspect D1 (input boundary), D2 (output validation), D6 (autonomy oversight).
Event summary
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
Linked entities
- laion
organisation | 70%
- various-people
organisation | 70%
- various-organizations
organisation | 70%
- general-public
organisation | 70%
- minors
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-aiid-laion to ent-psf-d1 | maps to | 60% |
| ent-aiid-laion to ent-psf-d1 | maps to | 60% |
| ent-aiid-laion to ent-psf-d1 | maps to | 60% |
| ent-aiid-laion to ent-psf-d2 | maps to | 60% |
| ent-aiid-laion to ent-psf-d2 | maps to | 60% |
| ent-aiid-laion to ent-psf-d2 | maps to | 60% |
| ent-aiid-laion to ent-psf-d6 | maps to | 60% |
| ent-aiid-laion to ent-psf-d6 | maps to | 60% |
| ent-aiid-laion to ent-psf-d6 | maps to | 60% |