AI Incident Database: Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls"
PicSo AI, which appears to be getting advertised by Meta over Instagram, is allegedly being used for generating inappropriate content with an emphasis on "girls." This raises concerns about the misuse of generative AI technologies for creating offensive and potentially sexually explicit material that could be used for nefarious and criminal purposes.
AI Incident Database · Incident 576Operator lens (medium): inspect D2 (output validation), D6 (autonomy oversight).
Event summary
PicSo AI, which appears to be getting advertised by Meta over Instagram, is allegedly being used for generating inappropriate content with an emphasis on "girls." This raises concerns about the misuse of generative AI technologies for creating offensive and potentially sexually explicit material that could be used for nefarious and criminal purposes.
Linked entities
- picso-ai
organisation | 70%
- Meta
vendor | 70%
- potentially-exploited-groups
organisation | 70%
- general-public
organisation | 70%
- consumers
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-vendor-meta to ent-psf-d1 | maps to | 60% |
| ent-vendor-meta to ent-psf-d1 | maps to | 60% |
| ent-vendor-meta to ent-psf-d1 | maps to | 60% |
| ent-vendor-meta to ent-psf-d6 | maps to | 60% |
| ent-vendor-meta to ent-psf-d6 | maps to | 60% |
| ent-vendor-meta to ent-psf-d6 | maps to | 60% |
| ent-vendor-meta to ent-psf-d7 | maps to | 60% |
| ent-vendor-meta to ent-psf-d7 | maps to | 60% |
| ent-vendor-meta to ent-psf-d7 | maps to | 60% |
| ent-vendor-meta to ent-psf-d8 | maps to | 60% |
| ent-vendor-meta to ent-psf-d8 | maps to | 60% |
| ent-vendor-meta to ent-psf-d8 | maps to | 60% |