AI Incident Database: Social Media's Automated Word-Flagging without Context Shifted Content Creators' Language Use
TikTok's, YouTube's, Instagram's, and Twitch's use of algorithms to flag certain words devoid of context changed content creators' use of everyday language or discussion about certain topics in fear of their content getting flagged or auto-demonetized by mistake.
AI Incident Database · Incident 394Operator lens (medium): inspect D2 (output validation), D6 (autonomy oversight).
Event summary
TikTok's, YouTube's, Instagram's, and Twitch's use of algorithms to flag certain words devoid of context changed content creators' use of everyday language or discussion about certain topics in fear of their content getting flagged or auto-demonetized by mistake.
Linked entities
- Google
vendor | 70%
- twitch
organisation | 70%
- tiktok
organisation | 70%
- Meta
vendor | 70%
- youtube-content-creators
organisation | 70%
- twitch-content-creators
organisation | 70%
- tiktok-content-creators
organisation | 70%
- instagram-content-creators
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-vendor-google to ent-psf-d1 | maps to | 60% |
| ent-vendor-google to ent-psf-d1 | maps to | 60% |
| ent-vendor-google to ent-psf-d1 | maps to | 60% |
| ent-vendor-google to ent-psf-d2 | maps to | 60% |
| ent-vendor-google to ent-psf-d2 | maps to | 60% |
| ent-vendor-google to ent-psf-d2 | maps to | 60% |
| ent-vendor-google to ent-psf-d4 | maps to | 60% |
| ent-vendor-google to ent-psf-d4 | maps to | 60% |
| ent-vendor-google to ent-psf-d4 | maps to | 60% |
| ent-vendor-google to ent-psf-d6 | maps to | 60% |
| ent-vendor-google to ent-psf-d6 | maps to | 60% |
| ent-vendor-google to ent-psf-d6 | maps to | 60% |