AI Incident Database: Unrestricted AI Avatar Tool Accidentally Released by TikTok Permits Recitation of Hitler Quotes and Other Harmful Speech
TikTok accidentally released an internal version of its AI digital avatar tool without safeguards, allowing users to generate videos where avatars could recite harmful content, including quotes from Hitler. The tool, meant for advertisers, was accessible to personal accounts and lacked the watermark indicating AI-generated content. TikTok has since removed the tool and acknowledged the problem.
AI Incident Database · Incident 790Operator lens (medium): inspect D2 (output validation), D6 (autonomy oversight).
Event summary
TikTok accidentally released an internal version of its AI digital avatar tool without safeguards, allowing users to generate videos where avatars could recite harmful content, including quotes from Hitler. The tool, meant for advertisers, was accessible to personal accounts and lacked the watermark indicating AI-generated content. TikTok has since removed the tool and acknowledged the problem.
Linked entities
- tiktok
organisation | 70%
- tiktok-users
organisation | 70%
- general-public
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-aiid-tiktok to ent-psf-d1 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d1 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d1 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d2 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d2 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d2 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d4 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d4 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d4 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d2 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d2 | maps to | 60% |
| ent-aiid-tiktok to ent-psf-d2 | maps to | 60% |