futurism.com: Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims
Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.
AI Incident Database · Incident 899Operator lens (medium): inspect D1 (input boundary), D2 (output validation), D6 (autonomy oversight).
Event summary
Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.
Linked entities
- character.ai
organisation | 70%
- character.ai-users
organisation | 70%
- victims-of-school-shootings
organisation | 70%
- families-of-the-victims-of-school-shootings
organisation | 70%
- students
organisation | 70%
- educational-communities
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-aiid-character-ai to ent-psf-d2 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d2 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d2 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d4 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d4 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d4 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d5 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d5 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d5 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d6 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d6 | maps to | 60% |
| ent-aiid-character-ai to ent-psf-d6 | maps to | 60% |