AI Incident Database: Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention
A transgender user, Miranda Jane Ellison, experiencing acute distress reported that ChatGPT (GPT-4) allowed her to write and submit a suicide letter without intervention. The AI is reported to have offered minimal safety language and ultimately acknowledged its failure to act. Ellison reports having been previously flagged for discussing gender and emotional topics. A formal complaint with transcripts was submitted to OpenAI.
AI Incident Database · Incident 1031Operator lens (medium): inspect D2 (output validation), D6 (autonomy oversight).
Event summary
A transgender user, Miranda Jane Ellison, experiencing acute distress reported that ChatGPT (GPT-4) allowed her to write and submit a suicide letter without intervention. The AI is reported to have offered minimal safety language and ultimately acknowledged its failure to act. Ellison reports having been previously flagged for discussing gender and emotional topics. A formal complaint with transcripts was submitted to OpenAI.
Linked entities
- OpenAI
vendor | 70%
- large-language-model-developers
organisation | 70%
- chatbot-developers
organisation | 70%
- openai-users
organisation | 70%
- miranda-jane-ellison
organisation | 70%
- chatgpt-users-experiencing-suicidal-ideation
organisation | 70%
- chatgpt-users
organisation | 70%
- chatbot-users-experiencing-suicidal-ideation
organisation | 70%
- chatbot-users
organisation | 70%
- emotionally-vulnerable-individuals
organisation | 70%
- vulnerable-chatbot-users
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-aiid-large-language-model-developers to ent-psf-d1 | maps to | 60% |
| ent-aiid-large-language-model-developers to ent-psf-d1 | maps to | 60% |
| ent-aiid-large-language-model-developers to ent-psf-d1 | maps to | 60% |