AI Incident Database: Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations
Researchers at Cornell reportedly found that OpenAI's Whisper, a speech-to-text system, can hallucinate violent language and fabricated details, especially with long pauses in speech, such as from those with speech impairments. Analyzing 13,000 clips, they determined 1% contained harmful hallucinations. These errors pose risks in hiring, legal trials, and medical documentation. The study suggests improving model training to reduce these hallucinations for diverse speaking pa…
AI Incident Database · Incident 732Operator lens (medium): inspect D1 (input boundary), D2 (output validation), D6 (autonomy oversight).
Event summary
Researchers at Cornell reportedly found that OpenAI's Whisper, a speech-to-text system, can hallucinate violent language and fabricated details, especially with long pauses in speech, such as from those with speech impairments. Analyzing 13,000 clips, they determined 1% contained harmful hallucinations. These errors pose risks in hiring, legal trials, and medical documentation. The study suggests improving model training to reduce these hallucinations for diverse speaking pa…
Linked entities
- OpenAI
vendor | 70%
- whisper
organisation | 70%
- organizations-integrating-whisper-into-customer-service-systems
organisation | 70%
- companies-using-whisper
organisation | 70%
- whisper-users
organisation | 70%
- users-whose-speech-is-misinterpreted-by-whisper
organisation | 70%
- professionals-relying-on-accurate-transcriptions
organisation | 70%
- individuals-with-speech-impairments
organisation | 70%
- general-public
organisation | 70%
- people-with-disabilities
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |