AI Incident Database: OpenAI's 4o Model Allegedly Used to Generate Fake Receipts and Prescriptions
OpenAI's new image generator, 4o, was reportedly used to produce realistic fraudulent documents, including fake restaurant receipts, prescriptions for controlled substances, and potentially other identity or financial documents. Users demonstrated how the model could be prompted to bypass safety restrictions to be misused for expense fraud, medical forgery, and other various forms of document falsification.
AI Incident Database · Incident 1018Operator lens (medium): inspect D2 (output validation), D6 (autonomy oversight), D7 (tool permissions).
Event summary
OpenAI's new image generator, 4o, was reportedly used to produce realistic fraudulent documents, including fake restaurant receipts, prescriptions for controlled substances, and potentially other identity or financial documents. Users demonstrated how the model could be prompted to bypass safety restrictions to be misused for expense fraud, medical forgery, and other various forms of document falsification.
Linked entities
- OpenAI
vendor | 70%
- scammers
organisation | 70%
- regulatory-agencies
organisation | 70%
- pharmacists
organisation | 70%
- law-enforcement
organisation | 70%
- healthcare-providers
organisation | 70%
- general-public
organisation | 70%
- expense-management-platforms
organisation | 70%
- employers
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |