AI Incident Database: ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios
The "Dan" ("Do Anything Now") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.
AI Incident Database · Incident 677Operator lens (medium): inspect D2 (output validation), D7 (tool permissions).
Event summary
The "Dan" ("Do Anything Now") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.
Linked entities
- OpenAI
vendor | 70%
- Perplexity
vendor | 70%
- tiktok-users
organisation | 70%
- julia-munslow
organisation | 70%
- chatgpt
organisation | 70%
- gpt-3.5
organisation | 70%
- gpt-4
organisation | 70%
- general-public
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d1 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d6 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |
| ent-vendor-openai to ent-psf-d2 | maps to | 60% |