AI Incident Database: Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission
Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.
AI Incident Database · Incident 963Operator lens (medium): inspect D1 (input boundary), D2 (output validation), D6 (autonomy oversight).
Event summary
Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.
Linked entities
- Google
vendor | 70%
- general-public
organisation | 70%
- general-public-of-australia
organisation | 70%
- google-gemini-users
organisation | 70%
- victims-of-deepfake-terrorism-content
organisation | 70%
- victims-of-deepfake-child-abuse
organisation | 70%
- victims-of-online-radicalization
organisation | 70%
Related graph edges
| Edge | Type | Confidence |
|---|---|---|
| ent-vendor-google to ent-psf-d1 | maps to | 60% |
| ent-vendor-google to ent-psf-d1 | maps to | 60% |
| ent-vendor-google to ent-psf-d1 | maps to | 60% |
| ent-vendor-google to ent-psf-d2 | maps to | 60% |
| ent-vendor-google to ent-psf-d2 | maps to | 60% |
| ent-vendor-google to ent-psf-d2 | maps to | 60% |
| ent-vendor-google to ent-psf-d4 | maps to | 60% |
| ent-vendor-google to ent-psf-d4 | maps to | 60% |
| ent-vendor-google to ent-psf-d4 | maps to | 60% |
| ent-vendor-google to ent-psf-d6 | maps to | 60% |
| ent-vendor-google to ent-psf-d6 | maps to | 60% |
| ent-vendor-google to ent-psf-d6 | maps to | 60% |