Printed from Production AI Institute public record

https://www.productionai.institute/graph/entities/aiid-department-for-work-and-pensions

Production AI Institute · Public recordRecord
Production AI Institute
Briefing
Briefing

Today's public AI briefing: what changed, what went wrong, and what the evidence says.

Open Briefing →
Today's AI briefingThe daily record of what changed and broke.Public record explorerSearch every incident, entity, and source.
Check
Check

Inspect tools, incidents, and data-use disclosures against the public record.

Open Check →
Check an AI toolWhat a tool actually does with your data.Run exposure checkTest your own stack against the record.Data-use indexDisclosures across the major AI tools.Incident registryDocumented production AI failures.
The Lab
The Lab

Independent research instruments: model and agent scorecards, moral-reasoning evals, and ecosystem assessments.

Open The Lab →
The LabHow frontier models and agents actually perform.AI Morality CompassTest models on hard moral cases.Agent readinessIs the agent ecosystem production-ready?Ecosystem assessmentsIndependent reviews of the AI stack.Model & agent evalsOpen evaluations and their results.Research libraryEvidence-led analysis and briefings.
Learn
Learn

The open standard, the tools built on it, and the research that interprets the record.

Open Learn →
The FrameworkThe open production safety framework, explained.AI Adoption GuideFive stages from gated access to safe autonomy.Production AI Deployment GuideBuild a governed production system on Microsoft or AWS.Five-Year Automation RoadmapSequence enterprise capability, controls, and value.WorkflowOS · open sourceBuild governed AI workflows.Workflow libraryReady-made governed workflows.InsightsResearch articles on the record.
Act
Act

Turn uncertainty into public evidence: ask, disclose, build evidence, or correct.

Open Act →
Ask for disclosureRequest a public data-use answer.Submit a correctionFlag something wrong or missing on the record.Save a watchTell PAI what to keep current for you.
Method
Method

How the public record is made, governed, corrected, cited, and kept independent.

Open Method →
How records are madeSourcing, review, and correction.
Check an AI tool
Record
Record
Check an AI tool
Production AI Institute public record · department-for-work-and-pensions · observed 2024-07-17
← Public record explorer
Reading room view →
organisation
Production AI public record - EditorialMethod →

department-for-work-and-pensions

department-for-work-and-pensions - organisation named in the AI Incident Database harm index.

Confidence
70%
Sources
8
Events
3
Observed
observed 741d ago
department-for-work-and-pensions

What changed

A Department for Work and Pensions (DWP) algorithm wrongly flagged over 200,000 UK housing benefit claims as high risk, resulting in unnecessary investigations. Two-thirds of these flagged claims were legitimate, causing wasted public funds and stress for claimants. Despite initial success in a pilot, the algorithm's real-world performance fell short. This incident highlights the risks of overreliance on automated systems in welfare administration.

  • DWP algorithm wrongly flags 200,000 people for possible fraud and errorhttps://www.theguardian.com/society/article/2024/jun/23/dwp-algorithm-wrongly-flags-200000-people-possible-fraud-error
  • DWP algorithm 'wrongly flags' 200,000 people for fraudhttps://uk.news.yahoo.com/dwp-algorithm-wrongly-flags-200-090310331.html
  • AI Incident Database - Incident 738https://incidentdatabase.ai/cite/738/

Timeline

  1. 17 July 2024Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud
    Incident82%
    • DWP algorithm wrongly flags 200,000 people for possible fraud and errorhttps://www.theguardian.com/society/article/2024/jun/23/dwp-algorithm-wrongly-flags-200000-people-possible-fraud-error
    • DWP algorithm 'wrongly flags' 200,000 people for fraudhttps://uk.news.yahoo.com/dwp-algorithm-wrongly-flags-200-090310331.html
    • AI Incident Database - Incident 738https://incidentdatabase.ai/cite/738/
  2. 17 July 2024Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers
    Incident78%
    • DWP accused of discriminating against single mums with Universal Credit changeshttps://www.mirror.co.uk/money/dwp-accused-discriminating-against-single-33207819
    • AI Incident Database - Incident 740https://incidentdatabase.ai/cite/740/
  3. 22 Nov 2023UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review
    Incident82%
    • MP raises concern over Bulgarian nationals’ UK benefit suspensionshttps://www.theguardian.com/society/2021/dec/06/mp-raises-concern-over-bulgarian-nationals-uk-benefit-suspensions
    • UK risks scandal over ‘bias’ in AI tools in use across public sectorhttps://www.theguardian.com/technology/2023/oct/23/uk-risks-scandal-over-bias-in-ai-tools-in-use-across-public-sector
    • AI Incident Database - Incident 611https://incidentdatabase.ai/cite/611/

PSF mapping

No PSF domains are mapped to this entity in the current public record.

Source trail (8)

primary · checked 27 June 2024

↗

primary · checked 22 Nov 2023

↗

primary · checked 22 Nov 2023

↗

secondary · checked 9 July 2026

↗

secondary · checked 9 July 2026

↗

secondary · checked 9 July 2026

↗

secondary · checked 17 July 2024

↗

secondary · checked 17 July 2024

↗

Related records

Connected entities

standardPSF D1 — Input GovernancestandardPSF D2 — Output ValidationstandardPSF D3 — Data ProtectionstandardPSF D6 — Human OversightstandardPSF D7 — Security

Original public page: Open original record

Open in record explorer →
Cite this record

"department-for-work-and-pensions." https://www.productionai.institute/graph/entities/aiid-department-for-work-and-pensions (observed 2024-07-17; retrieved 2026-07-28). PAI.

Share on XShare on LinkedInCitation guide →
Public record

This record is maintained by PAI and free to cite. If something is wrong or missing, tell us. Corrections and source suggestions keep the record honest.

Share the record
Share on XShare on LinkedIn
Follow policy changes ->Save a watch ->Submit a correction
Records are free to cite. citation guidance.
AI risk intelligence

Track what changed, read the weekly brief, and follow the public evidence record - the operator loop for production AI risk.

Live risk watch →AI risk brief →Save a watch →Public record →
PAI
Production AI Institute

The public record and operating memory for production AI: what changed, what broke, and what the evidence says.

WorkflowOS · open source (MIT)
Navigate
Briefing
OverviewToday's AI briefingPublic record explorer
Check
Check an AI toolRun exposure checkData-use indexIncident registry
The Lab
The LabAI Morality CompassAgent readinessEcosystem assessmentsModel & agent evalsResearch library
Learn
The FrameworkAI Adoption GuideProduction AI Deployment GuideFive-Year Automation RoadmapWorkflowOS · open sourceWorkflow libraryInsights
Act
Ask for disclosureSubmit a correctionSave a watch
Method & trust
How records are madeCorrectionsHow to citeContact
© 2026 Production AI Institute · CC BY 4.0
AboutPrivacyTermsSecurityGovernanceIndependence