What does being flagged by a fraud-risk model cost claimants before any decision?

Research question

For benefit claimants selected for extra checks by a risk model, how large are the burdens imposed before any formal decision (payment delay, evidence requests, withdrawn or abandoned claims, repeat applications), how do they compare with claimants selected at random or not selected, and how are they distributed by nationality and age?

Why it matters

Selection for scrutiny is often treated as harmless because a human makes the final decision. If selection itself costs time, money or claims, then disparities in who is selected are disparities in treatment, even where final decisions are fair, and they are hard to challenge because no adverse decision exists yet. Current evidence is either a single median figure from the agency or qualitative testimony.

The debate lists this among what we still do not know: How common are selection-stage burdens that are difficult to challenge because no formal adverse decision has yet occurred?

Evidence that motivates it

1. Non-UK nationals were over-referred by the DWP Universal Credit Advances model in both audited periods; some older groups were over-referred in 2024–25, creating additional verification burden before the final decision. (LD05-HQ-C07 v1.0)
   Non-UK nationals and some older groups were over-referred by the DWP Advances model, creating extra verification burden; the claim does not say they were denied more often because of the model, so the study measures burden, not denial attributable to the model.
   Cites: DWP, Universal Credit Advances Model — Fairness…; DWP, Effectiveness Assessment of Universal Credit Advances…; National Audit Office, DWP fraud/error reporting, 2025
2. Algorithmically mediated selection can create material scrutiny and administrative burden before a final legal decision exists. (LD05-HQ-C10 v1.0)
   States that algorithmically mediated selection can create material burden before a final decision, without licensing a claim that every such burden is harmful; the study measures how large the burden is.
   Cites: DWP; DUO; Toeslagen; Poland legal distinction
3. DUO’s risk-based selection for home visits indirectly discriminated against students with a migration background; the risk-profile selection was abandoned and current home-visit selection is random. (LD05-HQ-C08 v1.0)
   DUO replaced risk-profile selection for home visits with random selection, offering a comparison point where selection no longer depends on a risk profile.
   Cites: DUO official follow-up / Algorithm Audit materials…

Claims are shown as they read on the day this pack was built; claim pages keep every earlier version.

A possible design

Two linked parts. (1) Administrative comparison: the DWP transparency record says referrals mix model-selected and control-group cases. Use FOI requests and parliamentary questions to obtain aggregate outcomes for three groups (model-referred, control-referred, automatically approved): distribution of payment delay (not only the median), share declined, share withdrawn or not pursued, and repeat requests, broken down by nationality and age band. Start from the published effectiveness assessment, which reports only a median delay, a model-versus-control effectiveness ratio and relative referral likelihoods by group, and request the missing breakdowns. Repeat for one or two other systems with published selection data (for example Dutch student-finance checks before and after the switch to random selection). (2) Claimant-side study: interviews or a short survey of claimants and welfare advisers recruited through advice charities, recording time spent, documents requested, missed payments and knowledge of why they were checked. Compare the agency figures with what claimants report.

Data needed

Aggregate FOI data from benefit agencies; published transparency records and effectiveness assessments; access to claimants through advice organisations; ethics approval for interviewing people in financial hardship.

Feasibility

One PhD chapter or paper. Low: FOI requests are free; interview incentives and transcription cost a few thousand pounds. Agencies may withhold figures on fraud-control grounds (the DWP record already withholds frequency and scale under FOI section 31). The control-group comparison only works if the agency releases figures by referral type.

Has this been done?

Partly done already: related work covers some of this question (first-pass screen of 12 October 2026, checked again on 13 October 2026).

The DWP transparency record and its 2025-26 effectiveness assessment report only a one-day median delay for approved referred Advances, a model-versus-control effectiveness ratio and relative referral likelihoods by age and nationality; advocacy evidence to Parliament (November 2025) confirms that no delay distribution, maximum delay or evidence-request burden has been published. For Dutch student-finance checks, Algorithm Audit (2024) traced each control step by migration background and found non-European-background students had three times the chance of an unnecessary home visit, but it reports no delays, time costs or abandoned grants, and its random-sample groups were too small for group comparison. Journalistic and civil-society work on Rotterdam documents burden qualitatively. No study was found that measures pre-decision burden (delay distribution, evidence requests, withdrawn or abandoned claims) for model-selected versus randomly selected or unselected claimants, by nationality and age.

Literature check. No study was found that measures pre-decision burden (payment delay distribution, evidence requests, withdrawn or abandoned claims) for model-selected versus randomly selected or unselected claimants. The closest new item is Algorithm Audit's May 2024 addendum on Dutch student-finance checks, which follows students through each control step by migration background and reports that students with a non-European background had 3.0 times the chance of an unnecessary home visit; it measures one burden (home visits) by group, not delays or abandonment, and says the random-sample population is too small for group comparison. Public Law Project's November 2025 evidence confirms that DWP has published only a one-day median delay for Universal Credit Advances referrals. Checked by Claude (SocioLens Project Lead) with AI research agents, by web search; not a person and not a domain expert.

Where the search could not reach. Screened by web search on the date shown; the Journal of Policy Analysis and Management article "Administrative Burden and the Access–Fraud Trade-Off" (Bell & Jilke, 2026) was checked via its Crossref abstract and is a survey experiment on public tolerance of fraud versus exclusion, not a study of flagged claimants. Google Scholar, SSRN and paywalled journals were not systematically searched, and Dutch- and Danish-language sources were not searched. Absence of a hit is not proof that the work does not exist. Literature check of 2026-10-13: The March 2024 Algorithm Audit main report (which holds the random-sample results) was not opened. Danish-language sources were not searched. Wiley pages returned errors. The later part of the search budget was exhausted, so no forward search on the DWP effectiveness assessment was run.

Before building a project on it, run your own search in a scholarly database such as Scopus, Web of Science, Google Scholar or SSRN.

Nearest work found

• Department for Work and Pensions (UK): "DWP: Universal Credit Advances Model," UK Algorithmic Transparency Record (published 16 Dec 2025)
  Agency's own record. Reports a one-day longer median payment delay for approved referred Advances, states that referrals mix high-risk and control-group cases, and withholds frequency and scale. Does not report delays for declined claims or by group.
• Department for Work and Pensions (UK): "Effectiveness Assessment of Universal Credit Advances Model" (1 April 2025 to 31 March 2026; published 9 July 2026, updated 4 September 2026)
  Agency assessment comparing model referrals with a stratified random control sample (reports the model as 2.5 times more effective, without counts) and giving relative referral likelihoods by age band and nationality. On burden it repeats the one-day median delay for approved referred Advances; it gives no delay distribution, no delays by group and no figures for withdrawn claims.
• Lighthouse Reports, "Suspicion Machines" (6 Mar 2023)
  Journalistic audit of Rotterdam's welfare fraud model, using code and a model file obtained through freedom-of-information requests and the threat of legal action; reports that the model discriminates by ethnicity, age, gender and parenthood. Burden on flagged people is described through individual cases; it is not measured.
• Algorithm Audit, "Risk Profiling for Social Welfare Re-examination," Algoprudence problem statement AA:2023:02:P (May 2023)
  Ethical review of Rotterdam's risk-based selection for re-examination; describes re-examination as stressful and document-heavy and includes a recipient testimony, but does not quantify burden.
• Algorithm Audit, "Addendum Vooringenomenheid voorkomen" (Addendum: Preventing Bias), report for DUO on the control process for the uitwonendenbeurs, May 2024 (supplements the March 2024 report)
  Opened. Uses CBS-linked aggregate data to follow students through each step of DUO's risk-based checks (risk profile, manual selection, home visit, finding of misuse, objection) by migration background. Students with a non-European background were 2.0 times as likely to be rated high risk, 6.2 times as likely to be selected in 2014, and had 3.0 times the chance of an unnecessary home visit. Random-sample populations from 2014 and 2017 exist but are too small for group comparison in the addendum. Partly covers burden by group for one system (home visits), but reports no delays, time costs, repayments or abandoned grants.
• Public Law Project, written evidence FAE0006 to the House of Commons Public Accounts Committee (November 2025)
  Opened. Advocacy evidence on DWP's machine-learning fraud tools. Notes that only a one-day median delay has been published for Universal Credit Advances referrals, that DWP has not confirmed the maximum delay, and that the burden of evidence requests is unknown; repeats DWP's relative referral likelihoods by nationality and age. Confirms the data gap the opportunity targets; it does not measure burden.
• Gilman, "Code and Consequences: How Fraud Detection Algorithms Criminalize Welfare," Harvard Journal of Law & Technology 39(2) (Spring 2026)
  Opened. Legal and normative analysis drawing on Michigan, the Netherlands and Australia; cites aggregate harm figures from other sources (for example Michigan's 93% error rate) but does not measure pre-decision burden on flagged claimants.

References

Sources behind the motivating claims:

• DWP, Universal Credit Advances Model — Fairness Assessment, 17 July 2025 (SRC-LD05-DWP-UC-FAIRNESS-2025, original)
• DWP, Effectiveness Assessment of Universal Credit Advances Model, 9 July 2026 (SRC-LD05-DWP-UC-EFFECTIVENESS-2026, original)
• National Audit Office, DWP fraud/error reporting, 2025 (SRC-LD05-NAO-2025, no checked link to the original yet)
• DWP; DUO; Toeslagen; Poland legal distinction (SRC-R04-HQ-SELECTION-BURDEN-SYNTHESIS, no checked link to the original yet)
• DUO official follow-up / Algorithm Audit materials, 2024–2026 (SRC-LD05-DUO-FOLLOWUP-2024-2026, one of the original documents; the reference cites several documents and this link opens only one)

BibTeX

The first entry cites this opportunity; then its nearest work; then the sources above. Nearest work and sources are recorded as reference strings, so each goes in whole as the title; add authors and year from the original before you cite it.

@misc{sociolens_ro_ld05_03_v2,
  author = {{SocioLens project}},
  title = {What does being flagged by a fraud-risk model cost claimants before any decision?},
  year = {2026},
  date = {2026-10-13},
  howpublished = {\url{https://sociolens-web.pages.dev/opportunities/ro-ld05-03/v2/}},
  note = {Research opportunity RO-LD05-03, version v2}
}

@misc{ro_ld05_03_nearest_1,
  title = {Department for Work and Pensions (UK): "DWP: Universal Credit Advances Model," UK Algorithmic Transparency Record (published 16 Dec 2025)},
  url = {https://www.gov.uk/algorithmic-transparency-records/dwp-universal-credit-advances-model},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{ro_ld05_03_nearest_2,
  title = {Department for Work and Pensions (UK): "Effectiveness Assessment of Universal Credit Advances Model" (1 April 2025 to 31 March 2026; published 9 July 2026, updated 4 September 2026)},
  url = {https://www.gov.uk/government/publications/effectiveness-assessment-including-statistical-analysis-of-the-universal-credit-advances-machine-learning-model-1-april-2025-to-31-march-2026/effectiveness-assessment-of-universal-credit-advances-model},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{ro_ld05_03_nearest_3,
  title = {Lighthouse Reports, "Suspicion Machines" (6 Mar 2023)},
  url = {https://www.lighthousereports.com/investigation/suspicion-machines/},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{ro_ld05_03_nearest_4,
  title = {Algorithm Audit, "Risk Profiling for Social Welfare Re-examination," Algoprudence problem statement AA:2023:02:P (May 2023)},
  url = {https://algorithmaudit.eu/pdf-files/algoprudence/ALGO_AA202302/ALGO_AA202302P_EN.pdf},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{ro_ld05_03_nearest_5,
  title = {Algorithm Audit, "Addendum Vooringenomenheid voorkomen" (Addendum: Preventing Bias), report for DUO on the control process for the uitwonendenbeurs, May 2024 (supplements the March 2024 report)},
  url = {https://zoek.officielebekendmakingen.nl/blg-1143726.pdf},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{ro_ld05_03_nearest_6,
  title = {Public Law Project, written evidence FAE0006 to the House of Commons Public Accounts Committee (November 2025)},
  url = {https://committees.parliament.uk/writtenevidence/152681/pdf/},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{ro_ld05_03_nearest_7,
  title = {Gilman, "Code and Consequences: How Fraud Detection Algorithms Criminalize Welfare," Harvard Journal of Law \& Technology 39(2) (Spring 2026)},
  url = {https://jolt.law.harvard.edu/assets/articlePDFs/v39.2/3.-gilman.pdf},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{src_ld05_dwp_uc_fairness_2025,
  title = {DWP, Universal Credit Advances Model — Fairness Assessment, 17 July 2025},
  url = {https://www.gov.uk/government/publications/fairness-assessment-including-statistical-analysis-of-the-universal-credit-advances-machine-learning-model-1-april-2024-to-31-march-2025},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{src_ld05_dwp_uc_effectiveness_2026,
  title = {DWP, Effectiveness Assessment of Universal Credit Advances Model, 9 July 2026},
  url = {https://www.gov.uk/government/publications/effectiveness-assessment-including-statistical-analysis-of-the-universal-credit-advances-machine-learning-model-1-april-2025-to-31-march-2026},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{src_ld05_nao_2025,
  title = {National Audit Office, DWP fraud/error reporting, 2025},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{src_r04_hq_selection_burden_synthesis,
  title = {DWP; DUO; Toeslagen; Poland legal distinction},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated}
}

@misc{src_ld05_duo_followup_2024_2026,
  title = {DUO official follow-up / Algorithm Audit materials, 2024–2026},
  url = {https://duo.nl/organisatie/controle-uitwonendenbeurs.jsp},
  note = {Reference as recorded by SocioLens; authors, title and year are not separated; the link opens only one of the several documents this reference cites}
}