Judge Finds DOGE Used ChatGPT to Cancel Grants
A court-documented failure of LLM use in government grant decisions directly illustrates risks APS agencies face when automating high-stakes classifications without adequate governance.
Key points
- A US federal judge ruled DOGE unlawfully cancelled 1,400+ NEH grants after ChatGPT flagged them as DEI-related.
- DOGE staff used minimal-context prompts with no DEI definition, no human-in-the-loop review, and no reasoning documentation.
- The ruling is a concrete legal precedent on AI-assisted government decision-making intersecting with constitutional rights.
Implications for Australian agencies
- Consider APS agencies using or evaluating LLMs for screening, eligibility, or classification decisions could assess whether their human-in-the-loop requirements, prompt design practices, and documentation standards are sufficient to withstand legal scrutiny.
- Monitor Policy and governance teams may want to monitor whether this ruling is cited in future challenges to automated decision-making, and whether it prompts new guidance from oversight bodies on acceptable LLM use in adjudicative processes.
Implications are AI-generated. Starting points, not advice — see methodology for how they're framed.
View original source
Copied.
Appeared in:
Weekly digest, 4 May 2026
"Judge Finds DOGE Used ChatGPT to Cancel Grants"
Source: Let's Data Science – AI Governance
Published: 10 May 2026
URL: https://letsdatascience.com/news/judge-finds-doge-used-chatgpt-to-cancel-grants-f9d8349e
US District Judge Colleen McMahon ruled that DOGE unlawfully terminated over 1,400 National Endowment for the Humanities grants worth more than $100 million, finding the process amounted to unconstitutional viewpoint discrimination. Court filings show DOGE staff submitted brief grant descriptions to ChatGPT using a single-label prompt asking whether content related to DEI, with no definition of DEI supplied to the model and no substantive human review of outputs. The judge found the resulting classifications lacked adequate reasoning and violated the First and Fifth Amendments. The case is now a documented legal record of the governance failures—absent definitions, audit trails, and human oversight—that arise when generative AI outputs drive rights-affecting administrative decisions.
Implications for Australian agencies:
- [Consider] APS agencies using or evaluating LLMs for screening, eligibility, or classification decisions could assess whether their human-in-the-loop requirements, prompt design practices, and documentation standards are sufficient to withstand legal scrutiny.
- [Monitor] Policy and governance teams may want to monitor whether this ruling is cited in future challenges to automated decision-making, and whether it prompts new guidance from oversight bodies on acceptable LLM use in adjudicative processes.
Retrieved from SIMS, 18 July 2026.