Expanding our AI and Healthcare Portfolio
Independent critical research on healthcare AI risks and regulatory gaps offers useful framing for APS agencies developing or assessing health sector AI governance - though the US policy context differs materially from Australia's.
Key points
- AI Now Institute is launching a dedicated research portfolio examining AI deployment risks across US healthcare systems.
- Key concerns include patient safety failures, workforce displacement, regulatory gaps, and corporate consolidation - relevant to Australian health AI governance debates.
- Focus is US-specific; Australian health AI governance context differs, limiting direct applicability for APS readers.
Implications for Australian agencies
- Monitor Health and human services policy teams may want to monitor AI Now's forthcoming publications for independent evidence on healthcare AI harms, particularly around ambient scribes and algorithmic staffing tools that are also being adopted in Australian settings.
- Consider Agencies working on AI governance frameworks for the health sector could consider whether the regulatory gap analysis - especially around tools that fall outside existing medical device and privacy regulation - has analogues in Australia's TGA and Privacy Act landscape.
Implications are AI-generated. Starting points, not advice — see methodology for how they're framed.
View original source
Copied.
Appeared in:
Weekly digest, 18 May 2026
"Expanding our AI and Healthcare Portfolio"
Source: AI Now Institute – Publications
Published: 19 May 2026
URL: https://ainowinstitute.org/publications/research/expanding-our-ai-and-healthcare-portfolio
The AI Now Institute has announced an expanded research portfolio focused on AI deployment in US healthcare, examining patient safety, worker conditions, regulatory adequacy, and the political economy of health AI vendors. The work critiques both the harms of current AI tools - including ambient scribes that fabricate clinical notes, chatbots missing drug allergies, and algorithmic staffing platforms - and the regulatory environment that leaves many tools outside FDA or HIPAA scrutiny. A first publication, 'Uber for Nursing Part II,' examines algorithmic gig nursing platforms. Future work will cover Epic Systems, HCA Healthcare scheduling software, and the Oxevision patient monitoring system. The research is participatory, drawing on healthcare worker collaboration and union partnerships.
Implications for Australian agencies:
- [Monitor] Health and human services policy teams may want to monitor AI Now's forthcoming publications for independent evidence on healthcare AI harms, particularly around ambient scribes and algorithmic staffing tools that are also being adopted in Australian settings.
- [Consider] Agencies working on AI governance frameworks for the health sector could consider whether the regulatory gap analysis - especially around tools that fall outside existing medical device and privacy regulation - has analogues in Australia's TGA and Privacy Act landscape.
Retrieved from SIMS, 18 July 2026.