Superhuman Automated Forecasting
AI-assisted forecasting tools entering policy use raises automation bias and calibration questions that APS AI governance practitioners should be aware of.
Key points
- Centre for AI Safety's FiveThirtyNine bot matches crowd-level forecasting accuracy on 177 Metaculus questions using GPT-4o.
- The post argues AI forecasting bots could help policymakers reduce bias and improve decision-making on complex topics.
- Automation bias, tail-risk neglect, and lack of fine-tuning are flagged limitations relevant to any government deployment context.
Implications for Australian agencies
- Monitor APS AI governance and strategy teams may want to monitor AI forecasting tool development, particularly as vendors begin marketing similar capabilities to government decision-makers.
- Consider Agencies considering AI-assisted policy analysis tools could assess the automation bias and calibration risks flagged here against their own risk frameworks before any adoption.
Implications are AI-generated. Starting points, not advice — see methodology for how they're framed.
View original source
Copied.
Appeared in:
Weekly digest, 4 May 2026
"Superhuman Automated Forecasting"
Source: Centre for AI Safety – Blog
Published: (undated)
URL: https://safe.ai/blog/forecasting
The Centre for AI Safety has released FiveThirtyNine, a GPT-4o-based forecasting bot that achieved 87.7% accuracy on 177 Metaculus prediction questions, roughly matching crowd forecaster performance. The post argues such tools could improve policymaker decision-making by providing neutral, calibrated probability assessments on complex or contested questions. The authors acknowledge significant limitations including automation bias risk, inconsistent probability outputs, poor performance on recent events, and the absence of a query-rejection mechanism. The piece frames AI forecasting as a potential epistemic infrastructure tool alongside Wikipedia and Community Notes, with integration into AI assistants and social media platforms as a stated ambition.
Implications for Australian agencies:
- [Monitor] APS AI governance and strategy teams may want to monitor AI forecasting tool development, particularly as vendors begin marketing similar capabilities to government decision-makers.
- [Consider] Agencies considering AI-assisted policy analysis tools could assess the automation bias and calibration risks flagged here against their own risk frameworks before any adoption.
Retrieved from SIMS, 18 July 2026.