A Significant Increase in Digital Labor Automation
Rapid gains in AI agent performance on real professional tasks signal workforce disruption timelines are compressing - relevant to APS workforce and AI strategy planning.
Key points
- The Remote Labor Index shows AI automation of freelance professional work rose from 2.5% to 16.1% in under eight months.
- Benchmark covers economically valuable tasks - 3D design, video, architecture, data analysis - relevant to APS workforce planning.
- Automated LLM judges overstate frontier model capability by 2-3x, reinforcing the need for human evaluation in AI assurance.
Implications for Australian agencies
- Monitor APS workforce and AI strategy teams may want to monitor RLI trajectory as a concrete indicator of the pace at which AI agents can substitute for knowledge-worker outputs.
- Consider Agencies developing AI assurance or evaluation frameworks could consider this finding - that automated LLM judges materially overstate capability - when assessing AI evaluation methodology options.
Implications are AI-generated. Starting points, not advice — see methodology for how they're framed.
View original source
Copied.
Appeared in:
Weekly digest, 29 June 2026
"A Significant Increase in Digital Labor Automation"
Source: Centre for AI Safety – Blog
Published: (undated)
URL: https://safe.ai/blog/significant-increase-in-digital-labor-automation
The Centre for AI Safety's Remote Labor Index (RLI) measures how often AI agents complete real freelance commissions at quality a paying client would accept, judged by human evaluators against professional gold-standard deliverables. The best-performing model (Fable 5) now automates 16.1% of projects, up from 2.5% at benchmark launch roughly eight months ago - a more than fourfold increase. The benchmark spans design, architecture, video, audio, and data work. A secondary finding is that automated LLM-based judges overestimate frontier model performance by approximately 2-3x, underscoring the limits of AI-as-evaluator in assurance contexts.
Implications for Australian agencies:
- [Monitor] APS workforce and AI strategy teams may want to monitor RLI trajectory as a concrete indicator of the pace at which AI agents can substitute for knowledge-worker outputs.
- [Consider] Agencies developing AI assurance or evaluation frameworks could consider this finding - that automated LLM judges materially overstate capability - when assessing AI evaluation methodology options.
Retrieved from SIMS, 18 July 2026.