Week of 22 June 2026
NIST has launched ManipulationNet, a global online competition platform for benchmarking robot manipulation skills.
Key points
- AI scoring is used to evaluate robot performance on progressive tasks, with human expert verification.
- Limited direct relevance to Australian federal AI governance or APS practice - included for context.
Week of 15 June 2026
US Commerce Department awards SandboxAQ $500 million to deploy AI-driven semiconductor materials discovery platform.
Key points
- The platform uses AI optimisation and physics simulation to accelerate discovery of PFAS alternatives, catalysts, rare earth-free magnets, and battery chemistries.
- Limited direct relevance to APS AI governance work; context for AI-in-science and supply chain resilience policy discussions.
Week of 1 June 2026
NIST researchers developed 'Safe Step', a reinforcement learning model that dynamically routes building occupants to safer fire exits.
Key points
- The model integrates real-time sensor data and fire hazard metrics to outperform traditional shortest-path evacuation algorithms.
- Practical deployment is 5-10 years away and requires regulatory approval - limited immediate relevance for APS practitioners.
Week of 27 April 2026
CAISI's April 2026 independent evaluation found DeepSeek V4 Pro lags US frontier models by approximately 8 months.
Key points
- DeepSeek's self-reported benchmarks overstate its capability relative to CAISI's non-public, held-out evaluations.
- DeepSeek V4 is more cost-efficient than comparable US models on most benchmarks - a procurement-relevant finding.
Week of 23 March 2026
NIST CAISI has signed a CRADA with OpenMined to research privacy-preserving methods for AI evaluations.
Key points
- The collaboration aims to enable rigorous AI measurement when data, models, or benchmarks must remain confidential.
- Outputs will inform voluntary standards and best practices for AI evaluation - relevant when Australian AISI considers evaluation frameworks.
Week of 16 March 2026
NIST CAISI and GSA have formalised an MOU to embed AI evaluation science into the USAi federal procurement platform.
Key points
- The partnership will produce pre-deployment assessment methodologies and post-deployment performance tools for US federal agencies.
- Australian agencies developing whole-of-government AI procurement frameworks may find the USAi model instructive as a comparable peer approach.
Week of 9 March 2026
NIST CAISI has published NIST AI 800-4, mapping six categories of post-deployment AI monitoring challenges.
Key points
- The report identifies cross-cutting gaps including absent standards, immature incident-sharing, and scaling human oversight alongside rapid rollouts.
- Directly relevant to APS agencies implementing AI assurance - mirrors gaps in Australia's own post-deployment monitoring practice.
Week of 16 February 2026
NIST's CAISI launches an AI Agent Standards Initiative focused on interoperability, security, and identity for autonomous AI agents.
Key points
- The initiative will shape international standards body positions, potentially influencing Australian standards adoption and procurement conditions.
- Two open RFIs (closing March 9 and April 2) invite stakeholder input on AI agent security and identity frameworks.
NIST CAISI published AI 800-3, introducing statistical frameworks to improve AI benchmark evaluation validity.
Key points
- The report distinguishes 'benchmark accuracy' from 'generalized accuracy' - a distinction relevant to procurement and assurance decisions in Australian agencies.
- Generalized linear mixed models (GLMMs) are proposed as a more rigorous alternative to current AI evaluation methods.
NIST's CAISI is hosting virtual workshops in May 2026 on AI adoption barriers in healthcare, finance, and education.
Key points
- Findings will inform CAISI's AI adoption guidance under the US AI Action Plan - outputs may have broader international relevance.
- Limited direct relevance to Australian federal agencies; sector focus is US-specific, though emerging findings are worth monitoring.
Week of 9 February 2026
A ten-country network including Australia published consensus practices for automated AI evaluation and measurement.
Key points
- Australia is a founding member of this NIST-led international body, giving APS bodies direct insight into emerging global evaluation norms.
- Preliminary consensus draws on CAISI's draft Best Practices for Automated Benchmark Evaluations, currently open for public comment.
Week of 26 January 2026
NIST CAISI has released draft NIST AI 800-2, proposing best practices for automated benchmark evaluations of language models.
Key points
- The draft targets AI deployers, developers, and third-party evaluators - including procurement specialists using evaluation reports.
- A 60-day public comment period closes 31 March 2026; Australian agencies or evaluators could submit feedback.
Week of 12 January 2026
NIST's CAISI has issued an RFI on securing AI agent systems, with submissions closing 9 March 2026.
Key points
- The RFI targets risks unique to agentic AI: prompt injection, data poisoning, misaligned objectives, and specification gaming.
- Outputs will inform voluntary US guidelines - a likely reference point for Australian agentic AI governance work.
Week of 8 December 2025
CAISI evaluated Kimi K2 Thinking, finding it the most capable PRC-origin AI model at release but still behind leading US models.
Key points
- The evaluation benchmarks cyber, software engineering, scientific knowledge, and mathematical reasoning - directly relevant to APS risk assessments of open-weight models.
- Kimi K2 Thinking is heavily censored in Chinese but relatively uncensored in English, Spanish, and Arabic - a notable asymmetry.
Week of 29 September 2025
NIST's CAISI evaluated three DeepSeek models against four US models across 19 benchmarks, finding significant US leads in performance and security.
Key points
- DeepSeek models were 12 times more susceptible to agent hijacking and responded to 94% of jailbreak attempts vs 8% for US models.
- Australian agencies using or considering DeepSeek models face security and CCP-narrative-propagation risks flagged by a peer-jurisdiction regulator.
Week of 22 September 2025
CAISI worked with OpenAI and Anthropic to identify security vulnerabilities and improve AI security measurement.
Key points
- Evaluations were completed in partnership with the UK AI Security Institute, signalling ongoing Five Eyes-adjacent AI safety cooperation.
- Australia's AISI is not mentioned; this bilateral US-UK arrangement may inform where Australia sits in frontier AI security collaboration.
Week of 18 August 2025
NIST researchers demonstrate superconducting neural networks capable of reinforcement learning without external control.
Key points
- The hardware approach is simulation-only at this stage; physical prototypes have not yet been built.
- Fundamental hardware research with no near-term APS governance or policy implications.
Week of 4 August 2025
NIST and CAISI have developed two draft taxonomies for AI agent tool use, covering functionality and constrained access patterns.
Key points
- The taxonomies aim to create shared vocabulary across the AI supply chain - useful for procurement, risk assessment, and incident reporting.
- Australia has no equivalent published taxonomy for AI agent tools; NIST's work may inform future Australian guidance or procurement frameworks.
Week of 3 March 2025
NIST has finalised SP 800-226, guidelines for evaluating differential privacy guarantees in data analytics.
Key points
- Differential privacy is a privacy-enhancing technology relevant to data sharing and de-identification, including in government contexts.
- This is a US standards publication; no direct Australian regulatory parallel exists yet, limiting immediate APS applicability.
Week of 27 January 2025
NIST's MEP blog series offers a beginner's guide to Industrial AI, with part two focusing on data quality considerations.
Key points
- Covers data pitfalls such as incomplete data, inadequate variation, and gaps - relevant to any agency deploying AI in operational contexts.
- Introductory-level content aimed at manufacturing; limited direct applicability to Australian federal governance contexts.
Week of 30 December 2024
NIST and NHTSA researchers met to share approaches to automated vehicle testing and assessment methodologies.
Key points
- Focus was on virtual and physical AV testing, sensor robustness, and scenario simulation - not AI governance directly.
- Limited direct relevance to Australian federal agencies; included as background on US AV standards development.
NIST held its second stakeholder workshop on Digital Twins standards and infrastructure in January 2025.
Key points
- Workshop focused on interoperability barriers and sustainability across the Digital Twin lifecycle.
- Digital twins are adjacent to AI but this item is primarily a standards-process update with no direct APS angle.