Week of 14 September 2026
Good Ancestors' September 2026 newsletter covers a major OpenAI rogue-agent incident, industry calls to slow AI development, and Australia's evolving response.
Key points
- Australian signals include ASD calling for an AI early-warning system, Anthropic's Queensland data centre lease, and the Joint Select Committee closing submissions.
- Canberra's tone has shifted markedly toward acknowledging catastrophic AI risk - the newsletter captures this as a genuine policy inflection point.
Von der Leyen endorsed pacing self-improving frontier AI and proposed voluntary talks with major labs at the EU Parliament.
Key points
- EU will pursue cooperation with Canada and the UK on model evaluation, verification, early warning, and AI security - notably excluding the US.
- No binding regulation, evaluation protocols, thresholds, or enforcement mechanisms were announced; this remains a political signal.
Anthropic proposes embedding independent third-party evaluators with access comparable to internal risk-assessment teams during model development.
Key points
- OpenAI's Sam Altman has backed a similar approach, but neither company has specified evaluator selection, access scope, or disclosure rules.
- The proposal is a principle commitment, not an operational program - implementation details will determine whether it constitutes genuine independent scrutiny.
Anthropic and Accenture announce a combined $2 billion commitment to build embedded AI evaluation capacity over five years.
Key points
- Embedded evaluators receive employee-like access to observe model development - a novel operating model for third-party safety assessment.
- Standards for evaluator access, reporting, and disclosure remain unsettled; effectiveness of safeguards is yet to be demonstrated.
Cohere CEO Aidan Gomez argues AI safety standards should emerge from public, international processes rather than industry self-regulation.
Key points
- The debate directly concerns who sets AI safety rules - a question with procurement and governance implications for Australian agencies.
- This is a corporate policy position, not enacted regulation; the underlying governance design question remains unresolved.
Cohere CEO Aidan Gomez warned AI models are becoming the most potent cyber weapon ever created due to scale vulnerability exploitation.
Key points
- Gomez supports AI guardrails but argues safety standards should be evidence-based and not set by a small group of major vendors.
- The article is commentary and secondary reporting - no new vulnerability disclosure, model release, or binding governance development.
Microsoft opened a six-week public consultation on a draft Code of Conduct for its MAI models on 14 September 2026.
Key points
- The draft requires models to remain under human control, accept shutdown, and avoid self-directed goals - relevant to agentic AI procurement assessments.
- This is a consultation draft stating design intent, not a binding standard or evidence of implemented product controls.
New York's LOADinG Act, signed December 2024, mandates human review, impact assessments, and disclosure for state-agency automated decisions.
Key points
- The Act's workforce protections and procurement conditions offer a comparable model to consider alongside Australia's responsible AI policy for government.
- Scope is limited to New York state agencies affecting benefits, rights, or public employees - not a broad private-sector AI restriction.
Bipartisan US bill directs NIST to develop standards for discovering, monitoring, and controlling AI agents in organisational networks.
Key points
- Federal procurement is the proposed enforcement mechanism, potentially binding government AI contractors to agent governance controls.
- This is a bill introduced on 9 September 2026, not yet law - Australian agencies face no immediate compliance obligation.
Anthropic's beta Life Sciences Verification Program grants verified organisations tiered, more permissive Claude access for biology research.
Key points
- The two-tier model — Standard Use and High-risk Use — illustrates how identity verification and institutional oversight can replace broad content filters in dual-use domains.
- Direct APS applicability is limited, but the model is relevant to agencies governing AI use in biosecurity, health research, or dual-use science contexts.
California Governor Newsom issued an executive order accelerating AI oversight laws and opening a two-month review of frontier-model safeguards.
Key points
- A proposed 'kill switch' mandate remains under evaluation only - no technical architecture, authority, or enforcement mechanism has been defined yet.
- Independent audit regimes of this kind typically increase demand for reproducible evaluations, deployment logs, and tested incident-response procedures.
Zuckerberg publicly rejected industry-coordinated AI slowdown, arguing labs have sufficient individual safety incentives.
Key points
- The debate sharpens a live governance question: whether voluntary lab-level controls can manage shared frontier-AI risks.
- Limited direct APS operational relevance; most useful as context for frontier-AI governance policy thinking.
Microsoft AI published a draft Code of Conduct for MAI models on 14 September, opening a six-week public consultation.
Key points
- The document proposes human-control commitments, absolute harm limits, and behavioral constraints - but is not binding regulation.
- APS relevance is indirect; useful context for agencies evaluating vendor AI governance claims or procurement due diligence.
RAND finds AI liability risk spans multiple insurance lines, creating fragmented and uneven coverage for enterprise AI deployments.
Key points
- 84% of public generative AI incidents involve misinformation or deepfakes; 60% of US litigation concerns IP or training disputes.
- Australian insurance market implications are not addressed; this is US-focused research with indirect relevance to APS risk assessments.
OpenAI CEO Sam Altman called for an industry culture of reporting and learning from AI accidents, comparing it to aviation safety.
Key points
- The remarks are a public call for practice, not a mandatory standard, formal oversight body, or agreed incident taxonomy.
- No concrete framework, participating organisations, or incident classification scheme has been announced - this remains aspirational.
UN Secretary-General Guterres called for international AI safety coordination at a September 16 briefing, announcing no new treaty or enforcement body.
Key points
- The statement is a political signal only - no standards, audits, deployment controls, or compliance obligations flow from it.
- Australia is an active participant in multilateral AI governance discussions, so UN-level framing may shape future negotiating contexts.
The EU AI Board's ninth meeting covered AI Act enforcement, AI literacy recommendations, and cybersecurity-AI intersection.
Key points
- Transparency obligations under the AI Act became applicable on 2 August 2026, with supporting Code of Practice and guidelines published.
- Limited direct Australian operational impact; useful as a signal of EU AI Act implementation trajectory.
19 EU Member States have jointly designed and pre-notified the first AI-focused IPCEI, coordinated by Germany.
Key points
- The project covers the full AI stack, targeting decentralised AI services and European digital sovereignty.
- Limited direct APS relevance; signals EU's strategic industrial AI investment posture worth monitoring.
NYC Council's full 51-member body will hold an Oct. 5 hearing calling OpenAI and Anthropic to account on AI safety.
Key points
- New York's RAISE Act, taking effect Jan. 2027, imposes risk assessments, incident reporting, and recordkeeping on frontier AI developers.
- City-level AI governance of frontier model developers is still legally untested - limited direct parallel to Australian federal arrangements.
South Korea, OECD, and ADB convened 80 experts from 25 Asia-Pacific countries to discuss AI-driven official statistics.
Key points
- The workshop centres on SDMX, a global standard for exchanging statistical data and metadata across systems and borders.
- No binding policy, dataset release, or specific AI pilots were announced - limited immediate actionability for APS readers.
Virginia's Executive Order 22 creates an AI Task Force focused on workforce displacement, data privacy, and cybersecurity risks.
Key points
- The order links AI governance with data-centre oversight, barring NDAs that conceal material information about proposed developments.
- Limited direct relevance to Australian federal agencies; useful as a peer-jurisdiction example of state-level AI task force design.
The Future of Life Institute is convening a Pro-Human Assembly in Washington on 15 September, focused on AI accountability and human control.
Key points
- Cross-ideological participation from Sanders and Bannon signals AI control concerns are gaining broad political traction in the US.
- The event is advocacy-only and creates no binding policy, regulation, or industry commitment - limited direct relevance for Australian agencies.
King Charles is hosting a private gathering of major AI executives and the UK AI minister in Scotland.
Key points
- No policy mandate, binding agreement, or formal outcome is attached to the meeting.
- Limited direct relevance to Australian federal agencies; a diplomatic-convening signal only.
All five members of the US House Democratic AI Commission received significant support from AI-linked political donors.
Key points
- The commission is tasked with producing a congressional AI framework - its composition may shape future US federal AI policy.
- No draft framework or legislative proposal has been published; limited direct relevance to Australian federal agencies.
Ugandan diplomat Olara Otunnu has included UN-led AI governance convening in his UN Secretary-General campaign platform.
Key points
- The proposal centres on stakeholder coordination and an 'early compact' - not a new agency, treaty, or adopted policy.
- Limited direct relevance to Australian federal agencies at this stage; purely a campaign position with no institutional force.