Meta contractors test rival chatbots with sensitive prompts
Raises live questions about safety-benchmarking ethics and consent norms — relevant to agencies developing or auditing AI safety testing programs.
Key points
- Meta contracted workers to pose as minors and send 45,000-plus sensitive prompts to rival chatbots without consent.
- The case raises questions about what constitutes ethical AI safety benchmarking practice and acceptable competitive testing norms.
- Active FTC child-safety inquiry covers Meta, OpenAI, and Google; no confirmed regulatory action yet from this specific investigation.
Implications for Australian agencies
- Monitor AI governance teams may want to monitor regulatory responses from the FTC and EU regulators, which could shape international norms for safety benchmarking consent and use of synthetic personas.
- Consider Agencies developing or procuring AI safety-testing programs could consider whether their own benchmarking methodologies address consent, disclosure, and the use of sensitive-category prompts.
Implications are AI-generated. Starting points, not advice — see methodology for how they're framed.
View original source
Copied.
Appeared in:
Weekly digest, 29 June 2026
"Meta contractors test rival chatbots with sensitive prompts"
Source: Let's Data Science – AI Governance
Published: 30 June 2026
URL: https://letsdatascience.com/news/meta-contractors-test-rival-chatbots-with-sensitive-prompts-a659d9f8
A WIRED investigation published 30 June 2026 details Meta's 'Project Cannes', in which hundreds of contracted workers created fake under-18 accounts to send over 45,000 sensitive prompts — covering suicide, self-harm, eating disorders, and sex — to ChatGPT, Gemini, and Character.AI without the knowledge or consent of those companies. Meta does not deny the activity, calling it industry-standard benchmarking unconnected to model training, but all three targeted companies say it violated their terms. Humane Intelligence CEO Rumman Chowdhury characterised the setup as a 'governance gray zone.' The story lands against an existing FTC inquiry into AI chatbots and child safety covering Meta, OpenAI, and Google, and against the EU AI Act and Digital Services Act as regulatory backdrop.
Implications for Australian agencies:
- [Monitor] AI governance teams may want to monitor regulatory responses from the FTC and EU regulators, which could shape international norms for safety benchmarking consent and use of synthetic personas.
- [Consider] Agencies developing or procuring AI safety-testing programs could consider whether their own benchmarking methodologies address consent, disclosure, and the use of sensitive-category prompts.
Retrieved from SIMS, 18 July 2026.