OpenAI Reportedly Uses Contractors to Review ChatGPT Conversations
Agencies using or procuring ChatGPT-based tools should understand that production conversations may enter human-review workflows — with residual privacy risk.
Key points
- OpenAI's 'Project Lily' routes real ChatGPT conversations to contractors for quality scoring and model improvement.
- Removing direct identifiers from conversations does not eliminate re-identification risk from sensitive free-form content.
- Relevant to APS agencies assessing vendor data-handling practices for conversational AI tools in use or under evaluation.
Implications for Australian agencies
- Consider Agencies assessing ChatGPT or comparable conversational AI tools could review vendor data-handling disclosures to determine whether production interactions can enter human-review or training workflows.
- Consider Privacy and AI governance teams could use this case to stress-test vendor risk assessments, particularly around contextual re-identification risk from free-form conversation data.
Implications are AI-generated. Starting points, not advice — see methodology for how they're framed.
View original source
Copied.
Appeared in:
Weekly digest, 14 September 2026
"OpenAI Reportedly Uses Contractors to Review ChatGPT Conversations"
Source: Let's Data Science – AI Governance
Published: 15 September 2026
URL: https://letsdatascience.com/news/openai-reportedly-uses-contractors-to-review-chatgpt-convers-afe1c797
Reporting by 404 Media, based on leaked documents, describes OpenAI using hundreds of contractors under 'Project Lily' to review real ChatGPT user conversations and score model responses. Contractors assess four candidate responses on a one-to-seven scale, producing quality signals used in post-training. While OpenAI reportedly removes direct identifiers before prompts reach reviewers, sensitive details — health, legal, financial, or workplace content — can persist in free-form exchanges. The investigation highlights a practical gap between identifier removal and genuine data minimisation that is directly relevant to any organisation evaluating conversational AI vendor risk.
Implications for Australian agencies:
- [Consider] Agencies assessing ChatGPT or comparable conversational AI tools could review vendor data-handling disclosures to determine whether production interactions can enter human-review or training workflows.
- [Consider] Privacy and AI governance teams could use this case to stress-test vendor risk assessments, particularly around contextual re-identification risk from free-form conversation data.
Retrieved from SIMS, 15 November 2026.