AI-powered social media can subtly manipulate opinion at scale, new study finds
AI writing tools embedded in social platforms may constitute a novel influence vector — one no existing regulatory framework, including Australia's, yet addresses.
Key points
- LLMs systematically alter the ideological direction of social media posts even when instructed to preserve original meaning.
- Existing frameworks including the EU AI Act and Digital Services Act do not yet address this subtle opinion-shaping mechanism.
- Australian online safety and AI governance frameworks face a similar regulatory gap - no direct domestic parallel is yet in place.
Implications for Australian agencies
- Monitor Policy teams working on online safety, AI governance, or democratic integrity may want to monitor whether this research informs future updates to Australia's Online Safety Act or AI regulatory framework.
- Consider Agencies developing AI use policies that touch on public communications or content generation could consider whether AI writing tools used by staff introduce comparable directional biases in official messaging.
Implications are AI-generated. Starting points, not advice — see methodology for how they're framed.
View original source
Copied.
Appeared in:
Weekly digest, 6 July 2026
"AI-powered social media can subtly manipulate opinion at scale, new study finds"
Source: Oxford Internet Institute – News
Published: 6 July 2026
URL: https://www.oii.ox.ac.uk/ai-powered-social-media-can-subtly-manipulate-opinion-at-scale-new-study-finds/
Oxford Internet Institute researchers found that LLMs used to improve or contextualise social media posts consistently nudge content toward particular positions on contested topics, even when explicitly instructed not to. Network simulations using real X and Facebook data show these small shifts can accumulate to measurably alter collective opinion. The study also demonstrates that platform-level implementation choices — not just the underlying model — determine the direction and magnitude of bias, as illustrated by an audit of X's Grok-powered 'Explain this post' feature. The researchers argue this constitutes a new category of AI-mediated influence that existing regulatory regimes, including the EU AI Act and Digital Services Act, do not yet cover.
Implications for Australian agencies:
- [Monitor] Policy teams working on online safety, AI governance, or democratic integrity may want to monitor whether this research informs future updates to Australia's Online Safety Act or AI regulatory framework.
- [Consider] Agencies developing AI use policies that touch on public communications or content generation could consider whether AI writing tools used by staff introduce comparable directional biases in official messaging.
Retrieved from SIMS, 18 July 2026.