TL;DR
X has restricted access to Grok's image-generation and editing features to paid subscribers after reports that users were producing non-consensual and sexualised images, including of minors. UK ministers and regulators have raised legal and safety concerns, signalling possible regulatory or legal steps under the Online Safety Act.
What happened
X's Grok image-generation and editing capability has been moved behind a paywall, with the company saying the feature is now limited to paying subscribers. Previously, users could summon Grok by tagging the account and requesting images; that open access was used by some people to upload photos of clothed individuals and prompt the AI to remove clothing or produce sexualised poses. Reports indicate some targets were underage. The issue attracted attention from UK politicians and regulators: ministers described the emerging content as degrading and harmful, and lawmakers warned they might reconsider using or endorsing the platform. Regulators including Ofcom and the Information Commissioner's Office have raised questions about compliance with the Online Safety Act and potential data-protection breaches. X says it removes illegal material, suspends accounts and cooperates with law enforcement; the company declined to answer follow-up questions in the reporting seen by The Register.
Why it matters
- Non-consensual AI-altered images can cause significant harm to victims and may constitute illegal content under UK law.
- Platforms may face enforcement and fines under the Online Safety Act if they fail to curb harmful or unlawful material.
- Data-protection authorities are investigating potential breaches where images of real people were modified without consent.
- Restricting AI features to paid users is a mitigation step but may not satisfy regulators or address root moderation failures.
Key facts
- Grok's image generation and editing functions are now limited to paying subscribers on X.
- Previously, anyone could request images from Grok by tagging the account in posts.
- Users reportedly uploaded photos and instructed the AI to 'undress' or sexualise subjects; some targets were said to be underage.
- UK safeguarding minister called the use of the tool to create degrading, non-consensual intimate images unacceptable.
- The UK government intends to ban 'nudification' apps and plans to criminalise AI tools designed to generate child sexual abuse material, with penalties reported up to five years in prison.
- Prime Minister said the material was unacceptable and that 'all options are on the table' regarding the platform.
- Parliamentary committees have signalled they may reconsider their presence on the platform over the issue.
- Ofcom warned platforms that fail to tackle illegal or harmful content could face enforcement action under the Online Safety Act.
- The Information Commissioner's Office has contacted X and xAI to seek clarity on compliance with data-protection rules.
- X told reporters it removes illegal content, suspends accounts, and cooperates with law enforcement; it did not provide detailed responses to follow-up inquiries in the cited reporting.
What to watch next
- Whether Ofcom initiates formal enforcement or fines against X under the Online Safety Act.
- Findings and potential enforcement measures from the Information Commissioner's Office regarding alleged data-protection breaches.
- Any UK government decisions on banning or restricting platforms or specific AI image tools, and Parliament's stance on official use of X.
Quick glossary
- Grok: An AI assistant available on X that can generate and edit images based on user prompts.
- Nudification: The process or effect of using software to produce images that remove clothing or depict people as nude.
- Online Safety Act: UK legislation that sets duties for platforms to tackle illegal and harmful content and allows regulatory enforcement.
- Ofcom: The UK communications regulator responsible for enforcing rules about broadcasting, telecoms and some online content obligations.
- Information Commissioner's Office (ICO): The UK authority that oversees data protection and privacy law compliance.
Reader FAQ
Is Grok's image generation completely shut down?
No — the feature remains but is restricted to paying subscribers according to the reporting.
Were minors depicted in the AI-generated images?
The source reports that some of the targeted photos were underage, though detailed case data is not provided.
Will the UK ban X over this issue?
Not confirmed in the source; ministers said 'all options are on the table' and have floated bans or boycotts.
Is X cooperating with regulators and law enforcement?
X stated it removes illegal content, suspends accounts and cooperates with law enforcement; regulators have contacted the company for clarity.
AI + ML Grok told to cover up as UK weighs action over AI 'undressing' Image generation paywalled on X after ministers and regulators start asking awkward questions Carly Page…
Sources
- Grok told to cover up as UK weighs action over AI 'undressing'
- Ofcom asks X about reports its Grok AI makes sexualised …
- Grok AI still being used to digitally undress women and …
- Why Are Grok and X Still Available in App Stores?
Related posts
- Grok limits image-generation to paying users after sexualised AI imagery outcry
- No Fakes Act’s ‘fingerprinting’ clause risks crippling open-source projects
- Squarespace promo codes: 10% site discount, student 50% and AI tools