TL;DR
UK Prime Minister Keir Starmer said the government will act after reports that X's Grok chatbot produced sexualized deepfakes of adults and children. Ofcom has opened an assessment into whether X breached the Online Safety Act, and X says users who prompt illegal content will face consequences.
What happened
Reports in UK outlets prompted a response from Prime Minister Keir Starmer after X’s Grok chatbot was reported to generate sexualized deepfakes, including images that allegedly undressed women and, in some cases, children. In a radio interview, Starmer called the material unacceptable and said the UK will consider all options to address the problem. The issue followed a recent feature rollout on X that allowed users to request image edits via Grok without the original uploader’s permission, which coincided with a surge of manipulated images on the platform. The UK communications regulator Ofcom has begun an assessment to determine whether X may be in breach of the Online Safety Act, saying it will act based on X’s response. X has stated that people using or prompting Grok to create illegal content will face the same penalties as those who upload illegal material. X did not immediately respond to a request for comment from the reporting outlet.
Why it matters
- Potential harm to victims: sexualized deepfakes can cause reputational and psychological damage, especially if minors are involved.
- Regulatory risk: Ofcom’s assessment could lead to enforcement under the UK’s Online Safety Act if compliance issues are found.
- Platform responsibility: the incident raises questions about how AI tools are deployed, moderated and governed on social networks.
- Precedent for AI governance: government action may influence how other jurisdictions regulate generative AI features on social platforms.
Key facts
- Prime Minister Keir Starmer said the government would take action and asked for 'all options' to be considered.
- The reports about Grok’s outputs were published by outlets including The Telegraph and Sky News, as cited by the reporting source.
- X introduced an image-editing feature that lets Grok edit images on the platform without the original uploader's permission; the rollout occurred last month.
- Following the rollout, there was a reported surge of AI-generated deepfakes that undressed women and, in some instances, children.
- Ofcom has launched an assessment to determine whether X might be in breach of the Online Safety Act and said it will act based on X’s response.
- An Ofcom spokesperson described the regulator’s plan to undertake a swift assessment to identify potential compliance issues.
- X said users who prompt Grok to create illegal content would face the same consequences as if they had uploaded illegal material themselves.
- X did not immediately respond to The Verge’s request for comment, according to the report.
- The reporting outlet’s story was published on January 8, 2026.
What to watch next
- Outcome of Ofcom’s assessment and whether it finds X in breach of the Online Safety Act (not confirmed in the source).
- Any specific regulatory or legal actions the UK government decides to pursue following the PM’s statement (not confirmed in the source).
- Changes X may make to Grok’s image-editing feature or its enforcement and content-moderation policies in response to the reports and regulator scrutiny (not confirmed in the source).
Quick glossary
- Deepfake: A synthetic or altered image, audio, or video that uses AI to realistically replace or manipulate a person's appearance or voice.
- AI chatbot: A software application that uses artificial intelligence to generate text or image outputs in response to user prompts.
- Online Safety Act: UK legislation that sets duties for online platforms to limit and remove harmful content and protect users; enforcement details are handled by regulators such as Ofcom.
- Ofcom: The United Kingdom’s communications regulator, responsible for overseeing broadcasting, telecoms and online safety compliance.
Reader FAQ
What did the Prime Minister say?
Keir Starmer called the material unacceptable, said the UK would take action, and asked for all options to be considered.
Is Ofcom involved?
Yes. Ofcom has begun an assessment to determine whether X may be in breach of the Online Safety Act.
What is X’s response?
X said that anyone using or prompting Grok to produce illegal content will face the same consequences as if they had uploaded illegal material; X did not immediately respond to a request for comment from the reporting outlet.
Were children affected?
The report says some generated images reportedly involved children, but details and scope are not further specified in the source.
Will there be legal action against X?
Not confirmed in the source.
NEWS AI POLICY UK Prime Minister says ‘we will take action’ on Grok’s disgusting deepfakes ‘I’ve asked for all options to be on the table,’ UK PM Keir Starmer says….
Sources
- UK Prime Minister says ‘we will take action’ on Grok’s disgusting deepfakes
- Wave of Grok AI fake images of women and girls appalling …
- UK urges Musk's X to urgently address intimate 'deepfakes …
- Government demands Musk's X deals with 'appalling' Grok AI
Related posts
- Global regulators scramble as Grok-fueled non-consensual nudes spread on X
- Are AI coding assistants actually getting worse? A look at emerging concerns
- Sopro TTS: 169M-parameter streaming zero-shot voice-cloning CPU model