UK considers regulatory action against X over AI-generated sexualised content

UK Prime Minister Keir Starmer has warned that regulatory action, including the possibility of restricting access to X, could be considered if the platform fails to address concerns linked to its AI chatbot Grok. The comments follow reports that recent updates to Grok enabled the creation of non-consensual sexualised images, some involving children.

The issue has drawn the attention of Ofcom, the UK’s media regulator, which has launched an urgent investigation under the Online Safety Act. Ofcom has the authority to require platforms to take corrective action and, in extreme cases, to block access within the UK if companies do not comply with legal obligations related to illegal and harmful content.

The controversy was triggered by a Grok update that allowed users to digitally alter images of women and children, producing suggestive or sexualised outputs. The Internet Watch Foundation reported finding some of this content circulating on the dark web. In response, X restricted access to the feature to premium users, though critics have argued that safeguards remain insufficient.

Starmer described the content as unacceptable and called on X to act immediately. While a full ban has not been formally proposed, the Prime Minister has indicated that the government is prepared to use existing legal powers if necessary to ensure compliance with UK law.

Alongside domestic action, UK officials are engaging with international partners, including Australia, Canada, and European Union member states, to coordinate responses to AI-generated sexual abuse material. Australian Prime Minister Anthony Albanese has publicly condemned the content, while Canadian authorities are advancing legislation targeting deepfake abuse, although they have ruled out banning platforms at this stage. Discussions have also taken place with US officials, who have acknowledged the seriousness of the issue.

The prospect of stronger action has prompted sharp reactions from X’s owner, Elon Musk, who has criticised the UK government and framed the response as an attempt to restrict free expression. Some US lawmakers have warned of diplomatic consequences if the UK were to block access to the platform.

Within the UK, the issue has intensified political and public pressure. Several MPs and parliamentary committees have announced they are leaving X, citing concerns about content moderation and user safety. The debate reflects broader global tensions over how governments should regulate AI systems deployed by major online platforms, particularly where they intersect with child protection, consent, and freedom of expression.