The online network X has sparked widespread anger after individuals used its AI chatbot Grok to alter pictures of women by stripping their clothing.
Multiple examples have been seen where the technology has been used to digitally undress female subjects to render them in swimwear without consent, as well as to insert them in inappropriate situations.
Company Reaction and Legal Stance
XAI, the firm responsible for Grok, offered no comment to requests for comment, except for an standard response stating "legacy media lies".
A government spokesperson stated that new laws is being introduced to ban nudification tools. Under a new criminal offence, anyone who distributed such technology would "face a prison sentence and substantial penalties".
"X or Grok has the ability to stop these types of abuse if they desired to," said Clare McGlynn, adding they "appear to enjoy impunity."
Oversight Body Stance and Platform Functionality
The communications watchdog Ofcom said technology companies must "assess the potential" of people viewing unlawful material on their services, but did not specify whether it was presently investigating X or Grok in regarding AI-generated pictures.
Grok is a free chatbot—with some paid-for functions—which responds to X users' requests when they mention it in a post.
It is often used to give reactions or further background to other posters' comments, but people on X are also able to modify an uploaded picture through its AI image editing tool.
Background of Criticism and Rules
The tool has been faulted for permitting users to create images and clips with nudity and sexually suggestive content, and it was previously alleged to have been involved in making graphic material of public figures.
"The platform has been enabling the production and spread of these images for months without taking any action and we have not seen any challenge by oversight bodies," the expert added.
XAI's own acceptable use policy prohibits "portraying images of individuals in a sexually explicit way".
In a comment, Ofcom said it was illegal to "make or share non-consensual intimate images or illegal content" and clarified this covered explicit AI images created with AI.
It said networks such as X were required to take "necessary measures" to "lessen the danger" of users coming across illegal material on their platforms and to remove it quickly when they become aware of it.
