X Implements New Restrictions on Image Editing to Combat Non-Consensual Content
New Restrictions on Image Editing
On Thursday, the social media platform X announced that it has imposed restrictions on all users, preventing them from editing images of "real individuals in revealing clothing" through its AI chatbot, Grok.
This decision follows backlash against the tool for generating non-consensual sexually explicit images.
Previously, Grok enabled users to digitally alter photos of individuals, predominantly women, by undressing them and sexualizing their images without consent. Reports indicated that the tool was producing thousands of such images every hour.
As of January 9, Grok limited its image generation and editing capabilities to paying subscribers only.
In a statement released on Thursday, X clarified that the new restrictions now apply to all users, including those who pay for subscriptions.
This measure adds an extra layer of protection, ensuring that individuals who misuse the Grok account to breach laws or platform policies can be held accountable.
Additionally, X has begun to "geoblock" the ability for users to create images of real people in "bikini, underwear, and similar attire" using Grok.
This action comes in response to increasing regulatory scrutiny from various governments.
On Wednesday, California's Governor Gavin Newsom and Attorney General Rob Bonta sought clarification from X's owner, Elon Musk, regarding his claims of being unaware of any instances of Grok generating "naked underage images."
The UK government has also requested that media regulator Ofcom utilize its authority to potentially ban the platform due to the unlawful images produced by Grok.
On January 8, the European Union mandated X to retain all internal documents related to Grok until the end of the year to ensure compliance with digital regulations.
Earlier, on January 2, the Indian government instructed X to eliminate sexually explicit content generated by Grok.
The Union Ministry of Electronics and Information Technology urged the platform to conduct a thorough review of the chatbot's technical, procedural, and governance aspects to prevent the generation of nudity or sexually explicit material.
In a letter to X's chief compliance officer in India, the government highlighted that users were exploiting Grok to create fake accounts for generating and disseminating obscene images and videos of women with the intent to harm their reputation.
Publishing or hosting obscene and sexually explicit content, including through AI tools, violates bodily privacy and can lead to severe legal repercussions, the government stated.
On January 3, amid the criticism, Musk asserted that "anyone using Grok to create illegal content will face the same consequences as if they uploaded illegal content."