X Limits AI Image Generation Feature Amid Controversy Over Non-Consensual Content
Introduction to the Controversy
On Friday, the social media platform X announced restrictions on its AI application Grok's image-generation capabilities, now available only to subscribers. This decision follows backlash over Grok's ability to create non-consensual sexually explicit images.
Concerns Over Non-Consensual Image Creation
Grok previously enabled users to digitally alter images of real individuals, predominantly women, by undressing and sexualizing them without consent. Reports indicated that the tool was generating thousands of such images hourly.
As of Friday, Grok's account on X began notifying users that the image generation feature is now restricted to paying subscribers, a shift from its previous free access for all users. This change implies that users' identities and payment details will be recorded.
Continued Access Through Standalone App
Despite the new limitations on X, the standalone Grok application reportedly still allows users to create such images without a subscription.
Government Actions and Regulatory Responses
The UK government has urged its regulator, Ofcom, to take action against X, including a potential ban, due to the unlawful images produced by Grok. Concurrently, the European Union has mandated X to retain all internal documents related to Grok until the end of the year to ensure adherence to digital regulations.
On January 2, the Indian government instructed X to eliminate sexually explicit content generated by Grok, emphasizing the need for a thorough review of the chatbot's operations to prevent the creation of inappropriate material.
Government's Stance on Obscene Content
The Union Ministry of Electronics and Information Technology expressed concerns about users exploiting Grok to create fake accounts for sharing obscene images and videos of women, which is a violation of privacy laws and could lead to severe penalties.
Elon Musk's Response
In light of the criticism, Elon Musk stated on January 3 that individuals using Grok to produce illegal content would face consequences similar to those who upload illegal material directly.