Indian Government Orders Action Against AI-Generated Explicit Content on Social Media

The Indian government has taken a firm stance against the misuse of AI-generated explicit content on social media, directing platform X to remove such material. The Ministry of Electronics and Information Technology has mandated a comprehensive review of the Grok chatbot to prevent the generation of inappropriate content. Failure to comply could lead to legal repercussions for the platform's officials. This move comes in response to concerns over the exploitation of AI tools to create fake accounts and share obscene images of women, raising significant privacy and ethical issues. The government has requested a detailed report on actions taken to address these concerns, highlighting the urgency of the matter.

By Narendra Chaudhary Jan 2, 2026, 21:06 IST

Government Directive to Social Media Platform

On Friday, the Indian government issued a directive to the social media platform X, instructing it to identify and eliminate sexually explicit content produced by its AI chatbot, Grok.

The Ministry of Electronics and Information Technology emphasized the need for X to conduct a thorough review at technical, procedural, and governance levels to prevent Grok from generating any content featuring nudity or sexual material.

The government cautioned that failure to comply with this directive could result in legal action against the platform's officials under various laws, including the Information Technology Act.

In a letter addressed to X's chief compliance officer in India, the government highlighted that users were exploiting Grok to create fake accounts for the purpose of generating and disseminating obscene images and videos of women, aiming to tarnish their reputations.

“This issue extends beyond the creation of fake accounts; it also targets women who share their own images or videos, utilizing prompts, image manipulation, and synthetic outputs,” the ministry stated.

The government asserted that hosting or sharing obscene and sexually explicit content, especially through AI tools, violates personal privacy and could lead to severe legal repercussions.

Additionally, the government mandated X to provide a report within 72 hours detailing the actions taken to manage the Grok application, the oversight by the chief compliance officer, responses to inappropriate content, and compliance with reporting requirements.

Earlier, Shiv Sena (Uddhav Balasaheb Thackeray) MP Priyanka Chaturvedi reached out to Union Minister Ashwini Vaishnaw, urging him to address the issue with X.

Chaturvedi condemned the use of AI to generate such images, labeling it a significant misuse of technology.

“This constitutes a violation of women's privacy rights and unauthorized use of their images, which is not only unethical but also criminal,” she stated in her correspondence with Vaishnaw.