Government Issues Warning to AI Tool Over Misuse for Obscene Content

Government's Notice to AI Tool

The central government has issued a stern notice to the AI tool, XAI, expressing concerns that its Grok tool is being utilized to create and disseminate obscene content targeting women. The Ministry of Electronics and IT has demanded an action report from XAI within 72 hours. Union Minister Ashwini Vaishnaw also raised alarms on Friday regarding the misuse of AI tools.

During an event related to ECMS in Delhi, Vaishnaw emphasized the need for strict intervention to protect women's dignity in light of the misuse of artificial intelligence tools on social media platforms like X.

Concerns Over Offensive Content

Vaishnaw's remarks came while addressing concerns about inappropriate and sexualized content related to women being generated through chatbots on the XAI platform. He stated that social media platforms must take responsibility for the posts shared on their networks. Furthermore, he mentioned that the standing committee has recommended stringent legal measures to hold social media accountable for their content.

Potential Loss of Safe Harbor for X

The notice warns that failure to comply could result in X losing its safe harbor protection under Section 79 of the Information Technology Act. The ministry highlighted the possibility of legal action under various laws, including the Indian Penal Code, the Indecent Representation of Women Act, and the Protection of Children from Sexual Offences Act. This information has been shared with multiple ministries, commissions, and state authorities, indicating a coordinated effort to curb obscenity generated by artificial intelligence.