The Centre pulled up X and directed it to immediately remove all vulgar, obscene and unlawful content, especially generated by Grok (X’s built-in artificial intelligence interface) or face action under the law.
The government has given social media platform X until January 7 to submit a detailed report explaining the steps it has taken to curb obscene and sexually explicit content generated through misuse of artificial intelligence tools, including its AI interface Grok.
The extension was granted after X sought additional time following a stern warning from the Ministry of Electronics and Information Technology, which accused the platform of failing to prevent the spread of vulgar and unlawful content, particularly material targeting women and children, sources told PTI.
The ministry had earlier directed X to remove such content immediately and submit an Action Taken Report within 72 hours.
Government sources said the deadline has now been extended by a day, with authorities stressing that compliance with Indian law is mandatory.
What is the case all about?
The case centres on allegations that users have been misusing Grok and other AI tools on X to create and circulate obscene images and videos, including through fake accounts. The ministry said the misuse involves prompts, image manipulation and synthetic outputs, often targeting women in a derogatory manner.
The Centre on Friday pulled up X and directed it to immediately remove all vulgar, obscene and unlawful content, especially generated by Grok (X’s built-in artificial intelligence interface) or face action under the law. The ministry had also asked the US-based social media firm to submit a detailed action taken report (ATR) within 72 hours of the directive (effectively by January 5).
“Importantly, this is not limited to creation of fake accounts but also targets women who host or publish their images or videos, through prompts, image manipulation and synthetic outputs,” the ministry said in its January 2 notice.
The government warned that such content violates provisions of the Information Technology Act and related rules governing obscene, indecent, pornographic and paedophilic material. It said these acts undermine the dignity, privacy and safety of women and children, while also weakening safeguards meant to regulate online platforms.
“The aforesaid acts and omissions are viewed with grave concern, as they have the effect of violating the dignity, privacy and safety of women and children, normalising sexual harassment and exploitation in digital spaces,” the ministry said.
Officials also made it clear that legal protections granted to online intermediaries are conditional. The ministry said compliance with due diligence obligations under the IT Act and rules is essential, warning that failure to comply could result in loss of liability exemptions and further legal action under Indian law.
“Compliance with the IT Act and rules is not optional,” the notice said, cautioning that platforms could face consequences under multiple laws, including the Bharatiya Nyaya Sanhita.
X has said it will act against illegal content on its platform. In a post from its Safety handle on Sunday, the company said it would remove unlawful material, permanently suspend accounts involved, and cooperate with law enforcement. “Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content,” it said.
The government has asked X to outline technical and organisational steps taken to prevent misuse of Grok, actions against offending accounts, oversight by its compliance officer, and systems to ensure mandatory reporting under Indian law.
