After a surge of obscene deepfakes sparked outrage, X has tightened controls on its AI chatbot Grok, blocking image generation of real people in revealing attire in some regions. The move follows government pressure and raises questions on AI accountability.
X restricts Grok image generation after backlash
New Delhi: Microblogging platform X has introduced new technological restrictions on its AI chatbot Grok to prevent the generation of images of real people in revealing clothing in jurisdictions where such content is illegal. The move follows widespread backlash over the circulation of obscene deepfake images allegedly created using Grok.
In a post shared on its official Safety handle, X said the restriction applies to all users, including paid subscribers. The platform stated that it has geoblocked the ability to generate images of real people in bikinis, underwear, or similar attire in regions where such content violates local laws.
Elon Musk Warns: Misuse of Grok will lead to permanent X ban; Click for details
“We now geoblock the ability of all users to generate images of real people in bikinis, underwear, and similar attire via the Grok account and in Grok in X in those jurisdictions where it’s illegal,” the company said.
X also announced that image generation and image-editing features through Grok on X will now be available only to paid subscribers. According to the platform, this step adds an additional layer of accountability by ensuring that users who attempt to misuse the AI can be identified and acted against.
Grok Under Scrutiny: X restricts image generation after backlash over obscene deepfakes#grok #grokai #deepfake pic.twitter.com/fLYyxFzgPS
— Dynamite News (@DynamiteNews_) January 15, 2026
The company confirmed that technological safeguards have also been implemented to prevent the editing of images of real people in revealing clothing, reiterating that these rules apply regardless of a user’s subscription status.
X emphasized that the changes do not alter its existing safety policies. All AI prompts and AI-generated content must comply with the platform’s rules. The company reiterated its zero-tolerance policy toward child sexual exploitation, non-consensual nudity, and unwanted sexual content.
It added that high-priority violative content, including Child Sexual Abuse Material (CSAM), is removed promptly, and accounts involved are suspended or terminated. Where required, such cases are also reported to law enforcement authorities.
The move comes after India’s IT Ministry raised concerns over obscene content linked to Grok. X admitted its lapse and said it had removed around 3,500 pieces of content and deleted over 600 accounts, assuring the government of compliance with Indian laws.
Elon Musk says X premium subscribers to get early access to chatbot Grok
On January 2, the ministry directed X to immediately remove all vulgar and unlawful Grok-generated content or face legal action. It also sought a detailed Action Taken Report (ATR) outlining technical safeguards, compliance mechanisms, and actions against offending users.
The government warned that failure to comply with the IT Act and IT Rules, 2021 could lead to the loss of safe harbour protection under Section 79, exposing X to legal liability.
Beyond India, regulators in the UK and the European Union have also intensified scrutiny of Grok, as global pressure mounts on generative AI platforms over deepfakes, data safety, and content moderation failures.
