Elon Musk’s artificial intelligence chatbot, Grok, has come under scrutiny on the social media platform X following concerns over its alleged misuse to generate pornographic content.
Several users are reported to have exploited Grok’s features to manipulate images without consent. Sexually explicit images have circulated online, with claims that they were created using personal photos of individuals without permission.
On X, users have tagged Grok in posts containing images of women, accompanied by explicit instructions such as “put her in a bikini” or “take her clothes off”.
In response, Indonesia’s Ministry of Communication and Digital (Kemkomdigi) has taken formal action against platform X over the alleged misuse of Grok’s artificial intelligence features.
According to Kompas, the ministry is currently following up on reports of improper use of the technology.
Ministry Finds Gaps in Content Safeguards
The Director General of Digital Space Supervision at Kemkomdigi, Alexander Sabar, said early findings suggest that Grok AI does not yet have specific safeguards to prevent the creation and distribution of pornographic content.
“Initial findings indicate that there are no specific regulations within Grok AI to prevent the use of this technology in the creation and distribution of pornographic content based on personal photos,” Sabar said in a written statement issued in Jakarta on Wednesday, January 7, 2026.
“This risks serious violations of citizens’ privacy and self-image rights,” he added.
Sabar said his office is coordinating with Electronic System Operators to ensure that adequate protection mechanisms are implemented to prevent further misuse.
Police Warn of Potential Criminal Charges
Indonesia’s National Police has also responded to reports of image manipulation involving Grok AI on X.
The Director of Cyber Crime at the Criminal Investigation Agency (Bareskrim Polri), Brigadier General Himawan Bayu Aji, said the manipulation of photos into explicit content may constitute a criminal offence under deepfake-related violations.
“So, technological developments are now moving towards artificial intelligence, including deepfakes that use AI,” Himawan said, as quoted by DetikInet.
Lihat postingan ini di Instagram
Other Countries Threaten to Block Grok AI
A number of countries are highlighting the artificial intelligence (AI) chatbot Grok integrated into Elon Musk’s platform X, following findings that it was creating obscene content and sexual deepfakes. India, France, and Malaysia have all stated they have taken steps or launched investigations into the content generated by the AI system.
The Indian government ordered platform X to immediately implement technical and procedural improvements to Grok after users and lawmakers highlighted the prevalence of AI-manipulated images, including sexualized images of women and content involving minors.
In France, the Paris prosecutor’s office stated it would investigate the prevalence of sexually explicit deepfakes on X.
Meanwhile, the Malaysian Communications and Multimedia Commission stated it has taken public complaints regarding the misuse of AI tools on platform X, particularly the digital manipulation of images of women and minors, resulting in indecent and harmful content.
