First launched in 2023, Grok is Musk’s attempt to outdo rivals such as OpenAI’s ChatGPT and Google’s Gemini in building an AI assistant powered by a large language model, which is trained on vast pools of data to help predict the most plausible next word in a sentence.

Arizona Attorney General Kris Mayes is investigating Grok after reports the AI tool created illegal sexual images, including content involving minors.

Grok will no longer be allowed to edit photos of real people to show them in sexualized or revealing clothing.

The move follows backlash from the government and an Ofcom investigation, after some were found to use the tool to generate sexualised images of people.

Against a backdrop of intense scrutiny over AI-generated nonconsensual images, the social media site and its AI chatbot had issues Friday morning.

Elon Musk's Grok chatbot is testing Europe's ability to clamp down on deepfakes and digital undressing of images online, even after regulators scored a rare win by forcing Musk's xAI to curb the creation of sexualized images.

Grok users can still make sexualized images within the app, just not via the @Grok account on X. I tested it out and learned how easy it is.

Ruben Chorlton Owen, 24, discovered explicit AI-generated images of himself created without consent as X's new rules still leave loopholes for men