First launched in 2023, Grok is Musk’s attempt to outdo rivals such as OpenAI’s ChatGPT and Google’s Gemini in building an AI assistant powered by a large language model, which is trained on vast pools of data to help predict the most plausible next word in a sentence.

Arizona Attorney General Kris Mayes is investigating Grok after reports the AI tool created illegal sexual images, including content involving minors.

Grok will no longer be allowed to edit photos of real people to show them in sexualized or revealing clothing.

The move follows backlash from the government and an Ofcom investigation, after some were found to use the tool to generate sexualised images of people.

Grok faces mounting scrutiny from government officials and advocacy groups after people used the AI chatbot to create sexualized images of minors and women.

Against a backdrop of intense scrutiny over AI-generated nonconsensual images, the social media site and its AI chatbot had issues Friday morning.

Grok users can still make sexualized images within the app, just not via the @Grok account on X. I tested it out and learned how easy it is.

Ruben Chorlton Owen, 24, discovered explicit AI-generated images of himself created without consent as X's new rules still leave loopholes for men