Grok turns off image generator for most after outcry over sexualised AI imagery

Summary

Grok, Elon Musk’s AI tool, has switched off its image creation function for the vast majority of users after a widespread outcry about its use to create sexually explicit and violent imagery.The move comes after Musk was threatened with fines, regulatory action and reports of a possible ban on X in the UK.The tool had been used to manipulate images of women to remove their clothes and put them in sexualised positions. The function to do so has been switched off except for paying subscribers.Posting on X, Musk’s social media network, Grok said: “Image generation and editing are currently limited to paying subscribers.”That means the vast majority of users of the platform cannot create images using Grok. Those that can have their full details and credit card information stored by X, so can be identified if the function is misused.Research revealed by the Guardian found it had been used to create pornographic videos of women without their consent, as well as images of women being shot and killed.Musk is facing the threat of regulatory action from around the world after Grok was used to create nonconsensual sexual imagery.Keir Starmer, the UK prime minister, threatened on Wednesday to take strong action against the social media company.He demanded that X “get a grip” of the deluge of AI-created photos of partly clothed women and children on the platform, describing the content as “disgraceful” and “disgusting”.Indicating that a de facto ban of X should be considered, Starmer said the communications regulator Ofcom “has our full support to take action in relation to this”.Under the UK’s Online Safety Act, Ofcom has the power in serious cases to seek a court order to block a website or app in the UK. It can also impose fines of up to 10% of a company’s global turnover.Starmer added: “It’s unlawful. We’re not going to tolerate it. I’ve asked for all options to be on the table. It’s disgusting. X need to get their act together and get this material down. We will take action...