California investigates xAI, Grok over sexualized AI images

California Attorney General Rob Bonta has initiated an investigation into xAI (Elon Musk’s company) and its artificial intelligence model, Grok, due to its production of sexually explicit and nonconsensual images of women and children.
The investigation focuses on the proliferation of deepfake nonconsensual intimate images, which are being used to harass women and girls across the internet.
Reports indicate that Grok can take normal photos from the internet and alter them to place individuals in suggestive or sexual scenarios without their consent.
Grok features a “spicy mode” specifically designed to generate explicit content, which has allegedly been used as a marketing tool leading to more dissemination of this content.
Bonta’s investigation cites findings that showed over half of the generated images in a specific timeframe depicted people in minimal clothing, including some appearing to be children.
The images are used to harass individuals online, prompting calls for xAI to immediately act against the production and distribution of such content.
California Gov. Gavin Newsom has publicly supported the investigation, deeming xAI’s actions vile and calling for accountability.
While there was a reduction in explicit images on the X platform, the problem continues on other Grok platforms, marking Bonta’s investigation as the first significant U.S.-based government action on the issue.

You may have missed