At least 37 attorneys general for US states and territories are taking action against xAI after people used its chatbot, Grok, to generate a flood of sexualized images earlier this year.
On Friday, a bipartisan group of 35 attorneys general published an open letter to xAI demanding it “immediately take all available additional steps to protect the public and users of your platforms, especially the women and girls who are the overwhelming target of [non-consensual intimate images].” (In addition to those who signed the letter, attorneys general from California and Florida tell … they have also taken action.)
The letter comes amid an international wave of regulator attention on Grok users creating intimate deepfake images of people without their consent, as well as sexualized images of children.
A recent report from the Center for Countering Digital Hate estimates that during an 11-day period starting on December 29, Grok’s account on X generated around 3 million photorealistic sexualized images, including around 23,000 sexualized images of children. In addition to using Grok’s X account to create these photos, people were generating far more explicit videos using the Grok Imagine model available on the Grok website, … previously reported. And unlike X, the Grok site did not appear to require any sort of age verification before allowing people to view content.
X did not respond to a request for comment. xAI responded to …’s questions with, “Legacy Media Lies.”
The open letter from attorneys general, which cited …’s reporting, said that Grok’s ability to create nonconsensual sexual imagery has been used as a “selling point” by xAI.
While xAI claims it has stopped Grok’s X account from undressing people, the letter stated that the company hasn’t removed nonconsensually created content, “despite the fact that you will soon be obligated to do so by federal law.” It also calls on xAI to remove Grok’s ability to depict people in revealing clothing or suggestive poses, suspend offending users and report them to authorities, and give users the ability to control whether their content can be edited by Grok.
“In addition to investigations and prosecutions in this area, we have called on payment processors and search engines to mitigate the creation of nonconsensual intimate images and advocated for legislation to prevent AI-powered child exploitation,” the letter says.
The inundation of nonconsensual intimate deepfakes on X and Grok.com comes at a time when half the country has already passed age verification laws, requiring people looking at pornography to provide proof that they are not a minor.
… contacted the offices of attorneys general in the 25 states that have passed age verification laws to ask how they were responding to the influx of nonconsensual sexualized images on Grok and X. … also reached out to the sponsors of the age verification bills in each of those states to ask if they felt X or xAI should be doing more to prevent children from viewing explicit content on X and Grok.com.
Some of the AGs that … reached out to say they were investigating or in discussions with either X or xAI specifically about concerns that Grok was being used to generate child sexual abuse material, or CSAM. According to the child advocacy group Enough Abuse, 45 states prohibit AI-generated or computer-edited CSAM.
Richie Taylor, communications director for Arizona attorney general Kris Mayes, tells … that Mayes opened an investigation into Grok on January 15. In a news release about the investigation, which cited …’s reporting, Mayes said the reports about the imagery being created are “deeply disturbing.” Mayes was one of the signatories on Friday’s joint letter.
S 001