Technology

An AI Company Is Suing Its Own User for Making Fake Sexual Images

Martin HollowayPublished 3w ago4 min readBased on 8 sources
Reading level
An AI Company Is Suing Its Own User for Making Fake Sexual Images

xAI, the company behind the AI tool Grok, has filed a lawsuit against Terry Wayne Harwood, a 67-year-old South Carolina man, in Texas. The company says Harwood used Grok to create fake sexual images of adults and children without their consent. Reuters broke the story on July 15, 2026, and Engadget confirmed the filing details the following day.

Grok is an AI tool that can generate and edit images based on written instructions called prompts. A deepfake is a fake image or video made by AI that shows a real person doing something they never actually did.

According to the complaint, Harwood operated two xAI accounts between December 8, 2025 and February 18, 2026. He uploaded ordinary, non-sexual photos of adults and minors and asked Grok to turn them into sexualized images and videos. xAI says that Grok refused Harwood's requests many times, but he kept changing the wording of his prompts to get past the tool's safety rules. One example from the filing: Harwood uploaded a photo of a fully dressed girl, about 10 to 11 years old, and asked Grok to remove her clothing and create an image of her doing a "Playboy model impression" as she lay in bed.

The South Carolina Attorney General's office arrested Harwood on March 9, 2026, as part of the Internet Crimes Against Children Task Force. He was charged with three counts of second-degree sexual exploitation of a minor and five counts of third-degree sexual exploitation of a minor. Authorities found that Harwood had shared child sexual abuse materials, not just possessed them. xAI is seeking an unspecified amount of money in damages from the civil suit.

Reuters reported that the case is one of the first brought by an AI company against one of its own users. That matters because xAI is not just defending itself against complaints from outside. The company is actively saying that a user broke its rules and caused harm, and it wants to be compensated for that harm.

The lawsuit comes amid a wave of legal and regulatory pressure on xAI over Grok's ability to create images. Reports that Grok let users turn photos of real women and children into sexualized images began appearing in early January 2026. California authorities launched an investigation into Grok over AI-generated child sexual abuse materials and nonconsensual deepfakes in mid-January. UK regulator Ofcom opened a formal investigation into X over the scandal involving Grok. The European Commission opened its own investigation into Grok and X over potentially illegal deepfakes. Ireland's Data Protection Commission also opened an investigation into Grok's nonconsensual image generation.

xAI added safety measures to prevent nonconsensual sexual deepfakes when the investigations began, announcing the changes via the @Safety account on X. Users were still able to use Grok to generate undressing images of men afterward, suggesting the safety measures were incomplete.

The legal trouble extends well beyond this one suit. The city of Baltimore sued xAI on March 24, 2026, claiming Grok illegally creates nonconsensual sexually explicit images (Reuters). British lawmaker Jess Asato sued xAI for invasion of privacy in June, saying Grok was used to create sexualized fake images of her without consent (AP News). A class action lawsuit filed against xAI and Stability AI claims their AI tools were used to generate child sexual abuse material; the suit expanded in early July, with new plaintiffs joining around July 9 (NPR, CyberScoop).

The spread of that response — four regions across three continents, multiple civil suits, a class action, and now a suit by the company itself against a user — shows how hard it is to control AI image manipulation once a tool is released with broad image-editing access. xAI's Series C funding round raised $6 billion from investors including A16z, Blackrock, Fidelity, Sequoia Capital, Lightspeed, Morgan Stanley, and Valor Equity Partners, among others (xAI).

In my view, suing a user is a notably different strategy from the purely defensive approach most AI companies have taken when their tools produce harmful output. xAI is arguing that the misuse started with the individual, not the tool, while also seeking money from him in court. Whether that argument holds up in a Texas courtroom, and whether it shifts any of the regulatory or legal responsibility away from the company, is the question that will draw attention from every AI company facing similar scrutiny. The pattern described in the filing, where a user keeps rewording prompts until the AI finally complies, is well-documented across the industry. What is new is a company treating that pattern as grounds for a lawsuit rather than solely a product-safety problem to fix in the next software update.