Technology

San Francisco City Attorney Demands Apple and Google Remove AI 'Nudify' Apps From Their Stores

Martin HollowayPublished 2w ago4 min readBased on 2 sources
Reading level
San Francisco City Attorney Demands Apple and Google Remove AI 'Nudify' Apps From Their Stores

San Francisco City Attorney David Chiu has sent cease-and-desist letters to Apple and Google demanding the removal of 13 AI-powered "nudify" applications from the Apple App Store and Google Play Store. The letters, reported on July 17, 2026, accuse the two companies of "aiding and abetting" the spread of nonconsensual intimate images and demand they sever working relationships with the developers in question. (Engadget)

The demand escalates a legal campaign Chiu launched earlier. He previously filed a lawsuit against 16 websites that enable users to transform images of real women and girls into AI-generated pornography. The current letters extend the same logic to the platform layer: that the app stores themselves bear responsibility for distributing the tools.

The financial dimension is not incidental. Chiu told Wired that Apple and Google have "likely made millions" from in-app payments tied to the offending apps. The figure, while not independently verified, frames the demand as more than a content-moderation issue. It puts platform revenue squarely in the enforcement conversation.

A report from the Tech Transparency Project lends weight to the legal pressure. TTP found that nudification apps frequently bypassed moderation at both Apple and Google, and that some were actively promoted within the App Store and Google Play. The report also documented that many of these apps carried an "E" for Everyone rating, which made them downloadable by children. The combination of discovery promotion and permissive age gating is, on its face, hard to reconcile with either company's stated trust-and-safety policies.

Google has responded, at least partially. A company spokesperson told Wired that Google had already deleted hundreds of apps with nudification features, five of which were among those Chiu flagged. Apple did not provide a comment to Wired ahead of publication.

The broader context here is that platform liability for AI-generated nonconsensual intimate imagery is still being defined jurisdiction by jurisdiction. What Chiu is doing with these letters is testing whether app store operators can be treated as participants in the distribution chain rather than neutral intermediaries. The "aiding and abetting" framing is deliberate: it borrows from criminal law concepts of complicity, and if it gains traction, it could reshape how Apple and Google approach not just moderation but developer onboarding and revenue sharing for entire categories of apps.

The financial angle matters because it cuts through the standard platform defense. When app store operators take a percentage of in-app purchase revenue, they are not merely hosting content passively. They are commercial participants. Chiu's mention of millions in revenue is pointed. It establishes that the platform had a direct financial stake in the continued availability of the apps, which is the kind of fact pattern that complicates Safe Harbor arguments and invites scrutiny under consumer protection and anti-trafficking statutes.

The TTP findings about "E" ratings add a distinct layer. Age gating exists to keep minors away from content and tools that are inappropriate or harmful. When an app designed to produce nonconsensual sexual imagery is rated for everyone, the gating system has not merely failed to catch an edge case. It has fundamentally mischaracterized the product. For the tech-literate reader, this raises a straightforward engineering and policy question: what in the review pipeline allowed these apps through, and was the failure automated, human, or structural?

Google's disclosure that it removed hundreds of such apps is notable for what it reveals about scale. If hundreds of nudification apps existed on Google Play, the problem is not a handful of bad actors exploiting a gap. It is a category of software being developed, submitted, approved, monetized, and distributed at volume. Apple's silence, by contrast, leaves open whether the company has conducted a comparable internal sweep or whether it is still assessing its exposure.

Worth flagging: no press release about the cease-and-desist letters was visible on the San Francisco City Attorney's news landing page as of the browse date of July 2, 2026. The page's most recent release at that time concerned Public Service Loan Forgiveness. This means the letters were either sent after July 2 or were issued without a corresponding public-facing announcement. The gap does not diminish the legal weight of the demand, but it does mean the public record on the City Attorney's own site had not yet caught up to the reporting.

Looking at what this means for the platforms: the pressure on Apple and Google will not resolve with the removal of 13 apps. The precedent Chiu is attempting to set, that app store operators bear legal and financial accountability for the apps they distribute and profit from, is the kind of argument that, if it survives a courtroom test, could reshape platform governance more broadly. The nudify app category is an extreme case, which makes it a useful vehicle for testing the principle. But the principle itself, once established, would not be limited to extreme cases.

For now, the letters are demands, not injunctions. Whether Apple and Google comply fully, partially, or contest the legal framing will determine whether this becomes a turning point in platform accountability for AI-generated harm or another enforcement action that dissolves into negotiated removals and quietly updated policies.