Technology

Meta Ran Dozens of Ads Containing AI-Generated CSAM Across Its Platforms

Martin HollowayPublished 3d ago4 min readBased on 2 sources
Reading level
Meta Ran Dozens of Ads Containing AI-Generated CSAM Across Its Platforms
Photo by InvadingInvader / CC BY-SA 4.0

Meta hosted and displayed dozens of paid advertisements containing AI-generated child sexual abuse material (CSAM) across Facebook, Threads, Messenger, and Instagram, with the ads reaching thousands of accounts, according to a report from Wired and corroborated by Engadget.

The ads were discovered by researchers with the Tech Transparency Project (TTP), who found them in Meta's ad library. All of the ads TTP identified were posted between November 2025 and August 2026. More than 50 of the ads passed through Meta's ad review process, which relies on automated tools, before going live.

TTP Director Katie Paul stated that the ads made no effort to mask the images or hide what they were promoting, and that they were reviewed, approved, and allowed to run by Meta. Several of the ads linked out to "nudify" or undressing apps — tools that use AI to generate non-consensual sexualized imagery of real people, often women and girls.

Meta's own advertising standards explicitly forbid ads that "contain content that sexually exploits or endangers children" and ban sexually explicit adult content from its ad system entirely. The gap between that written policy and what the automated review pipeline actually permitted through is the core of this story.

In a statement to Wired, Meta said it works aggressively to keep sexual exploitation off its platform, that most of the ads had minimal reach, and that many were disabled before Wired shared its findings with the company. Meta also noted that it removed over 36 million pieces of child sexual exploitation content last year. The company did not, per the reporting, dispute that the ads had been approved and served.

This is not an isolated incident. The BBC reported in July that Instagram ran ads advertising child sexual abuse material in India. In April 2026, the Consumer Federation of America sued Meta for failing to deal with scam ads on its platforms. Taken together, these events point to a pattern in which Meta's automated ad review infrastructure has repeatedly failed to catch content that violates both its own policies and criminal law.

The structural problem is straightforward to describe and difficult to solve. Meta's ad system processes enormous volume, and its review pipeline leans heavily on automated classification. AI-generated CSAM presents a specific challenge that pre-dates generative AI tools but has been dramatically compounded by them: the content is synthetic, meaning it does not match known hashes of real CSAM in databases like those maintained by the National Center for Missing and Exploited Children. Hash-based detection, the backbone of platform-level CSAM moderation for years, is largely blind to novel AI-generated imagery. That leaves content moderation dependent on machine learning classifiers trained to recognize the visual and contextual signals of child sexual exploitation — classifiers that, on the evidence here, failed to flag material that Paul says was not even disguised.

Worth flagging: the commercial dimension of this failure matters as much as the safety dimension. These were paid placements. Meta's ad infrastructure not only hosted the content but actively distributed it to targeted users in exchange for advertising revenue. An ad review system that approves CSAM-linked creative is not merely a moderation failure; it is a monetization pipeline that financially benefited from the distribution of illegal material. The advertisers paid Meta, and Meta served the ads.

The connection to "nudify" apps deepens the concern. These tools, which strip clothing from images using generative models, have proliferated rapidly and are frequently marketed through social media ad networks. That several of the CSAM ads TTP found linked directly to such apps suggests the ads were not incidental content violations but deliberate customer-acquisition funnels for tools designed to produce non-consensual sexual imagery.

Meta's scale makes this hard, but its resources make the failure hard to excuse. The company reported removing 36 million pieces of child sexual exploitation content in a year — a number that indicates both significant enforcement effort and the sheer volume of material it must contend with. The question TTP's findings raise is whether Meta's automated review can be made reliable enough to stop CSAM at the ad-approval stage, or whether the volume and adversarial nature of the content make that a fundamentally unattainable bar for fully automated systems.

The regulatory landscape is moving, though perhaps not fast enough for critics. The Consumer Federation of America lawsuit in April signals growing legal pressure on Meta's ad practices, though that suit addresses scam ads rather than CSAM specifically. Whether the TTP findings accelerate regulatory or legislative action on AI-generated sexual exploitation content remains an open question.

For engineers and trust-and-safety professionals, the takeaway is concrete. Hash-based CSAM detection does not cover AI-generated material. Automated classifiers failed here on content that was, per the researcher's account, unambiguous and unmasked. The ad review pipeline approved and monetized that content. Each of those failure points is a separate technical and operational problem, and each will need a different solution.