Technology

AI-Powered Malware Is Getting Smarter — And Now Targets AI Systems Too

Martin HollowayPublished 4d ago7 min readBased on 4 sources
Reading level
AI-Powered Malware Is Getting Smarter — And Now Targets AI Systems Too

AI-Powered Malware Is Getting Smarter — And Now Targets AI Systems Too

Security researchers are tracking a new generation of malware that operates on two fronts: worms that use machine learning to outmaneuver traditional network defenses, and attacks that specifically target generative AI systems themselves. The emergence signals a turning point in the long battle between attackers and defenders.

When Malware Learns to Adapt

Conventional malware has historically followed fixed playbooks. It finds a vulnerability, exploits it, and spreads to the next target in much the same way. AI-enhanced worms work differently.

These threats use machine learning to observe how security systems respond to them, then modify their behavior to avoid detection. Instead of relying on a preset list of tricks, they analyze what worked and what didn't, adapting in real time. According to Palo Alto Networks research, this adaptive capacity makes traditional signature-based detection—where antivirus software looks for known malware patterns—increasingly ineffective.

A real-world example is NoaBot, a worm discovered by Akamai researchers in January 2024 after operating silently on Linux servers for months. Built on the foundation of Mirai, an older botnet framework, NoaBot installs cryptomining software on infected machines while taking special care to hide how it operates. The worm's real sophistication, though, lies in how it reacts to defensive measures rather than simply in what payload it delivers.

The New Attack Surface: AI Itself

Beyond targeting traditional networks, researchers have identified an entirely new vulnerability: generative AI systems can spread malware to one another.

Security researchers created a proof-of-concept worm in a laboratory environment that moves automatically between AI agents—essentially software programs that chat with users and perform tasks. The experimental worm exploited email assistant features to steal data from messages and send spam. It also exposed weaknesses in both ChatGPT and Gemini, suggesting the vulnerability isn't limited to one company's AI system.

IBM researchers have independently developed similar AI worms in controlled settings, signaling that multiple security teams are investigating these attack methods at the same time.

The good news is critical: these AI worms exist only in laboratory tests. They have not appeared in real business networks or consumer systems. That window gives organizations time to build defenses before attackers put these techniques into practice.

How AI Worms Actually Work

The attack hinges on a technique called prompt injection. Think of it like this: if you've ever watched someone slip a forged instruction into a stack of legitimate memos to trick a manager into approving something, prompt injection is the AI equivalent. An attacker embeds hidden instructions inside what looks like a normal user message. When the AI reads and processes that message, it unknowingly carries out the malicious command—and can pass it along to other AI systems it's connected to.

Generative AI systems are particularly vulnerable to this because they're designed to read natural language (regular human writing) and respond helpfully to almost any input. The more flexible and conversational an AI system is, the easier it becomes to trick with a well-crafted prompt.

The risk is especially acute in corporate environments, where AI tools increasingly handle email processing, document reviews, and customer service. Each connection between an AI system and another service—or another AI—becomes a potential pathway for attack.

The broader context here is worth noting. We have seen a similar pattern emerge with every major shift in computing technology. Personal computers brought computer viruses, networks enabled worms that spread across them, and mobile devices created a whole new class of mobile-specific malware. Each platform that becomes widespread eventually attracts sophisticated attacks tailored to how it works. AI systems, as they become more central to business operations, are no different.

What makes AI vulnerabilities conceptually distinct is that they exploit the core strength of these systems—their ability to understand and respond to human language—rather than technical flaws in code or configuration. Traditional malware might exploit a programming mistake or a password left unsecured. AI worms exploit something more fundamental: the nature of language itself.

What Organizations Can Do Right Now

For networks facing AI-powered traditional worms, behavioral analysis tools offer better protection than older signature-based antivirus software. These tools watch for patterns of suspicious activity—how a worm adapts and moves—rather than trying to recognize it by its fingerprint.

Against AI-targeted attacks, the strategy centers on controlling what information the AI can access and what it can do. Organizations should limit how AI systems talk to each other, isolate them from the broader network where possible, and carefully filter both what goes into these systems and what comes out.

Model providers like OpenAI and Google are building better defenses against prompt injection, and they continue to improve output filtering. But the underlying tension—between making AI systems useful and usable versus locking them down completely—will likely persist. This is similar to the decades-long struggle with social engineering attacks, where human nature remains the hardest thing to secure against.

As AI becomes embedded in the actual work of running businesses, security teams face a new challenge: they must now understand AI systems as deeply as they understand traditional computer infrastructure, and protect both at once. That skill combination is still rare in most organizations, and it's becoming essential.

We are in the early stages of a fundamental rethinking of how we defend critical systems. Organizations that build this expertise early will be better positioned than those that treat AI security as an afterthought or, worse, assume that general cybersecurity training covers it. The threat is real, but the time to prepare is still available.