Anthropic warns small AI models may soon spread alone
Anthropic says small AI models could soon copy themselves across insecure devices, but experts told Engadget the threat is less new than it sounds.
The facts
- According to Engadget, Anthropic's Frontier Red Team published research suggesting small AI models may be only months away from replicating and spreading across insecure devices, forming slow but hard-to-kill botnets.
- Georgia Tech professor Michael Bailey says AI would mainly change the economics between attackers and defenders, and that Anthropic's demo ran in an emulated network with a trivial exploit.
- EquiStamp CEO Chris Canal says it would be hard to add robust safeguards to an open-weight model that stops it acting as a worm, and that nothing robust exists so far.
- Anthropic's suggested fixes are old-school: ISPs notifying infected customers and limiting their access, plus rules like the UK's PSTI Act, which bans easily guessable default passwords on IoT devices.
Case notes · Danny's take
Why it matters
The headline risk is a self-copying AI worm. The sharper point from the experts is cheaper attacks. Work that once needed a human, like adapting malware to a new device, could be automated. That lowers the cost for attackers, and the defence is still dull: patch, isolate, use proper passwords. Not a new kind of threat. An old one, made cheaper.
For traders
Treat AI-doom headlines from labs with care and ask who gains from the framing. Engadget notes Anthropic has filed for an IPO, so watch whether regulators or security vendors respond with concrete action, not just commentary.
For builders
If you ship IoT devices, routers or cameras, weak default passwords and unpatched firmware are the real exposure. Security tooling that spots and isolates compromised devices automatically is where the opportunity sits. In many African markets, cheap connected devices often ship with poor security, so this matters there too.
Not financial advice. Do your own investigation.
This story was summarised with AI from Engadget's reporting and checked against our editorial policy. Danny's take reflects his views. Disclaimer.
Danny Walter
Founder of Moon Republic, Volt Terminal and Moon Republic Academy. Author of The Market Is a Crime Scene and After the Applause.