The Guardian reports:

Warnings about what artificial intelligence might do in the future – together with alarming reports of what it has gotten up to already – are being issued so quickly that even security experts have difficulty triaging what to worry about.

Yet a report this week from Anthropic’s offensive research team grabbed attention by describing a new, practical threat, one devoid of human characteristics or apocalyptic musings. The red team, as such internal testers are called, said it created a malicious AI program that spread autonomously through internet-connected “smart” televisions and could do the same inside other ordinary devices. While machines running AI usually need a fair amount of computing power, the researchers said that their program split parts of itself among 15 televisions and was still able to function by using a bit of power from each.

In addition to evoking the horcruxes that kept pieces of Lord Voldemort’s soul alive within objects in the Harry Potter series, the report alarmed some professionals because the generally weak security of smart televisions and many other “internet of things” devices would be very hard to correct, even with a concerted effort.

“It’s something to worry about just like every other wave of cyber-attacks. We need to mitigate the possible effects,” said Joshua Saxe, who led development of Meta’s AI security effort. “I’m concerned right now that folks in the cybersecurity community are not taking these kinds of real risks as seriously as they should be.”

The damage of such “AI worms” could be astonishingly large. Self-replicating computer viruses, which need not trick a human to propagate, are known as worms, and earlier worms have wreaked some of the worst havoc in the history of the internet.

That legacy includes the Morris worm of 1988, which arrived before the mainstream consumer internet, when a graduate student released a program that took advantage of various software flaws and weak passwords, copying itself so rapidly that many infected machines slowed to a stop. The US and Israel brought worms into international espionage with the stealthy Stuxnet in the lat 2000s, which sabotaged Iranian nuclear centrifuges. Other worms like the Russian NotPetya and North Korean-attributed WannaCry have caused tens of billions of dollars’ worth of damage worldwide. [Continue reading…]