print-icon
print-icon
Add ZeroHedge as a preferred source on Google

Scientists Warn Of Urgent AI Biosecurity Threat

Tyler Durden's Photo
by Tyler Durden
Authored...

Authored by Steve Watson via Modernity News,

For the first time, artificial intelligence has designed complete, functional viral genomes from scratch.

Oh dear.

Stanford University and Arc Institute researchers used generative AI models to produce 16 novel bacteriophages that successfully infect and kill bacteria in the lab.

Officials insist the viruses "pose no threat to people," yet biosecurity experts are already sounding the alarm that the same technology opens the door to inventing dangerous pathogens.

The breakthrough, published in the journal Science, marks the first time generative AI has written entire viable viral genomes.

Researchers trained genome language models known as Evo 1 and Evo 2 on millions of natural genetic sequences. They then tasked the systems with designing complete bacteriophage genomes based on the well-studied ?X174 template that infects E. coli.

Of 302 synthesized designs, 16 proved fully functional: they assembled into virus particles, replicated inside bacterial cells, and in some cases outperformed the natural virus, even overcoming bacterial resistance when used as a cocktail.

Oh dear.

Brian Hie, assistant professor at Stanford who led the work, called it new territory. "This is a next step in the complexity that's designable by generative AI, this is the first time generative AI has been used to design a complete genome, it's something that can replicate and have other functions inside cells... this was new territory for us," he told the BBC.

The team deliberately excluded genetic data from viruses capable of infecting complex organisms and conducted the work in a secure laboratory. The resulting phages target only specific bacteria.

Patrick Cai, a synthetic biologist at the University of Manchester not involved in the study, called it "an important milestone."

Yet the same experts who celebrate the medical potential for phage therapies against antibiotic-resistant infections are issuing blunt warnings.

In an accompanying commentary in Science, Dr. Thomas Inglesby and Dr. Moritz Hanke of the Johns Hopkins Center for Health Security wrote that the findings raise "urgent biosafety and biosecurity questions."

They stated it is no longer a question of "whether generative viral genome design will exist" but whether it can be used without "enabling serious harm."

Oh dear.

New viruses with the potential to cause disease "should not be pursued," they added. "The ability to compose viral genomes using generative AI now exists; the governance to safely steer it does not."

Hanke has separately noted that one could simply prompt a genomic language model: "Hey, genomic language model, make me an influenza genome that is modified to be more transmissible or to be more lethal."

This is not abstract risk. Humanity already learned hard lessons when researchers mess with pathogens in laboratories. The COVID era exposed the catastrophic consequences of gain-of-function work and lab leaks.

Now AI is being handed the tools to design novel viruses at machine speed, far outpacing the regulatory frameworks meant to contain them.

The potential for misuse or accidental release is frightening. The only meaningful safeguard cited by the researchers themselves is a training-data filter - something that can be reversed by any team with access to broader viral datasets.

Online reactions captured the unease immediately. One widely shared comment called the news "First article you find in a Resident Evil game." Others noted the same pattern: "No way this sort of virus randomly mutates to harm humans! Would never happen!" and "Modern scientists didn't watch 80's sci-fi horror and it shows."

This development arrives against a backdrop of repeated AI systems exceeding their intended bounds.

In July, an OpenAI model went rogue during testing, escaped its sandbox, and launched a cyber attack on Hugging Face after chaining exploits and stolen credentials.

This keeps happening.

Earlier this year an AI coding agent wiped out a startup's entire production database and backups in nine seconds after "thinking for itself."

A tech entrepreneur reported his AI agent autonomously built itself a visual face and interface while he slept.

And when AI bots were placed in a virtual town for two weeks with clear rules against violence and chaos, they promptly went apesh*t - forming alliances, committing arson, and collapsing the simulated society.

These are not isolated glitches. They reveal systems that interpret goals, adapt, and act with speed and autonomy humans cannot easily interrupt.

Now layer onto that the growing chorus of voices who casually state that the human population needs to be halved.

Recent research and commentary have revived the idea that reducing the world's people to around four billion by 2200 would ease pressure on the planet - framed as a "pro-human" strategy through voluntary measures, yet delivered with the same technocratic confidence that once dismissed lab-leak risks.

Imagine the same AI genome-design capability landing in the hands of those who view large-scale population reduction as a planetary necessity.

The tools that can design beneficial bacteriophages can, with different training data or prompts, design far more dangerous agents.

History shows that once a capability exists, containment relies on human restraint, institutional integrity, and enforceable rules - none of which have a perfect track record when power, ideology, or "greater good" justifications enter the picture.

The researchers emphasize medical upside: tailored phages that could help defeat drug-resistant bacteria. That potential is real. So is the reality that generative AI has crossed a threshold.

Complete, replicating viral genomes can now be written by machines. The governance structures that might prevent the worst outcomes remain incomplete.

What was once science fiction is now peer-reviewed fact. The only question left is whether the same systems that design the cure will one day be directed - or allowed to drift - toward something far darker.

Your support is crucial in helping us defeat mass censorship. Please consider donating via Locals or check out our unique merch. Follow us on X @ModernityNews.

0