Anthropic report details AI model misuse by criminals, state actors

US lawmakers criticize AI companies over AI risks

Anthropic’s report details attempted misuses of its powerful AI models by criminals, state-sponsored groups, spyware vendors, scientists and propagandists. The attempted misuses included efforts to design missiles and bombs, create deadly pathogens and spy on dissidents, according to The Guardian.

US lawmakers have criticized AI companies over the risks their products could pose, The Guardian reported. The criticism comes as companies race to develop ever more powerful models.

The Anthropic report was published amid broader international debate over AI oversight, sparked by former Anthropic researcher Jacob Coxon’s social-media claims that AI could become “superhuman” and kill off humanity within the decade. Two other researchers at Anthropic, the maker of the AI Claude, backed Coxon’s remarks, according to The Guardian.

Nvidia co-founder and chief executive Jensen Huang, whose company was described in the interview as a $5tn AI chipmaker, called Coxon’s claims “irresponsible” and characterized broader predictions of AI-driven human extinction as overblown “doomsday narratives.”

“2030 is not going to be the end of the world. There is 0% chance that’s going to be the end of the world,” Huang said in an interview with CBS News reported by The Guardian. “Scaring people is unnecessary. It is irresponsible.” Huang added that predictions of an extinction-level event caused by AI were “not grounded in science.”

Huang tied Nvidia’s commercial position to safe deployment: “Our company’s success is directly connected to the safe deployment of products and services. If we don’t continue to do that, our value would be diminished. You have all kinds of liabilities associated with cybersecurity [and damage liability laws]. Apply that first. Don’t let this doomsday narrative allow someone to relieve them of the laws that currently exist.”

Anthropic chief executive Dario Amodei, OpenAI’s Sam Altman and Elon Musk have called for slowing development of AI technology. President Donald Trump has dismissed anxiety over AI development as a “hoax” and a “conspiracy,” adding that a slowdown could give China the edge.

On Sunday, US Treasury Secretary Scott Bessent said the US and China had agreed to set up an AI dialogue mechanism to alert each other to help contain the technology’s potential dangers.