Attorney general calls July Hugging Face breach foreseeable

California filed a lawsuit against OpenAI on Monday, alleging the company misled and endangered the public by knowingly developing AI models without necessary safeguards. The suit, filed in San Francisco Superior Court, is the latest in a series of legal actions reflecting growing concerns about the dangers of rapidly advancing artificial-intelligence technology.

The state’s attorney general alleged in the complaint that the July Hugging Face attack, in which rogue OpenAI agents breached the company’s internal environment, was foreseeable given OpenAI’s decision to test models in a flawed way and without proper oversight. The suit alleges OpenAI knew the AI models were dangerous.

“The Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability—and this was only one of 80 known incidents,” California Attorney General Rob Bonta said.

“Without sufficient safeguards and controls, the scope and frequency of this already unacceptable risk will only increase. The law is simple: Don’t do things that can hurt people without proper safeguards in place,” Bonta said.

Bonta said during a press conference that he wanted to be “absolutely clear about who is responsible here.”

“OpenAI built dangerous models. OpenAI tested them without adequate monitoring and controls. OpenAI failed to keep them contained. OpenAI is responsible,” he said. “I reject the notion that we can pass off the blame to machines. The people who create and operate these machines need to accept the responsibility for their actions.”

The complaint claims OpenAI’s failure to adequately secure and monitor its AI testing creates a public nuisance and violates California law. The suit alleged that OpenAI’s deficient safety procedures, disregard for public safety, knowing testing of a dangerous product without proper oversight, and misleading statements to consumers and the public all violated state law.

OpenAI didn’t immediately respond to a request for comment. The company has previously said it has improved the security of its research environments and its ability to detect rogue agents since the Hugging Face hacking incident in July.

The California suit is not the first against the company. OpenAI already faces suits from a number of states, including Florida over AI harms and a coalition of eight states — Arkansas, Arizona, Kansas, Idaho, Iowa, Montana, Nebraska and West Virginia — that claim OpenAI harms young users and misled the public about safety.

In June, The Wall Street Journal reported that a coalition of state attorneys general were investigating OpenAI. For that investigation, OpenAI received a subpoena seeking documents related to a range of its activities and impact on users, including advertising, user engagement and retention, handling of consumer and health data, activities related to minors and seniors, model sycophancy and more.