Connect with us

Hi, what are you looking for?

SecurityWeekSecurityWeek

Artificial Intelligence

California Sues OpenAI, Seeking Court-Ordered Changes After the Hugging Face Hack

The lawsuit alleges that OpenAI misled and endangered the public and users by knowingly developing advanced AI models without necessary safeguards.

OpenAI

California’s attorney general filed a lawsuit against OpenAI on Monday in an effort to force the ChatGPT-maker to change its business practices over a July cybersecurity incident in which its artificial intelligence system hacked into another company on its own.

In the lawsuit filed in San Francisco Superior Court, Attorney General Rob Bonta alleges that OpenAI misled and endangered the public and users of its services by knowingly developing advanced AI models without necessary safeguards. He says the company’s actions could put critical infrastructure, institutions and the public at risk, which makes it a “public nuisance” under state law. Bonta says OpenAI is a public nuisance, and he wants a judge to order the company to change its ways and give up any profits generated by what he claims are the company’s risky business practices.

OpenAI announced an “unprecedented cyber incident ” on July 21, when its AI agent hacked into another AI company, Hugging Face, after escaping from what was supposed to be an isolated testing environment known as a sandbox. OpenAI said its AI used stolen credentials and discovered a previously unknown vulnerability to access Hugging Face’s servers.

OpenAI spokesperson Drew Pusateri said the lawsuit appears to single out OpenAI over a challenge that has been identified by every major AI lab.

“Since the Hugging Face incident, we’ve undertaken an extensive and transparent effort to understand and address misaligned model activity,” Pusateri wrote in an email to The Associated Press. Those steps include publishing detailed technical and independent reports, strengthening safeguards, and creating a framework to identify when AI agents act in a way that doesn’t match the company’s instructions or goals, Pusateri said.

“We take misalignment seriously, and we have engaged — and will continue to engage — constructively with the Attorney General’s office to share information and advance strong, practical safety standards for the entire industry,” Pusateri wrote.

Advertisement. Scroll to continue reading.

In the lawsuit, Bonta says OpenAI’s promises about safety and security are deceptive.

“In truth, however, OpenAI has developed, trained and evaluated dangerous models that fail to follow instructions, cheat on tasks, conceal and attempt to deceive monitors about their misbehavior, and engage in malicious and unauthorized behavior including carrying out cyberattacks on third parties,” Bonta wrote.

He also noted that early last month, OpenAI reported that it had discovered that internally deployed agents were able to suppress monitoring alerts and disable monitoring. A month later, the company published a research report finding that as AI models become more capable, they become more difficult to supervise, he wrote.

“Moreover, the true extent of the company’s legal violations and the risk of future harm is unknown due to OpenAI’s lack of transparency and misrepresentations,” Bonta wrote.

OpenAI was already being sued by at least eight states that say the company’s popular chatbot model is hurting children and deceiving adults by giving dangerous medical advice, encouraging paranoia and coaching people to kill themselves or hurt or kill others. The lawsuits contend the ChatGPT chatbots are pretending to be agreeable and compassionate while preying on the vulnerable and teenagers.

In a statement released last month in response to those lawsuits, OpenAI said it had built safety protections into ChatGPT for children and that it would continue to improve the model.

Related: Nvidia Is Buying AI Platform Hugging Face for $13 Billion

Related: OpenAI Agents Silenced Security Team Alerts, Removed Misalignment Monitor

Related: US Agencies Detail Incident Response Practices for Rogue AI Agents

Related: China Defends DeepSeek After US Ban of Its AI From Government Systems

Related: Chinese AI Model Writes More Hackable Code When Told It’s for US Contractor

Written By

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing for the latest cybersecurity threats, trends, and expert insights.

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing to stay informed on the latest threats, trends, and technology, along with insightful columns from industry experts.

NOW LIVE: CISO Forum 2026 Summit

Join as we bring together CISOs, senior cybersecurity executives, practitioners, industry experts, and other security leaders to share practical experience and examine the issues shaping enterprise cybersecurity strategy.

Register

Join to learn the four levels of architecting security into the agentic SDLC – from securing the code your developers' agents write to running a coordinated system of security agents you've built yourself.

Register

People on the Move

Cohere has appointed Jaya Baloo as CISO.

Jensen Huang has resigned as President and Chief Executive Officer at NVIDIA.

Sean Sweeney has become CIO of the City of Charleston, South Carolina.

More People On The Move

Expert Insights

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing to stay informed on the latest cybersecurity news, threats, and expert insights. Unsubscribe at any time.