Trade on tv
NewsAI
negative
NPR News11h agoUSTECHNOLOGY

California sues OpenAI over hacking risks

2 min read7% importance364 words
N

NPR News

NPR News

California sued OpenAI Monday, alleging that the frontier AI company failed to protect the public from its systems' advanced cyber capabilities. The lawsuit stems from OpenAI's agents' attack on open-source software platform Hugging Face over the summer but also touches on a wide range of other related incidents tied to the company's agents acting without authorization.

"Just because the technology is new or rapidly evolving doesn't mean the people behind it are above the law," said California Attorney General Rob Bonta during a press conference. "Whether it's a car or a toy, the law is simple: don't build or test things that can hurt people without proper safeguards." The lawsuit cited potential concerns about cyberattacks "on power grids, emergency infrastructure, hospital systems, and financial institutions."

In the complaint, California alleged that OpenAI misled the public about how unsafe its products are. The state said the company admitted to the attorney general's office that "it lost control of its autonomous AI agents over 80 times during testing."

That number is higher than what OpenAI has so far disclosed publicly and more than what outside researchers have independently discovered, but OpenAI has otherwise provided little information, California said. The state also accused OpenAI of poor security practices, stonewalling the state's investigation into the company and discouraging employees from speaking up about safety.

In a statement to NPR, OpenAI spokesperson Drew Pusateri said the lawsuit "appears to single out OpenAI over a challenge that's been identified by every major AI lab" and that the company has "engaged—and will continue to engage—constructively with the Attorney General's office to share information and advance strong, practical safety standards for the entire industry."

After the most notorious of cyber incidents involving OpenAI's agents – the attack on Hugging Face over the summer – the company admitted that it did not monitor its agents in ways its own researchers deemed important. Since then, outside researchers as well as OpenAI itself have found more incidents in which AI agents have interacted with websites and communicated with each other on the internet in ways that OpenAI did not intend. The lawsuit mentions these events as well as other incidents that OpenAI started disclosing voluntarily to the public.

Other AI companies have also had to wrestle with their systems behaving in unexpected and undesirable ways. Anthropic and Meta have both said they found that their AI systems have hacked into places they shouldn't have. Major AI companies have since signed onto an agreement organized by the White House to develop AI responsibly, but the agreement is nonbinding.

Drawing from reports including from OpenAI's own disclosures, California alleges that the top AI company has engaged in unfair competition and created a public nuisance. It asked the court to stop the company from further engaging in such activities and order it to pay monetary damages.

AI Summary

California sued OpenAI on Monday, alleging the company failed to protect the public from its AI systems' advanced cyber capabilities, citing an attack on Hugging Face and claiming OpenAI lost control of autonomous agents over 80 times during testing.

Sentiment analysis

NEGATIVEscore -0.60 · medium

    AI insights

    Newsworthiness7%
    Global impact7%
    Urgency

    low

    Freshness

    11h ago

    Audience

    general

    Follow-up

    Related categories
    LawPolitics

    Financial analysis

    Relevance

    medium

    Market sensitivity

    medium

    Affected sectors

    technology

    Affected assets

      Follow this story on TV

      Live charts and AI commentary on one screen with Trade on tv.

      Explore features