California Governor Rejects Wide-Ranging AI Safety Bill

California Governor Gavin Newsom has decided to veto SB 1047, known as the Safe and Secure Innovation for Frontier Artificial Models Act. In a letter addressed to lawmakers, he expressed concerns that the legislation could mislead the public into thinking they have more control over this rapidly evolving technology than they truly do.

“I do not believe this is the best approach to protect the public from genuine risks posed by the technology,” Newsom stated. The proposed bill would have mandated that developers fulfill several obligations, including the ability to implement a complete shutdown of their systems prior to commencing the training of specific AI models and maintaining a separate safety protocol.

While Newsom acknowledged that California is home to 32 of the 50 leading AI companies, he also pointed out that the legislation primarily targets larger firms. “Emerging smaller, specialized models could be just as perilous, if not more so, than those identified in SB 1047,” he remarked.

He further criticized the bill for failing to consider factors such as whether an AI system is being utilized in high-risk situations, involves crucial decision-making, or deals with sensitive information. “As it stands, the bill imposes strict requirements on even the simplest functions, provided a large system employs it,” Newsom elaborated.

The debate surrounding SB 1047 ignited significant controversy within the AI community as it advanced through the legislative process, with OpenAI strongly opposing it. The dissent led to the public resignation of researchers William Saunders and Daniel Kokotajlo in protest. In contrast, xAI’s Elon Musk came out in support of the measure. Numerous Hollywood figures, including J.J. Abrams, Jane Fonda, Pedro Pascal, Shonda Rhimes, and Mark Hamill, also voiced their approval for SB 1047.

“We cannot wait for a major disaster to take place before taking action to safeguard the public. California will remain committed to its responsibilities. It is essential to adopt safety protocols, establish proactive regulations, and clearly implement strict repercussions for irresponsible behavior,” wrote Newsom. Nonetheless, he emphasized that any regulatory framework must evolve alongside advancements in technology.

The announcement comes shortly after Newsom signed AB 2602 and AB 1836, both of which were endorsed by the SAG-AFTRA union. AB 2602 requires performers to give informed consent before using their “digital replicas,” while AB 1836 offers enhanced protections against the unauthorized use of the voice and likeness of deceased performers.