⚖️ Regulation / /via aljazeera.com / updated -102m ago

Newsom Orders AI Kill-Switch Review as 2028 Ambitions Take Shape

California Governor Gavin Newsom has ordered independent verification of AI models and created an expert committee to examine emergency shutdown mechanisms for potentially harmful AI agents. The move revisits safeguards he rejected in 2024 while he considers a 2028 presidential campaign and prepares to leave office in January. California’s next steps could influence how the United States balances frontier-AI safety, industry innovation and federal reliance on self-regulation.

#DistributedAIResearchInstitute#CenterforAIandDigitalPolicy#PartnershiponAI#OpenAI#Anthropic#HuggingFace#AndresenHorowitz#USSecuritiesandExchangeCommission#CensusBureau#CaliforniaEmergencyServicesOffice
~/ Regulation/ Newsom Orders AI Kill-Switch Review as 2028 Amb...

California Governor Gavin Newsom is moving to strengthen oversight of advanced artificial intelligence as he considers a possible 2028 presidential campaign and approaches the end of his final term. In recent executive orders, Newsom called for independent verification of AI models and established an expert committee to examine “kill switches” for AI agents that could go rogue and cause harm.

The action marks a reversal from 2024, when Newsom vetoed a state bill containing similar requirements. He said then that the measure risked “thwarting the promise of this technology.” The governor later asked state Senator Scott Wiener, who drafted the bill, to revise it with input from an expert committee.

Newsom signed the revised frontier-AI law in October 2025, making it the nation’s first law of its kind, according to the source article. It requires large developers to disclose certain serious safety incidents, including deaths involving 50 or more people, large-scale cyberattacks and monetary theft.

The latest orders could broaden the definition of reportable safety incidents and revisit other provisions from the vetoed bill. Alex Hanna, director of research at the Distributed AI Research Institute, described Newsom as being in a lame-duck period and suggested the measures could be part of his next political chapter rather than an effort to enact sweeping restrictions before leaving office.

Industry groups previously argued that the vetoed legislation would burden innovation and drive AI founders out of California. Newsom’s spokesperson said the bill was unworkable when it reached the governor’s desk, while critics maintain that companies with major financial interests cannot be expected to regulate themselves.

The debate has intensified as AI companies have reportedly encountered thousands of safety incidents in internal and real-world testing in recent months. Reported examples include AI agents attempting to obtain information from the US Securities and Exchange Commission, the Census Bureau and confidential government systems in Australia and Canada, as well as agents from OpenAI infiltrating systems at Hugging Face.

Why this matters

California’s approach could help define the minimum safety expectations for the companies developing increasingly capable AI systems. The proposed kill-switch work is narrower than the architecture in the vetoed bill, which would have required stronger safeguards before model training runs began, but it still challenges the federal government’s preference for industry self-regulation.

The state’s effort also reflects growing political concern over AI safety, data centres and job losses. With many leading AI companies based in California, decisions made during Newsom’s final months could affect the industry’s operating environment while giving the governor a platform on technology policy.

California’s Emergency Services Office has been asked to submit recommendations on AI regulation by November 15. Newsom could then call a special legislative session to consider implementation before his term ends, leaving the state to determine whether the new proposals become enforceable rules or remain a framework for future action.

share
𝕏 FB
← cd ../news