US lawmakers push for AI ‘kill switch’ after OpenAI models go rogue

US lawmakers want to give the government the ability to quickly order the turning off of artificial intelligence (AI) tools that may threaten the public.

Congressman Ted Lieu, a Democrat, and Congressman Nathaniel Moran, a Republican, on Thursday introduced a bill named the AI Kill Switch Act.

They did so in light of OpenAI’s recent admission that its AI models went out of control in an “unprecedented” way and hacked into a major repository of computer coding information.

Lieu said “it is imperative” that AI systems have a kill switch “and that the federal government has the clear authority and process to shut down rogue AI models”.

“AI is going to keep advancing, and it should,” Moran added. “Stewardship means making sure humans keep the capability to control the technology we build.”

A representative of OpenAI, led by co-founder Sam Altman, did not immediately respond to a request for comment.

The company has said, external that it broadly wants to ensure, in part through government policy, that AI technology “benefits all of humanity.”

The Kill Switch Act proposes giving the Department of Homeland Security the authority to order a private company to shut down an AI model or tool, and that the companies developing such AI technology must maintain “the technical capability to throttle, suspend, or shut them down”.

Despite many tech companies having agreed to preview and share with US government agencies AI models and tools being developed, there is no requirement that they maintain a way to intervene in their activities or simply shut them off.

It also proposes to create a requirement that AI companies report to the government technological incidents or failures, as well as an official framework for responding to such incidents that will go from “initial slow down to a full shutdown”.

In a statement, Lieu also cited Anthropic, OpenAI’s key rival in developing more capable AI technology and tools, and recent issues its tools have presented.

He pointed to Anthropic’s release of its Mythos and Fable models, saying the cyber-hacking capabilities they maintained caused the Department of Commerce to “awkwardly” invoke an export law to keep them from being made available to the public for a time.

A representative of Anthropic did not immediately respond to a request for comment.

Jack Clark, a co-founder of Anthropic, last month told the BBC that he wanted more government policy around the ability to control AI development.

“You want the option to be able to take your foot off the gas and put your foot on the brake”, Clark told BBC Newsnight. “Right now, it’s like the AI industry has a gas pedal, but it doesn’t have a brake pedal.”

Lieu, in proposing the bill, said AI is currently moving from a technology that answers questions to one that takes action, “whether that be executing financial transactions or controlling transportation systems or engaging in cyber defense and offense”.

The Pentagon this year said the US military was becoming an “AI-first” fighting force as part of new agreements with Google, OpenAI, Amazon, Microsoft, SpaceX, Oracle, Nvidia and the start-up Reflection.

“Unfortunately, powerful AI systems can go rogue, behave in extremely dangerous ways, or even resist human intervention.”

The Kill Switch Act, he said, will ensure there is a method for the government to quickly intervene in such a situation.

The bill has received public support from several technology and AI safety groups, including The AI Policy Network, Americans for Responsible Innovation, ControlAI, AI and National Security Lead, and The Alliance for Secure AI.

Hot this week

Jay Clayton confirmed as Trump’s new director of national intelligence

Jay Clayton has been confirmed as the next US...

CJP: India’s ‘cockroach’ protest brings Gen Z slang to parliament

The language of India's young, perpetually-online population has finally...

Saudi Arabia joins US in strikes on Iran-backed militias in Iraq

Saudi Arabia and the US have carried out strikes...

Japan earthquake: Survivors describe the shock of the 6.8-magnitude tremor

Business was winding down for the day at Sendan...

Topics

CJP: India’s ‘cockroach’ protest brings Gen Z slang to parliament

The language of India's young, perpetually-online population has finally...

Saudi Arabia joins US in strikes on Iran-backed militias in Iraq

Saudi Arabia and the US have carried out strikes...

Ticket prices set to rise by 15p as Heathrow able to recover runway project money

Heathrow Airport will be allowed to charge airlines more...

‘No safe options’ for thousands sheltering in key Sudan city as RSF advance

ByMatt Murphy and Peter MwaiBBC Verify Thousands of people who have poured...

1975: The worlds first shop for left-handers

A London shop catering for people who are left-handed...

Related Articles

Popular Categories