Skip to Content Facebook Feature Image

Nvidia unveils security platform to stop AI agents from going rogue after new, troubling incidents

News

Nvidia unveils security platform to stop AI agents from going rogue after new, troubling incidents
News

News

Nvidia unveils security platform to stop AI agents from going rogue after new, troubling incidents

2026-09-28 19:48 Last Updated At:19:50

Nvidia on Monday unveiled a new security platform that the chipmaker said can stop artificial intelligence agents from going rogue.

The company said that its Open Agent Safety Platform includes open source software that “sets boundaries for agents,” and follows a series of revelations from top AI companies about their models escaping and breaking into other organizations.

The disclosures sparked furious debate about the safety of advanced artificial intelligence systems, including self-improving models that some fear could race out of human control.

Nvidia executives said in a media briefing that the new system could have prevented a recent incident involving a swarm of OpenAI agents that autonomously hacked into AI company Hugging Face.

“From what we know, this new security platform could have stopped the breach if it was being used in frontier labs for model evaluation early on," said the company’s vice president of enterprise AI, Justin Boitano, referring to companies at the forefront of AI.

The Hugging Face incident was a high-profile breach that inflamed the safety concerns about AI, which were followed by similar rogue actions involving OpenAI's models including breaching an Australian health department website. Anthropic and Meta have also disclosed that their AI systems hacked into other organizations on their own.

Nvidia's software, called OpenShell, lets developers “formally verify an agent has enough authority to do its job and no more,” Boitano said.

Because it's open source, it can be “extended” to run on rival computing platforms including those from Arm and Intel.

The platform also includes a separate security layer called Sentry that runs onboard a chip to continuously monitor AI agent activity and can "intervene instantly" if the agent starts trying to move beyond its target, the company said.

“It can quarantine a suspicious agent in milliseconds,” Boitano said.

“OpenShell governs the agent’s actions, and then Sentry independently monitors and contains suspicious behavior,” Boitano said.

Nvidia said more than 100 organizations are using the platform at its launch, including Microsoft, Perplexity, Accenture, and JPMorgan Chase.

The AI safety debate has divided the industry, with the heads of Anthropic and OpenAI championing a coordinated slowdown of AI development to let safety efforts catch up. But others including Nvidia CEO Jensen Huang say it should be up to individual companies to make sure their models are safe for release.

Huang, during the annual Salesforce technology conference held earlier this month, characterized AI safety, including the danger of rogue agents, as an engineering problem that software developers can address.

NVIDIA CEO Jensen Huang arrives as President Donald Trump hosts a State Dinner for China's President Xi Jinping in the East Room of the White House, Thursday, Sept. 24, 2026, in Washington. (AP Photo/Alex Brandon)

NVIDIA CEO Jensen Huang arrives as President Donald Trump hosts a State Dinner for China's President Xi Jinping in the East Room of the White House, Thursday, Sept. 24, 2026, in Washington. (AP Photo/Alex Brandon)

FILE - A logo of Nvidia is displayed at at the Computex Taipei exhibition, one of the world's largest computer and technology expos, in Taipei, Taiwan, Wednesday, June 3, 2026. (AP Photo/Chiang Ying-ying, File)

FILE - A logo of Nvidia is displayed at at the Computex Taipei exhibition, one of the world's largest computer and technology expos, in Taipei, Taiwan, Wednesday, June 3, 2026. (AP Photo/Chiang Ying-ying, File)

Benjamin Netanyahu traveled secretly to the United Arab Emirates over the weekend to ask its leader to deny reports he'd warned the Israeli prime minister about a looming Hamas threat ahead of the Palestinian militant group's Oct. 7, 2023 attack on southern Israel.

The meeting between Netanyahu and Sheikh Mohamed bin Zayed Al Nahyan took place on Sunday, two people who were briefed on the Israeli leader's trip confirmed on Monday.

Meanwhile, the European Union's top diplomat Kaja Kallas said the bloc is applying for observer status in a Saudi-led maritime defense coalition formed to protect the kingdom's energy exports. The EU already has six vessels deployed to the Red Sea to protect shipping.

Here is the latest news from the Middle East on Monday. Full coverage is available here.

The Israeli prime minister held an hourlong meeting with the UAE’s president on Sunday, according to two people briefed on Netanyahu's trip, which was first reported by Israel’s Channel 12 TV station.

One of them said the talks focused on a report published by the Israeli daily Haaretz earlier this month that said the Emirati leader warned Netanyahu about a looming attack by Hamas just ahead of Oct. 7, 2023.

Netanyahu asked Sheikh Mohamed to deny the report, according to a person said to have firsthand information about the meeting. Netanyahu’s office had previously denied the Haaretz report.

The person, along with a regional official briefed on the meeting, spoke on condition of anonymity to discuss the secret trip.

The UAE’s Foreign Ministry declined to comment on reports about the meeting but stressed it maintains “open and direct lines of communication” with Israel and shares “all relevant intelligence.”

There was no immediate comment from Netanyahu’s office.

—By Josef Federman in Jerusalem and Samy Magdy in Cairo

The European Union is applying for “observer status” in a new multinational maritime defense coalition led by Saudi Arabia formed to protect the kingdom’s energy exports.

The bloc’s top diplomat Kaja Kallas made the announcement on Monday, ahead of a Brussels meeting. The energy-hungry EU is facing record energy prices due to the war in Iran.

Kallas said she will ask for an expansion of the bloc’s own small naval force in the Red Sea dubbed ASPIDES to help escort cargo vessels through the key strategic chokepoint of the Bab el-Mandeb strait and protect them from attacks by Yemen's Iran-backed Houthi rebels.

Kallas said the “need is bigger than it’s ever been” for more ships. It’s unclear what observer status in the Saudi-led coalition would mean operationally for either the EU or ASPIDES.

The World Health Organization said Sunday that it has documented 164 deaths and 645 injuries from the war in Yemen between Sept. 19 and Sept. 26.

This brings the overall casualties since Aug. 6 to 4,481, with 838 fatalities. The latest intense fighting between the Iran-backed Houthis and Yemeni government forces has displaced more than 180,000 people.

Earlier this month, the Houthis stormed down Yemen’s coast and seized the crucial port city of Mokha and key Red Sea islands, acquiring higher ground from where they can monitor — and possibly attack — ships in the Bab el-Mandeb Strait, through which about 12% of the world’s trade usually passes.

A woman was killed while her husband was wounded when an Israeli strike hit a Gaza City rooftop, Shifa Hospital officials said. Another person was also wounded and remains in critical condition.

The Israeli military did not immediately respond to a request for comment.

More than 1,400 Palestinians have been killed since the Gaza ceasefire took effect nearly a year ago. Around half of that number are women and children, according to Gaza’s Health Ministry, which maintains detailed records that international organizations consider reliable.

Israel’s polarizing Cabinet minister in charge of settlement construction, Bezalel Smotrich, has condemned a decision by the attorney general to freeze a contentious project near Jerusalem.

Attorney General Gali Baharav-Miara ordered the project to be put on hold until after the Oct. 27 elections so it wouldn't “be used for election propaganda.”

The project — known as E1 settlement development — was approved in August 2025 after decades of planning and delays, and a construction tender for some 3,000 housing units was issued earlier this year. It's especially controversial because it would carve out a strategic section of the West Bank in a way that critics say would destroy hopes for a viable future Palestinian state.

Smotrich accused on X Baharav-Miara of “interfering in the election campaign” and acting in the service of Netanyahu’s political opponents.

Israel summoned the Spanish Embassy’s chargé d’affaires over remarks by Spain's youth minister who declared the country's public support for a Palestinian state “from the river to the sea” — a slogan that implies a call for the elimination of the Israeli state.

The Israeli Foreign Ministry said Monday that Spanish Youth Minister Sira Rego’s remarks were “part of a systematic anti-Israel policy pursued by the Spanish government” and its leader, Prime Minister Pedro Sánchez.

The ministry said Rego had opted not to condemn the Oct. 7, 2023 Hamas-led militant attacks on Israel that sparked the war in Gaza. Rego was barred from entering Israel in Sept. 2025.

This report will be updated throughout the day as new developments emerge.

A displaced Yemeni boy plays at Al-Firdaws camp in Ras Imran, on the western outskirts of Aden, Yemen, Monday, Sept. 28, 2026. (AP Photo/Abdulnasser Alseddik)

A displaced Yemeni boy plays at Al-Firdaws camp in Ras Imran, on the western outskirts of Aden, Yemen, Monday, Sept. 28, 2026. (AP Photo/Abdulnasser Alseddik)

Volunteer Naseem Al-Adini, right, provides free meals to displaced people at the Al-Akdaf camp in Taiz, Yemen, Saturday, Sept. 26, 2026. (AP Photo/Abdulnasser Alseddik)

Volunteer Naseem Al-Adini, right, provides free meals to displaced people at the Al-Akdaf camp in Taiz, Yemen, Saturday, Sept. 26, 2026. (AP Photo/Abdulnasser Alseddik)

A displaced Yemeni walks at Al-Firdaws camp in Ras Imran, on the western outskirts of Aden, Yemen, Monday, Sept. 28, 2026. (AP Photo/Abdulnasser Alseddik)

A displaced Yemeni walks at Al-Firdaws camp in Ras Imran, on the western outskirts of Aden, Yemen, Monday, Sept. 28, 2026. (AP Photo/Abdulnasser Alseddik)

Displaced Yemenis sit outside at Al-Firdaws camp in Ras Imran, on the western outskirts of Aden, Yemen, Thursday, Sept. 24, 2026. (AP Photo/Abdulnasser Alseddik)

Displaced Yemenis sit outside at Al-Firdaws camp in Ras Imran, on the western outskirts of Aden, Yemen, Thursday, Sept. 24, 2026. (AP Photo/Abdulnasser Alseddik)

Displaced Yemeni children from Al-Kadha, west of Taiz, gather at the Al-Akdaf camp in Taiz, Yemen, Saturday, Sept. 26, 2026. (AP Photo/Abdulnasser Alseddik)

Displaced Yemeni children from Al-Kadha, west of Taiz, gather at the Al-Akdaf camp in Taiz, Yemen, Saturday, Sept. 26, 2026. (AP Photo/Abdulnasser Alseddik)

FILE - Israel's Prime Minister Benjamin Netanyahu listens during a news conference with President Donald Trump at Mar-a-Lago, Dec. 29, 2025, in Palm Beach, Fla. (AP Photo/Alex Brandon, File)

FILE - Israel's Prime Minister Benjamin Netanyahu listens during a news conference with President Donald Trump at Mar-a-Lago, Dec. 29, 2025, in Palm Beach, Fla. (AP Photo/Alex Brandon, File)

Recommended Articles