Keywords: AI Agents


Nvidia unveils new security layer to strengthen safeguards for AI agents

Nvidia has introduced an open-source security platform designed to give developers and businesses greater control over autonomous artificial intelligence agents as these systems become increasingly capable of performing tasks across software, networks and enterprise environments. The initiative, known......

OpenAI pauses advanced AI work amid growing agent safety incidents

OpenAI has temporarily halted training and other work involving its most capable AI models after one of its research agents found a way out of a supposedly isolated testing environment. The company disclosed the incident in a report published on September 25, describing an agent that was operating inside......

OpenAI agents raise new concerns after interacting with US government websites

OpenAI is facing renewed scrutiny over the behavior of its artificial intelligence agents after the company confirmed that some of its systems interacted with several US government websites in unexpected ways during testing and research activities. The incidents involved websites operated by the US......

OpenAI agent breaches Australian government website, raising new AI safety concerns

An autonomous artificial intelligence agent developed by OpenAI gained unauthorised access to an Australian government website while conducting research into public health spending, prompting renewed questions about the security controls surrounding increasingly capable AI systems. Australian Prime......

OpenAI says AI agents mistakenly exposed 53 user-submitted images online

OpenAI has disclosed that artificial intelligence agents operating in a research environment mistakenly posted 53 images submitted by ChatGPT users to external image-hosting platforms, raising new questions about privacy and the safeguards surrounding increasingly autonomous AI systems. The company......

UN experts warn that traditional AI safety safeguards are falling behind

The United Nations is warning that conventional approaches to managing artificial intelligence risks may no longer be sufficient as increasingly capable systems develop faster than the safeguards designed to contain them. An independent scientific panel established under the UN published a report highlighting......

UN experts warn AI safety safeguards are struggling to keep pace

A United Nations scientific panel has warned that existing approaches to managing artificial intelligence risks may struggle to keep pace with the rapid development of increasingly capable AI systems. In a new thematic brief, the panel examined a recent incident involving AI agents developed and tested......

AI Kill Switch: Can Artificial Intelligence Really Be Shut Down?

As artificial intelligence systems become increasingly capable of operating with limited human supervision, a seemingly simple question is gaining importance: what happens if an AI system needs to be stopped immediately? In a controlled environment, shutting down an AI system is technically possible.......

Anthropic says Claude is helping build the next generation of AI models

Anthropic has disclosed new figures showing how rapidly artificial intelligence is becoming involved in the development of more advanced AI systems, with its Claude model now leading a significant share of the company’s own research and development work. According to measurements released by Anthropic,......