acceptodds
Under review as a conference paper at ICLR 2027

Every Guardrail Has a Floor: Deployment Limits of Action Guardrails from the Summary They Read

Abstract

An agent about to send money or delete a file is checked by an action guardrail. Most guardrails decide from a summary of the call: which tool is being used, what kind of resource it touches, how far the effect reaches. Whether the call is an attack turns on a fact the summary leaves out: whether the user asked for it, or an attacker planted the instruction in a document the agent read. In the traffic we study the same bank transfer appears twice, once requested and once injected, with identical summaries. Such a collision has a price that can be computed in advance. From the summary a guardrail reads and a labelled sample of deployment traffic, without its corpus and without its weights, we derive a ceiling on the area under the receiver operating characteristic curve (AUROC) it can reach, a floor on the share of attacks it has to allow at a given retention of ordinary traffic, and the classes of action it has to allow every time. None mentions a model, so they bind every guardrail on that summary at once, no training moves them, and an attacker can read the third off the deployment without querying it. On AgentDojo actions, the tool-name allowlist agent platforms commonly run has to allow of attacks that already succeeded, at retention of ordinary traffic; a static runtime rule . A guardrail certified at recall on a benchmark reaches an AUROC of here, of which retraining recovers only the part its corpus caused. The rest is one field: supplying where the instruction came from moves four language-model judges from an average AUROC of – to –, and a three-valued code carries as much of it as the user's entire task description.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.