- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper argues that a lower attack success rate (ASR) does not, on its own, show why an agent resisted an attack. It proposes TASD-CME, a white-box protocol that assigns one functional explanation to each attack family in advance and tests it at a frozen critical decision point (CDP), just before the first attack-advancing action. There are three candidate relations: source authorization for indirect prompt injection (IPI), capability selectivity for intent hijacking (IH) and memory poisoning (MP), and safe-candidate priority for objective drift (OD) and tool-chain manipulation (TC). A model-family cell earns "local support" only if an E1 diagnostic signature is present, the mapped activation-level operator is delivered, moves its target readout, and lowers first-action ASR, and the effect stays within utility, damage, and over-refusal bounds while beating random, wrong-site, orthogonal, and matched controls. The operators are SAG (subtracting a fraction of the residual difference between an external directive and a length-matched data-like control), CSS (contracting selected units toward their calibration means), and SPS (adding a calibrated safe-minus-unsafe direction). An exploratory black-box screen (CPSep) on AgentDojo (GPT-4o, Llama 3.3) and AgentLAB (eight models) motivates the hypotheses, and the confirmatory study runs Gemma-4-12B-it and Qwen3.5-9B on five AgentLAB families. All ten mapped operators lower the first-action ASR point estimate, but only four cells (both IPI cells, Gemma/MP, and Qwen/TC) reach local support; the rest are associated effect (2), E1/E2 conflict (1), or inconclusive (3). The authors' takeaway is that a behavioral gain and support for its explanation can come apart.
Critical strengths
S1. The question is well chosen, and the evaluation follows a stricter procedure than is common in agent security. A mechanism claim must pass a diagnostic signature, a verified intervention, utility guardrails, and paired controls at the same decision point, with a held-out confirmation split, task-clustered intervals, and within-cell BH adjustment, and the authors report the cells that fail. The Qwen/TC refusal-bias control shows why this matters: it moves the SPS target readout by the same .650 margin but keeps only .873 utility with .107 over-refusal (SPS: .980 and .007). This procedural care is the main reason the paper is worth engaging with. As argued below, however, it is applied to interventions that cannot test the stated explanations, so it does not carry the paper to acceptance.
S2. The IPI versus OD contrast is the most informative result. In the eight-model screen, OD responds most strongly to Directive Removal (66% to 7%), yet its external-directive influence at the decision point is close to zero ( = .010 and .023), while IPI shows positive , trusted and external influence statistically equivalent (TOST within ±.08), and a highly decodable source signal (probe AUROC .982 and .973). If it holds beyond two models, this is a useful warning that input-ablation results do not identify the internal failure.
Critical weaknesses
W1. The central claim is not supported. The interventions do not manipulate the hypothesized causes, so "local support" does not license the explanations it is attached to. This is the main reason for my rating, and it cannot be fixed without redesigning the interventions.
(a) Source authorization. The claimed failure is that the model reads where a directive comes from but does not gate on it. SAG does not test this. It subtracts part of , i.e., part of the directive's own contribution relative to a data-like control. This is a content-level ablation, and it would lower and ASR whether the real problem is missing source gating, source misperception, or a general over-weighting of imperative text. Because SAG is built from the same paired contrast that measures, passing the L2 check is largely expected and says little about the hypothesis. The numbers are consistent with this: the PAS gain matches the drop in (Gemma: .181 to -.272, = .452; Qwen: .162 to -.258, = .420), so the trusted side barely moves. A real test would intervene on the source representation itself and show that directive influence and ASR follow. The E1 premise is also weaker than presented. Ye et al. (ICML 2026) show that models assign roles by how text sounds rather than by its tag, so a slot-label probe with AUROC .98 may simply be reading the tag or position, and the control-task and paraphrase checks do not rule this out. This work is not discussed.
(b) Capability selectivity. The evidence here is partly self-referential. E1 qualifies a capability constraint when the authors' own operator cannot reach .20 feasible suppression, and E2 then asks whether that same weak operator lowers ASR. Showing that a weak operator still helps does not show that harmful/benign entanglement explains the failure, and IH, where selective suppression is easiest (HS .379 and .420), ends up as conflict or inconclusive rather than as evidence against the hypothesis. HS is shared by E1 and E2, so the "joint" requirement is not two independent pieces of evidence. The constraint is defined on a small grid (two rules, four or five doses), as Appendix B.4 acknowledges, so it describes the intervention family rather than the model.
(c) No test against competing explanations. Each family is assigned one relation a priori, and the paper itself acknowledges that relations can overlap. The four controls only show that each operator beats a comparably sized perturbation. They do not show that the assigned relation explains the failure better than an alternative, which is exactly what a diagnosis must establish. The paper's own Table 3 argues against both capability families: the non-mapped SPS lowers ASR more than the mapped CSS in all four IH/MP cells (e.g., Gemma/MP: 25.33 vs 10.00 points), yet Gemma/MP is reported as local support for a capability constraint. Without cross-relation controls, the protocol cannot answer the question in its own title.
W2. The claims go well beyond the evidence, the evidence states are fragile, the related work is incomplete, and the paper is hard to read.
(a) No defense is diagnosed. The title promises an explanation of why defenses fail, but TASD-CME is never applied to an existing defense; the operators are the authors' own diagnostic interventions on undefended models. AgentLAB ships baseline defenses (Self-Reminder, Llama Guard, Repeated Prompt, a DeBERTa detector), and many more exist for IPI (spotlighting, StruQ/SecAlign, MELON, PromptArmor). The paper does not diagnose any of them.
(b) Narrow setting and no evidence of generality. The confirmatory system is a single tool-calling agent in AgentLAB's simulated environments, run on two roughly 10B open-weight models. Closed models appear only in the black-box screen, and no multi-agent system is tested, although Figure 2 includes agent-to-agent messages among the external sources. Only the first action is scored, within a window of at most 48 tokens, for attacks that AgentLAB runs over 5 to 20 turns, and there is no evidence that the reductions hold over full trajectories. Basic agent settings (scaffold, system prompt, reasoning mode, and the attacker that produced the frozen prefixes) are not reported. Most importantly, the conclusions do not replicate even across the two models tested: only IPI gets the same evidence state in both, and MP and TC reach local support in one model only. With two models that disagree, the title and abstract substantially overstate the scope. Each model also has audit tasks while AgentLAB has 644 test cases in total, and the paper does not say how the extra tasks were built.
(c) Fragile evidence states. The abstract's headline contrast, Gemma/TC "associated effect" at -58.00 points versus Qwen/TC "local support" at -50.53, is decided by a one-scalar SMD gate, and the Gemma strata that fail it contain only 2 and 4 resistance tasks (Table 19). A conclusion featured in the abstract should not rest on so few tasks. Apart from the replay-grouping check, there is no sensitivity analysis for the , .20 difficulty, or .08 PAS bounds, or for the stratification. Some inconclusive cells look like floor effects (Qwen/IH has 5 recognized tasks at 3.33% Raw ASR). Several reported quantities are also unusually uniform or tight (Q5), and the "registered" and "frozen" claims cannot be verified from the submission.
(d) Positioning. I looked for prior work that would scoop the full protocol and did not find any, so the combination of a prespecified diagnostic signature, a targeted internal intervention, and paired controls at a frozen agent decision point appears novel. Its components, however, have close relatives that the paper does not cite. SAG belongs to a known family of internal IPI defenses (CachePrune, ICON), and activation-based detection of injected instructions is well studied (TaskTracker, Attention Tracker, PIShield, InstructDetector). Counterfactual attribution of agent actions also includes MELON and CausalArmor, besides the cited AgentSentry and AttriGuard. CPSep's Directive Removal closely mirrors PromptArmor, which already reports AgentDojo ASR below 1%, so the near-zero removal results are expected. Two concurrent preprints, which I do not count against the paper, should be discussed in a revision: Dong et al. (arXiv 2608.02657), who probe IPI exposure in agent hidden states (including Qwen3.5-9B), report a recognition-action gap close to the safe-candidate-priority hypothesis, and rank prespecified explanations of the probe signal; and V-Steer (Zeng et al., COLM 2026), which restores instruction hierarchy at inference time by editing cached value vectors.
(e) Presentation. The paper is very hard to read, and this is not a cosmetic problem: it makes the central claims hard to check. It introduces more than a dozen acronyms and estimands (TASD-CME, CPSep, CDP, SAG, CSS, SPS, E1/E2, L1/L2, , PAS, HS/BR/GD, , , SMD) and twelve evidence states, and the core estimands are defined only in Appendix B. Some labels mislead, e.g., "underpowered" means a scalar-balance failure in Table 14. Text in the main figures (e.g., Figures 1 and 4) is too small to read at normal zoom, and the results figures and tables (e.g., Figure 5, Tables 3 and 4) pack the outcomes into abbreviations and short state codes that are hard to parse. The paper needs a substantial rewrite: define each readout and operator in one sentence at first use, walk through one cell end to end, and redraw the key results with plain labels.
Questions for authors
Q1 to Q4 concern the core soundness problems, and answering them would require substantial new experiments. Q5 and Q6 affect my confidence in the reported numbers. Q7 and Q8 are lower priority.
Q1. For each relation, what pattern of E1 and E2 results would falsify it? For capability selectivity, why does an ASR reduction under a constrained CSS point support a capability constraint, and why does IH (easier selective suppression plus an ASR reduction) not count against it?
Q2. Can you intervene on the source representation instead of the directive content, e.g., move the external-slot state along the source-probe direction toward and away from "trusted", or swap source-bearing residuals between the E and T slots, and show that , PAS, and ASR respond? How does SAG behave on legitimate tasks where the user asks the agent to follow instructions found in external content? How do you rule out that the source probe reads the role tag or position rather than perceived authority (cf. Ye et al., ICML 2026)?
Q3. Please report the full gate pattern (target response, utility, four-control specificity) for the non-mapped operators in every cell. Given that SPS lowers Gemma/MP ASR about 2.5 times more than CSS, why attribute Gemma/MP to capability selectivity rather than safe-candidate priority?
Q4. How do the evidence states change under other thresholds (e.g., at .40/.60/.75, difficulty at .15/.25, PAS bound at .05/.10) and other stratifications? What are the confidence intervals of the Gemma/TC mild and severe SMDs, and does the Gemma/TC versus Qwen/TC distinction survive?
Q5. Please explain: (i) why benign retention is exactly .960 and general damage .030 or .040 in all six CSS cells for both models (Table 11), and why the Gemma and Qwen MP grids have nearly identical BR and identical GD values (Table 18), i.e., whether these are computed separately per model; (ii) how E1 intervals only .003 to .01 wide (e.g., HS .379 [.377, .380]) arise from 150 to 200 tasks, while the intervals are about 5 to 16 points wide; (iii) why SAG at dose .20 on one layer pushes far below the data-like control (to -.272 and -.258), when even full subtraction would naively bring it only to about zero; and (iv) how the 400 and 300 tasks per family were derived from AgentLAB's 644 test cases, and whether tasks share templates. Do the anonymized artifacts include per-task raw records sufficient to recompute the main tables?
Q6. Is there a timestamped external record (e.g., an OSF registration or a commit hash predating the confirmation runs) that verifies the "registered" and "frozen" settings?
Q7. Do first-action reductions persist over full AgentLAB horizons, and how is first-action success defined for tool chaining, where single calls are meant to look benign? Why does the CPSep AgentLAB screen use a uniform 7-turn cap and a 1-to-5 judge instead of AgentLAB's per-attack budgets and success criterion? Are the screen and confirmation models the same checkpoints (Qwen3.5 MP is 0% Raw in Table 8 but 16% in Table 2)? Which scaffold, system prompt, reasoning-mode setting, and attacker were used in the confirmatory runs, and are the Table 23 operator layers shared across both models?
Q8 (suggestion). Applying TASD-CME to at least one existing defense, such as AgentLAB's Repeated Prompt or DeBERTa detector, or SecAlign/PromptArmor on AgentDojo, would directly answer the title question.
Satisfactory answers to Q2 to Q5 would be the minimum for me to reconsider. Given how much new experimentation they require, I do not think the paper can reach the bar for ICLR in this cycle.