- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper introduces CIAware-Bench, a benchmark for evaluating whether language models can recognize interventions in their own execution trajectories. The benchmark considers scenarios where an external control mechanism replaces an acting model's output or action with content generated by another model.
The evaluation covers 13 acting models, eight intervening models, and four environments: Essay, BigCodeBench, Bash Arena, and SHADE-Arena. Intervention awareness is measured primarily through AUROC, obtained by explicitly prompting models to determine whether their execution histories have been modified.
The paper additionally investigates style imitation, reasoning visibility, alternative control protocols, and the consequences of providing explicit intervention feedback. A separate experiment reports an increase in side-task success from 37% to 48% when the acting agent receives notification that a previous action was blocked and replaced.
Critical strengths
- A potentially important distinction in the AI-control threat model.
Knowing that a monitoring system exists is different from recognizing that a particular action has been blocked or replaced. The latter may reveal information about the monitor's behavior and potentially enable adaptive attacks.
Investigating this distinction is reasonable and may help characterize the capabilities of increasingly sophisticated agents.
- Broad experimental coverage.
The benchmark evaluates multiple frontier models across diverse task environments, including coding, writing, and multi-step tool-using agents.
The experiments involving style imitation, reasoning visibility, and different intervention protocols provide useful observations about possible intervention-detection signals.
- Some meaningful diagnostic findings.
The paper highlights the distinction between ranking-based discrimination and actual binary intervention detection.
For example, Astra achieves an AUROC of approximately 0.91 on BigCodeBench but still classifies 68% of intervened examples as clean.
The BigCodeBench evaluation also uses a relatively well-controlled single-step comparison between the acting model's original solution and the replacement model's solution.
Critical weaknesses
- Insufficient justification for the necessity and practical significance of the proposed benchmark.
I question the practical necessity of evaluating intervention awareness as a standalone capability.
Recent AI-control research has already investigated adaptive adversaries that know the monitoring protocol and actively attempt to circumvent it. For example, Adaptive Attacks on Trusted Monitors Subvert AI Control Protocols (ICLR 2026) directly evaluates adaptive attacks against known monitoring mechanisms. Reliable Weak-to-Strong Monitoring of LLM Agents (ICLR 2026) studies the effect of agent monitoring awareness, while Instrumental Monitor Evasion Emerges Under Ordinary Task Pressure (2026) demonstrates that agents can attempt to evade runtime monitors when oversight obstructs task completion.
The manuscript acknowledges relevant recent work, so my concern is not an outdated literature review. Rather, it is unclear what additional security-relevant information CIAware-Bench provides beyond existing adversarial control evaluations.
In conservative AI-control settings, one can already assume that the untrusted agent knows the monitoring protocol or even possesses perfect intervention awareness.
Under this assumption, why is it necessary to separately measure whether an agent can retrospectively identify a substituted action?
The paper does not sufficiently explain how its benchmark results would change the design, deployment, or security evaluation of a control protocol.
- The measured intervention-awareness capability is not convincingly connected to actual control evasion.
The paper implicitly motivates a sequence of capabilities:
- Recognizing that an intervention occurred.
- Inferring properties of the monitoring mechanism.
- Adapting behavior to circumvent the monitor.
However, these are distinct capabilities, and the paper does not establish a reliable relationship between them.
CIAware-Bench primarily measures whether models can identify an intervention when explicitly prompted to inspect their execution histories. Such detection may rely on stylistic differences, implementation choices, or trajectory inconsistencies.
A high AUROC does not necessarily imply that an agent would spontaneously recognize an intervention during normal execution, infer the monitor's internal rules, or successfully evade the control protocol.
More importantly, the paper does not demonstrate that models with higher intervention-awareness scores achieve higher adaptive attack success rates under otherwise comparable conditions.
Without establishing this relationship, the benchmark's predictive value for actual AI-control security remains unclear.
- The multi-step evaluation contains a significant experimental confound.
The construction of clean and intervened trajectories is not properly matched in the multi-step settings.
According to Section 3.3 and Appendix A.1, clean trajectories in Essay, Bash Arena, and SHADE-Arena terminate immediately before step t, whereas intervened trajectories include the replacement step t and, where applicable, its tool results.
Consequently, the two classes differ not only in intervention status but also in observable trajectory length and execution progress.
A model may exploit these differences when answering the intervention-detection question without actually recognizing a meaningful inconsistency in the origin of an action.
The appropriate comparison should use the acting model's original step t as the clean condition and the intervening model's replacement step t as the intervened condition, while preserving identical preceding histories and matched step positions.
Although the paper includes additional controls, such as Defer-to-Resample, these experiments do not fully eliminate the confound in the main multi-step evaluations.
This issue directly weakens the validity of the reported intervention-awareness measurements.
- The intervention-feedback experiment does not establish a causal relationship between spontaneous awareness and control evasion.
The paper reports that side-task success increases from 37% to 48% when an acting model is explicitly informed that its previous action was blocked and replaced.
However, the intervention-feedback condition directly provides information about the monitoring system and encourages the agent to pursue an alternative strategy.
The observed improvement may therefore result from explicit feedback, behavioral guidance, or the additional information supplied to the model.
It does not demonstrate that the agent's independently measured intervention-awareness capability causes an increase in attack success.
Furthermore, the feedback experiment evaluates a different acting model and does not establish a quantitative relationship between CIAware-Bench AUROC and subsequent evasion performance.
A more convincing evaluation would compare agents under otherwise identical conditions while separately controlling intervention notification, disclosure of blocked actions, and explicit instructions to change strategy.
- The operational interpretation of AUROC requires stronger justification.
AUROC measures a model's ability to rank clean and intervened examples across classification thresholds.
However, the operational significance of intervention awareness depends on whether the agent actually recognizes an intervention and changes its behavior.
The substantial discrepancy between AUROC and binary intervention-detection rates suggests that the current metric may overstate the practical reliability of this capability.
Moreover, comparative uncertainty is incompletely characterized because many model-pair experiments reuse underlying tasks while bootstrap procedures operate independently across cells.
The paper should provide more realistic operating-point measurements and stronger statistical controls before drawing broad conclusions about differences in intervention awareness across model generations.
Questions for authors
-
Necessity: What additional security-relevant information does CIAware-Bench provide compared with existing adaptive AI-control evaluations that already assume the attacker knows the monitoring protocol? Can the authors identify a concrete control-policy decision that would change based on the proposed benchmark?
-
Predictive validity: Is intervention-awareness AUROC correlated with actual adaptive attack success or degradation in control safety? Does it provide predictive information beyond model capability and existing monitor-evasion benchmarks?
-
Online awareness: Can models recognize interventions spontaneously during ordinary execution without being explicitly prompted to classify their histories? If so, does this recognition change subsequent tool calls or attack strategies?
-
Experimental validity: Can the authors rerun the multi-step experiments with clean and intervened trajectories matched in length, intervention position, and preceding execution history?
-
Causal analysis: Can the authors isolate the effects of intervention notification, blocked-action disclosure, and explicit behavioral guidance in the side-task experiments?
-
Practical evaluation: Can the authors compare control safety under otherwise identical conditions with no intervention feedback, neutral notification, spontaneous recognition, and complete intervention disclosure? This would help clarify the operational significance of intervention awareness.
5 comments
continuation
Q5/6/W4 Intervention feedback. We agree with the reviewer that the intervention-feedback experiment in Appendix B does not establish a causal link between spontaneous awareness and downstream evasion rates, as it does not measure an agent's intrinsic propensity to evade after spontaneous awareness. To address this, we now explicitly clarify in the manuscript that our evaluation focuses on prompted awareness, leaving the study of spontaneous awareness to future work.
We selected DeepSeek for the intervention-feedback experiment because it readily pursues side tasks. Currently, we cannot establish a direct quantitative link between CIAware-Bench scores and control-evasion rates because high-scoring frontier models are closed-source and refuse side-task instructions due to safety alignment, though we expect this to change as capable open-source models catch up.
The primary goal of our benchmark is to inform frontier labs to rigorously evaluate this capability with results of Appendix B intended to provide supporting context for the importance of intervention awareness in AI Control, rather than serving as the paper's core evaluation.
Per reviewers request, we have now updated Appendix B with a neutral condition to explicitly isolate strategy changes. Without encouragement to “change strategy” the DeepSeek model achieves 43% side task success (vs. 37% no notice baseline), whereas with encouragement to change the action it achieves 48% side task success. We hope that addresses reviewer’s concerns regarding capability isolation in Appendix B experiments, and we are happy to provide further experimental evidence for relevance of the intervention awareness for control deployments.
W5: A binary answer depends on how the wording of the prompt calibrates the model. With our prompts, Astra is very conservative and never flags a clean trajectory in the multi-step settings. With a threshold chosen in the model's favor, Astra's balanced accuracy rises (e.g., from 0.71 to 0.84 on Essay). We chose to report AUROC as the main metric to obtain a conservative estimate without the need to fix a threshold. A threshold-free metric is less sensitive to the wording of the probe (see our response to reviewer Wd5u).
Regarding uncertainty, the intervals in the submitted version resample pairs within each model pair and do not account for tasks that are shared across model pairs. We now resample tasks instead, so that a task is drawn once for all model pairs of an acting model. This makes the intervals of the model means about 1.5 times wider. The conclusions are unchanged. We have updated all error bars in the revised version accordingly.
—
We thank the reviewer again for their constructive feedback and hope our answers clarify their questions. We would be grateful if the reviewer would consider updating their score. We would be happy to answer any follow up questions.
I appreciate the authors' detailed response and additional experiments. The length-matched controls and the neutral intervention-feedback condition address some of my methodological concerns and improve the credibility of the empirical findings.
However, my primary concern regarding the necessity and scientific significance of this work remains unresolved. The main finding is that newer frontier models exhibit substantially stronger intervention awareness than older models. While this is an interesting empirical observation, it may be a transient capability difference as models continue to improve. The paper does not establish a sufficiently generalizable insight into the underlying mechanisms of intervention awareness or its implications for AI control.
More importantly, the authors acknowledge that they cannot establish a direct quantitative relationship between CIAware-Bench scores and actual control-evasion performance. The additional feedback experiments demonstrate that providing intervention information can influence agent behavior, but they do not establish that the capability measured by the proposed benchmark predicts real control failures.
Furthermore, the authors suggest that control evaluations should assume perfect intervention awareness. If this is the appropriate conservative assumption, it remains unclear what additional actionable information is provided by measuring the exact awareness levels of current models.
Overall, while the rebuttal strengthens the experimental evidence, I remain unconvinced that the proposed benchmark offers a sufficiently significant and lasting research contribution beyond documenting capability differences across model generations. I therefore maintain my score.
We thank reviewer ezdc for their thorough and constructive review of our paper. We are happy to address the raised points in the following.
Q1/W1: We would like to highlight a difference in studied phenomena across the three papers you mentioned. In Terekhov et al. and Kale et al., awareness of the monitor is given to the model through prompting, and the main object of study is the untrusted model’s attacking capability given monitor awareness. Schmotz et al. (concurrent) study monitor evasion capability with a retained intervention in the trajectory (which, in terms of our paper, amounts to perfect CI awareness). We would argue that these settings are significantly different from capability to recognise interventions that we study in this work, and actionable insights it gives. CI awareness differs strongly between models, with most older models near chance and Astra far above chance. Control evaluations should therefore assume perfect CI awareness and test whether protocols remain effective under it. On this point, no prior work has measured the effects of CI awareness on attack success. Through thorough ablations in Appendix B we show that this raises side-task success and thereby affecting deployment security. We also suggest that protocol developers should deploy countermeasures such as style imitation and other methods (e.g. style uniformization with style guides) to decrease CI awareness. Last, CI awareness raises the larger question of whether a misaligned model can be steered toward benign answers and actions if it can detect these attempts.
Q2/3/W2 Spontaneity: We are making the assumption of a maximally misaligned model (as is typical in AI control research for conservative estimates) and hence we chose to use a prompt to probe the model. We agree that measuring whether a model recognises interventions spontaneously is very interesting and relevant to realistic deployment scenarios, but lies out of scope of our work. Evaluating spontaneous awareness raises new challenges as spontaneous mentions would depend on not only the capability of whether the model can notice it but also on its propensity to do so (and require access to raw reasoning, which is unavailable for the current most CI-aware models). Given the evaluation awareness of models and at times even obsessing with the grader due to RL, we think it is reasonable to directly prompt the model. We made this more clear in the revision.
Q4/W3: Our setup has a length difference between clean and intervened trajectories to avoid any confounders in the side-task setting, while keeping the setup consistent. With side-task and equal length, the acting model could achieve perfect control intervention awareness score by simply making its prediction based on whether the side task is present or not. However, given that all main results of the paper are in a setting without side-task, we agree that a length matched control is insightful. We ran additional experiments for Astra in the Essay, SHADE-Arena and Bash settings. (The BCB setting is a single step setup and therefore always length matched.)
We see that the length has a very small effect on the results. Matching the length changes Astra's AUROC by at most 0.03. The decrease on SHADE-Arena comes mainly from the calendar reminder task, where step t is often the step that sends the reminder emails and a probe after this step is more likely to say that there was an intervention. Other than this case the AUROC values and binary classification changes only marginally showing that the original benchmark design is defensible.
continuation in next response