- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper targets an important problem. Namely, agents face changing risk taxonomies, and their actions need to be evaluated against user-supplied policies. The paper “AdaGuard: An Adaptive Guard Model with User-Defined Policies” makes three main contributions. First, it introduces the AdaptiveSafety dataset. It consists of 10,939 training and 1,000 test samples, which cover policies with 1–100 rules. The dataset is built from agent trajectories with policy and behavioral counterfactuals. Second, the paper introduces a GRPO-style objective called SafePO. Third, it develops AdaGuard, a family of guard models built using SFT followed by SafePO.
Critical strengths
- The dataset design targets an important problem, i.e., changing risk taxonomies. The dataset provides two kinds of counterfactuals. First, policy counterfactuals rely on changed rules and fixed behavior. Second, behavioral counterfactuals rely on fixed rules and changed actions or outcomes.
- The AdaGuard models developed in the paper perform strongly on the AdaptiveSafety dataset. In accuracy, they outperform competing models such as GPT-5.2 by 13 percentage points and DynaGuard-4B by 22 percentage points.
Critical weaknesses
- The paper lacks critical ablations and competing methods for SafePO. For example, the paper does not compare SafePO to GRPO under the same reward setting. Ablations for the value-guided modulation and region budgets are also missing.
- Table A4 compares SafePO against SFT using a different input-budget calculation and single runs which makes the gains against SFT hard to judge.
- On the DynaBench dataset (Table 1 and TableA1), DynaGuard-8b model and three API-based models (GPT-5.2, Gemini-3.1-Flash-Lite and Jev) outperform AdaGuard-8B. And AdaGuard-0.6B achieves only 51.38 percent accuracy.
- Section 3.1 does not specify whether the AdaptiveSafety dataset’s labels and test set were produced and validated by humans or an LLM. Moreover, the paper does not report agreement statistics.
Questions for authors
Please see the Critical Weaknesses section.
4 comments
We greatly appreciate your time and constructive feedback. Should you have any questions regarding our rebuttals, please feel free to contact us, we would be more than happy to discuss them with you and make further revisions as needed.
Thank you for the detailed response and the additional experiments. Overall, the responses address several of my concerns and provide useful additional evidence. In particular, the matched 8B controls and the description of the annotation pipeline are helpful. However, regional budgeting and value modulation each add only 0.1–0.3 points on AdaptiveSafety, and value modulation adds at most 0.37 points on DynaBench. Since no variance across seeds is reported, these gains cannot be separated from run-to-run variance. All AdaptiveSafety labels, including those in the test set, are LLM-generated. The reported agreement is between two LLMs, and no human validation is reported. I appreciate the authors’ efforts and will maintain my original rating.
Thank you for your thoughtful response and constructive suggestions. We continue to believe AdaGuard offers a useful contribution to agent safety through AdaptiveSafety, a dataset centered on user-defined policies, and guard models that assess agent behavior against those policies. We understand your remaining concerns and respect your decision, although we regret that the additional evidence did not change your assessment. Thank you again for your time and careful consideration of our work.
Rebuttal 1
We thank the reviewer for recognizing the importance of adaptive risk taxonomies, policy and behavioral counterfactuals, and AdaGuard’s strong AdaptiveSafety performance. Following the review, we conducted matched 8B controls and a comprehensive audit of the annotation pipeline.
Q1. What do the matched controls establish about SafePO?
A1. We evaluated all four checkpoints with identical examples, prompts, parsing, greedy decoding, and input/output budgets. The RL conditions share the same SFT initialization, training data, structured reward, group size, optimization budget, KL coefficient, and checkpoint-selection rule. Uniform GRPO uses whole-response token weights. Fixed-region SafePO uses a 1:2 analysis-body to structure-and-verdict budget without value modulation. Full SafePO additionally enables within-region modulation.
Uniform GRPO improves over matched SFT by 0.3 points on both AS metrics and by 0.73 and 0.92 points on DB accuracy and Set-EM. Fixed regional weighting adds 0.3, 0.3, 1.11, and 2.39 points. Learned modulation adds a further 0.3, 0.1, 0.37, and 0.19 points. The uniform-to-fixed comparison isolates regional budgeting, while the fixed-to-full comparison isolates value modulation. The value model is used only during training, so all variants retain the same inference architecture and cost. We will replace the historical comparison in Appendix A.4 with this matched experiment and add the exact seed and training-cost records.
Q2. How should the DynaBench results be interpreted?
A2. DynaGuard-8B reaches 80.11% binary accuracy and 77.31% violation-positive F1, compared with 76.80% and 76.05% for AdaGuard-8B. The three API systems obtain 80.85–83.61% accuracy. AdaGuard-8B has higher recall than DynaGuard-8B, 74.91% versus 68.91%, and additionally predicts the complete policy-local violation set with 70.72% Set-EM, whereas DynaGuard provides a binary interface.
The model-size trend is clear: DynaBench accuracy increases from 51.38% at 0.6B to 71.82% at 4B and 76.80% at 8B. Our revised conclusion is that AdaGuard-8B supports complete rule attribution beyond AdaptiveSafety and improves over its matched SFT initialization, while the strongest DynaBench systems retain higher aggregate binary accuracy.
Q3. Were AdaptiveSafety labels produced by humans or LLMs, and how were they checked?
A3. Both train and test reference labels were produced by an LLM-based annotation pipeline. The primary annotator received only the current policy and canonicalized interaction, without the inherited label, transformation name, or intended counterfactual direction. A different model then produced its assessment and conducted proposal-aware verification for omitted or unsupported rules, policy-local validity, analysis faithfulness, and evidence grounding.
Direct cross-model exact-set acceptance is 87.71% overall and 84.10% on the test set. Every retained positive rule is linked to supporting interaction content; all 17,350 pointers passed address validation, quoted-text occurrence, and positive-label coverage checks. We report this cross-model acceptance rate as the agreement statistic and explicitly identify the annotations as LLM-generated.
The split is lineage-disjoint. A base interaction and all associated policy, behavioral, and identifier variants remain in one split. Train-test overlap is zero for base identity, interaction-content, candidate, policy-content-pair, contrast-group, and reference-analysis hashes. All six data collections and nine construction categories are represented in both splits.
Thank you again for the careful review. We believe the matched controls, calibrated DynaBench interpretation, and explicit annotation audit directly address the principal concerns. We welcome further questions and would be grateful if the reviewer would reconsider the score in light of this evidence.