- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The idea of this paper is to have an agent generate trajectories and then have a gate decide for each action whether the action complies with some safety specification. The trajectories are collected without the gate. This compliance information is then used for fine-tuning the agent to adhere to the specifications. The gate remains active at deployment. The main contribution is this fine-tuning. Specifications are generated via an anonymous paper.
Critical strengths
S1: The evaluation is carefully designed to separate the impact of different learning variants. S2: The information required for retraining is cheaply obtainded from a running agent as the gate anyway needs to be in place.
Critical weaknesses
W1: The newly presented methodology is thin. Retraining an agent to reduce the intervention of a safety mechanism is not a majorly new idea. W2: The bibliography of the paper is rather short. I briefly investigated whether further relevant literature exists and quickly came across the following:
- Ta, Anh, Junjie Zhu, and Shahin Shayandeh. "Reinforced Agent: Inference-Time Feedback for Tool-Calling Agents." Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM). 2026.
- Agarwal, Aradhye, et al. "Learning when to act or refuse: Guarding agentic reasoning models for safe multi-step tool use." arXiv preprint arXiv:2603.03205 (2026).
- Mu, Tong, et al. "Rule based rewards for language model safety." Advances in Neural Information Processing Systems 37 (2024): 108877-108901.
- Guan, Melody Y., et al. "Deliberative alignment: Reasoning enables safer language models." arXiv preprint arXiv:2412.16339 (2024).
Questions for authors
- What is the relation to the literature named above, and is there a reason for the short section on related work?
- Why did you not compare with other baselines? One could consider other types of defenses.