- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper compares different jailbreak guardrails of embodied agents with the same backend LLMs (GPT-4o and DeepSeek-V3.2). The paper first defines the benchmark dimensions, including (a) intervention phase; (b) decision mechanism; (c) input modality; and (d) replanning capability. It then runs experiments on SafeAgentBench with 6 guardrail frameworks. Experiment results show several observations and insights: (1) visual information leads to worse guardrail results (Llama Guard 3 and EMBGuard); (2) better defense compromises usability; (3) interception at the planning/control stage (more downstream) induces higher latency; and (4) rule-based has lower latency compared with LLM or agent-based guardrails.
Critical strengths
1. Comprehensive evaluation of the existing jailbreaking guardrail framework.
I appreciate the author's effort in conducting this scale of experiment and also the engineering efforts.
The paper provides a comprehensive evaluation of 6 jailbreaking guardrails with fixed LLM models (GPT-4o and DeepSeek-V3.2). The experiment results are discussed in detail. It's also interesting to see that "adding vision information to the guardrails harms the performance", which is the most interesting finding of this paper.
However, with that being said, I think the paper has critical weaknesses, as discussed below, which make it difficult for me to flip the decision even with this strength.
Critical weaknesses
1. The findings and insights are mostly expected and show limited significance.
The paper discusses several insights (Section 4.3); however, most of them are expected (not surprising or significant to a broader ICLR audience).
-
The defense-usability insight is a well-known trade-off in the area. A guardrail showing better defense capability brings down the clean task performance is already a well-known issue, broadly beyond jailbreaking embodied agents, including adversarial robustness [1] and LLM safety [2], etc. Therefore, this insight adds little new knowledge to this community.
-
Similarly, the insight that "guardrails focused on planning/action have higher latency" is also largely expected: guardrails check every action of the embodied LLM, which naturally requires more compute and thus is slower than guardrails that check at a higher abstraction level. The insight that "Rule-based guardrails are faster than LLM-based guardrails" is even more straightforward.
The finding that "vision harms guardrail performance" is the most interesting one, but I have concerns related to the rigor of this finding (discussed below)
2. The rigor of the claim and insight is questionable, and most of the insights are hypotheses without further evidence.
-
First, the rank in Figure 2 takes the average of different metrics (e.g., bypass rate, false positive, etc.). It looks problematic to me to simply average those metrics numerically because they are computed in different ways, with different scales (even with normalization), and some have strong correlations (e.g., bypass rate and hazard success rate). Therefore, any insight drawn from this ranking is also questionable.
-
Second, the paper claims "vision harm guardrails": EMBGuard (
T+V) < EMBGuard (T) and Llama Guard (T+V) < Llama Guard (T) based on the above rank. Since the rank itself is not rigorous, so do the conclusion. For example, EMBGuard (T+V) shows a much lower false positive rate and a higher completion rate than EMBGuard (T). How the ranking is averaged largely influences how the results are interpreted. Also, Llama Guard is not designed for embodied agent tasks; thus, it's unknown how solid the conclusion drawn from it is. -
Additionally, the insight section has a lot of hypotheses (e.g., "we attribute xxx to yyy", "one possible explanation...") from the main results without further analysis. A concrete example is at Line-401: The paper claims "including vision dilutes attack signal from instruction" without showing further evidence, such as guard model attention scores; at Line-406, the paper claims "embodied guardrails inherit this fragility", a claim largely beyond what the results can support.
Therefore, I think the paper is not publication-ready for ICLR and can be further improved by (1) providing more interesting insight discussion by digging into the results more and (2) revising or justifying why the current rank is scientifically rigorous in Figure 2.
Reference
[1] (ICLR'19) Robustness May Be at Odds with Accuracy
[2] (ACL'24) The Art of Defending: A Systematic Evaluation and Analysis of LLM Defense Strategies on Safety and Over-Defensiveness
Questions for authors
Please see the suggestion above.