- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper asks whether a safety evaluation under benign conditions can stand in for a direct adversarial robustness evaluation. Six open instruction-tuned models (2B-8B) are scored with a benign composite (AHHH, the mean of helpfulness, harmlessness and honesty scores from an LLM judge) and with an assistant-prefill attack on 315 harmful requests, summarized by a robustness AUC over prefill lengths of 0-20 tokens. For four of the models the authors also run a three-round retry test and a transferred GCG suffix (100 prompts). The model orderings under these measurements do not coincide, e.g. Qwen3 has a higher AHHH than Qwen2.5 but lower prefix robustness, and Qwen2.5 drops from second to fourth under GCG. The prefix ordering is stable across seven grids, and the GPT-4o harm judge is checked against 240 human labels (accuracy 0.87).
Critical strengths
The paper is careful about what it measures. The claims are restricted to the tested models and conditions, missing judgments are tracked and not imputed, and the judge is calibrated against human labels, with the weaker agreement on the multi-round examples reported openly. I also found the grid analysis useful: the ordering under the prefix attack does not change across the seven grids while the AUC value changes by up to 50%, which is a good reminder not to compare such numbers across papers.
Critical weaknesses
-
The main message is already well accepted, and the evidence here is narrow. That a model which behaves well on benign prompts can still be jailbroken, and that robustness depends on the attack, is the starting point of the jailbreak literature (HarmBench, JailbreakBench, etc.). What this paper adds is a rank comparison among six small models (four for the GCG and retry parts), with one prefill attack and one transferred suffix whose success rate is only 1-18% on 100 prompts. The authors themselves describe the results as "finite counterexamples". I did not learn much beyond what I would have expected. There is also no method here. A large part of the paper is about bookkeeping (pinned revisions, missingness bounds, complete-case vs available-case sets, seven grids, hashes), and two of the four listed contributions are of this kind. This is good practice, but it is not a research contribution by itself.
-
I am not convinced that the benign composite is a meaningful "benign safety" measure. Harmlessness is at or near the ceiling for all six models (4.80-5.00 in Table 2), so it cannot order them. The key counterexample (Qwen3 vs Qwen2.5) comes from helpfulness (4.28 vs 1.94) while both have harmlessness 5.00. So what is shown is that a helpfulness-driven score does not predict prefill robustness, and I don't think anyone would expect it to. It is also not clear where the benign prompts and the prefill targets come from; the paper says their source and authorship cannot be recovered.
And, by the way, the paper is a little bit hard to follow with such amount of self-clarification. It seems the author had relied too much on large language models while writing.
Questions for authors
- Does the conclusion hold if the benign measure is harmlessness only, or a standard benign safety benchmark, instead of the AHHH composite?
- Why is the helpfulness of Qwen2.5-7B so low (1.94 out of 5)? Is this a judge or truncation issue?
- For the prefill attack the judge sees the prefill together with the continuation. How much of the measured success comes from the supplied target tokens themselves?