- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper argues that existing jailbreak attacks optimize for refusal avoidance rather than harmful output. This causes semantic drift: a query like “how to make a bomb” mutates into a benign variant such as “how to make a bomb chicken,” which avoids refusal but yields harmless content. The authors further argue that reported ASR mainly reflects agreement between the supervisor used during search and the evaluator used for scoring, rather than whether outputs are actually harmful.
Critical strengths
Strength 1: Clear diagnosis of semantic drift. The paper shows concretely, through the “bomb → bomb chicken” examples and the decomposition in Eq. 3, that refusal-avoidance objectives can evade safeguards while producing harmless output. Why it matters: This is a real weakness of keyword-based search signals, and the framing is useful. However, it overlaps substantially with PAIR, TAP, and StrongREJECT, which limits its weight.
Strength 2: Consistent empirical gains. Swapping in a harmfulness discriminator improves GCG, AutoDAN, and BEAST on all 12 models, raising average ASR from roughly 63–72% to about 89.5%. Why it matters: This is the paper’s strongest evidence that the search signal matters more than the search algorithm. Its weight is reduced by the shared reliance on human annotation for both the supervisor and the evaluator, and by the missing comparison to existing judge-guided attacks.
Critical weaknesses
Weakness: None of the three main contributions is new.
- Refusal avoidance ≠ harmful output (semantic drift). That non-refusal does not imply harmful content is well known. StrongREJECT (Souly et al., 2024) explicitly studies such "empty jailbreaks," and HarmBench (Mazeika et al., 2024) adopted a harmfulness classifier instead of refusal keywords for the same reason.
- Harmfulness-guided attack search. Using a judge's harmfulness score to guide jailbreak search is already standard practice in PAIR (Chao et al., 2023) and TAP (Mehrotra et al., 2023). Neither is compared against experimentally.
- Red/blue arms race with a surrogate discriminator. Training a surrogate model through queries to attack a black-box defender is the classic substitute-model attack (Papernot et al., 2017). Iterative red/blue co-evolution for LLM safety is also explored in MART (Ge et al., 2024).
Why it matters: With all three ideas already established, the paper's contribution reduces to applying known techniques to older refusal-based attacks. Without comparisons to these works, that is not a sufficient advance for acceptance.
Questions for authors
I would like to ask the author to explain more about the novelty of the claim in this paper.