- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes benign-side adaptation poisoning. Attacker only submits harmful queries wrapped in benign framings. Defender’s weak-labeler committee naturally mislabels some as safe. These mislabeled rows enter periodic fine-tuning and teach guard to ignore this framing. With 25 poison rows on ShieldGemma-2B, framed-harmful detection drops sharply while benign false-positive rate stays zero. Authors test dose, stealth, blind transfer, generality across guards and pools, pacing, margin mechanism, and defenses. They propose PTF and GGF attack variants and ACLF defense. Validation uses open-weight guards, public query pools, 3 seeds, and a primary adaptation recipe with additional ablations.
Critical strengths
(1) The threat model is novel and minimal: attacker only submits prompts, and poison labels are not injected or flipped but come from defender’s own weak labelers. The permission matrix clearly separates this channel from prior poisoning. If true, it exposes a shared risk of self-adapting guardrails in the labeling loop, so it is consequential.
(2) The mechanism analysis is useful: decision margins cross the boundary while weight displacement remains relatively stable, and ACLF calibrates loss threshold on trusted anchors to remove poison rows. This links attack to a practical defense and gives a concrete lever for defenders. These strengths do make sense because they initate a new attack surface and a testable defense, not just one more jailbreak.
Critical weaknesses
1.The critical weakness is evidence does not support production-level claim enough. The headline dose-25 attack is dose-parameterized, but authors’ own full-stream window shows simple-framing attack is completely neutralized, and professional-task attack only partly survives. So main result may be upper bound, not realistic damage. Stealth claim also relies on two model-generated and model-certified 320-item benign sets, not standard public benchmarks, and only a small number of seeds with very large variance. Zero false positive and collapse numbers are not robust enough. Defense comparison is only in same small pipeline.
2.A secondary weakness is presentation: some figures have text/line overlap and are hard to read, and appendix is split into too many small sections, which makes paper fragmented. This is not main rejection reason but lowers quality. Also, the paper gives inconsistent statements about code availability, leaving it unclear whether the implementation can be inspected during review.
Questions for authors
- Can you report benign false-positive rates on standard public benign benchmarks, beyond the two self-generated 320-item sets, and provide more seeds and confidence intervals for the reported E2 drops?
- In the full-stream realistic window, what is the end-to-end practical damage of PTF? Since simple-framing is neutralized and dose-parameterized results are upper bounds, should the full-stream results, rather than dose-controlled results, be the headline?
- How sensitive are conclusions to the adaptation recipe (last two layers, 100 steps, lr 1e-5, 40 anchors, committee composition)? Would standard full fine-tuning close the channel, and how do the stronger-labeler results limit the generality claim?
2 comments
Thank you for the newly added experiments and analysis. However, my concern remains that the paper's novelty is not competitive enough compared to the ICLR bar. As a result, I will keep my original score.
Response to Reviewer DVyJ: Public Benchmarks, More Seeds, and Recipe Sensitivity
Thank you. All results and text changes in this response are included in the revised PDF uploaded with this rebuttal (changes marked in blue).
Q1 (Benign FPR on public benchmarks; more seeds; CIs). Every headline arm is now scored on XSTest [1] and OR-Bench [2], and FPR is reported against the matched clean arm, because both the unadapted guard and the clean adaptation loop over-refuse public benign prompts (XSTest 0.136 and 0.399; OR-Bench 0.029 and 0.151). No attack arm rises above its matched clean arm; the rate falls, because poisoning makes the guard less strict:
On seeds, the dose-25 E2 drop over five seeds is 62.2±35.7pp (per seed 97.5/61.2/97.5/37.5/17.5; all at least 17.5pp, none with an FPR rise), and we report this spread openly.
Q2 (Full-stream damage of PTF; should full-stream be the headline?). Yes, the revision leads with the full-stream window and labels dose-controlled arms single-window upper bounds. Against matched clean arms the professional-task channel loses 42.6±22.1pp (per-seed attack 0.442/0.025/0.325 against clean 0.688/0.704/0.679; absolute five-seed E2_tvd 0.33±0.21), while plain and 12-family detection stay at 0.988 and at or above 0.963. Against the unadapted guard, the reduction is partial in some seeds. The simple-framing attack is fully stopped in the same window (E2 = 1.00, 3/3 seeds), and that null result is the main reason the mislabel rate, rather than dose, becomes the headline. A sweep at a fixed 200-submission quota locates where the window's defense disappears: E2_tvd moves from 0.727±0.085 at r_eff near 0.04 through 0.341±0.140 near 0.16 to a 0.23 to 0.27 plateau at or above 0.28.
Q3 (Recipe sensitivity; would full fine-tuning close the channel?). The paper already compares four mechanisms and sweeps the lr-by-pacing surface. W1 also noted that the defense comparison lives in the same pipeline, so we re-ran ACLF under full-parameter fine-tuning: it still removes all 25 poisons in 3 of 3 seeds (E2 1.0/1.0/1.0 against 0.0/0.075/0.0 unfiltered), so the defense is not tied to the last-two-layer recipe. The remaining arms:
Standard full fine-tuning therefore does not close the channel (three seeds, so evidence rather than a final limit), and a committee with one strong member that catches close to 100% of the reachable framings is safe by design.
W2 (presentation), plus the claims-framing part of W1. Accepted. The upper-bound and seed-variance parts of W1 are answered in Q1 and Q2, and the defense-scope part in Q3. In the revised PDF the abstract leads with the full-stream result, the appendix is merged into four parts, and the code is provided in the Supplementary Material.
References
[1] Röttger et al., XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models, NAACL 2024.
[2] Cui et al., OR-Bench: An Over-Refusal Benchmark for Large Language Models, ICML 2025.