- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Amplify to Detect, a frozen-model intervention for multimodal jailbreak detection. It places multiplicative scalers on the output channels of a VLM’s linear projections and scores each channel by the first-order sensitivity of a paired harmful–benign refusal-margin objective to that scaler. The top positively scored channels are amplified by a factor 1+ε, and the resulting hidden states are fed to existing detectors without retraining the VLM. Across LLaVA-1.6, Qwen2.5-VL, and InternVL3, amplification improves AUROC in all cases and TPR@5% in nearly all; the largest gains are for the weak HiddenDetect baseline. Direction and selection ablations show that reversing the sign reverses the effect and that random or weight-magnitude selection does not help, while the refusal-margin score does.
Critical strengths
S1. A clean, well-motivated formulation. Casting channel selection as a signed first-order sensitivity of a harmful–benign refusal margin is simple, principled, and connects naturally to the SNIP/pruning literature. Scoring whole projection-output channels rather than individual weights is a sensible unit of attribution.
S2. The intervention is cheap and modular. The method keeps the VLM frozen, adds no trainable parameters to the backbone, and plugs into existing hidden-state detectors without changing their training or scoring. This makes it easy to adopt and a reasonable complement to detector design rather than a replacement.
S3. Informative and honest ablations. The signed-direction control, the matched-random and magnitude baselines, and the layer/strength sweeps isolate where the effect comes from and show it is not a generic perturbation. The Limitations section is unusually candid about what the method does and does not establish.
Critical weaknesses
W1. The headline gains may be an artifact of a weak base detector. The large improvements are concentrated on HiddenDetect, whose original TPR@5% is very low (18.9–40.4). A plain logistic-regression probe on the original representations already reaches 84.6–92.2 TPR@5%, higher than amplified HiddenDetect, and barely moves after amplification. So the intervention mostly lifts a weak detector toward the level of a trivial strong baseline, rather than advancing the state of the art; the paper should argue what amplification buys over simply using a better detector.
W2. The causal framing is overstated. The paper repeatedly claims safety signals can be “causally strengthened,” but all evidence is that amplifying a refusal-margin proxy raises a downstream detection score. The signed-direction result (reversing ε reverses the effect) is a mathematical consequence of the first-order expansion, not independent evidence of causality, and the paper itself concedes that improving the margin does not establish safer generation. The claims should be scoped to detection separability.
W3. The effect is model- and layer-dependent, undermining generality. On InternVL3 the intervention can reduce both AUROC and TPR@5%, and the gains depend strongly on the (ℓa, ℓd) pair, with the AUROC-optimal pair differing from the TPR-optimal one. Without a model-agnostic rule for choosing these, “consistent improvement” is hard to sustain.
W4. Narrow evaluation and no adaptive attack. Evidence comes from three open 7–8B models, one detector split, and 355 attribution pairs, with the 65 held-out pairs testing transfer only within the same source. There is no adaptive-attack evaluation and no measurement of benign task quality, false refusals, or inference cost. For a safety-detection method, the absence of an adaptive attacker that knows which channels are amplified is a significant gap.
W5. Formatting and reporting issues that should be fixed. In Table 1, the KCD entries overrun the column boxes. These same KCD TPR@5% figures have standard deviations larger than their means (9.67 ± 15.50, 22.56 ± 38.93, 33.07 ± 38.22), meaning the detector is close to random across the five seeds. Separately, the Figure 7(a) caption labels the amplification factor “g” while the text and equations use ε; the symbol should be made consistent.
Questions for authors
Please refer to weaknesses.