- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes TrendGuard, a pre-generation safety detector for multimodal large language models. It uses sparse probes on last-token residual and MLP representations to obtain layer-wise unsafe scores. Two variants classify these scores: Trend-Abs combines absolute scores, adjacent-layer differences, and trend statistics, while Trend-Rel measures relationships to class-conditional prototype trends. Experiments across seven backbones and four unsafe benchmarks report strong detection under a low false-positive constraint.
Critical strengths
1. Practical pre-generation detection. TrendGuard operates on frozen backbones during prompt prefill, enabling intervention before response generation. The lightweight probes and classification heads introduce little overhead in the reported throughput experiment.
2. Broad empirical coverage. The evaluation includes multiple model families, attack benchmarks, and benign datasets. The consistently high detection rates across the tested backbones provide evidence that the framework is applicable beyond a single architecture.
Critical weaknesses
W1. The paper doesn't show why the full layer-wise trajectory is needed. Figure 1 shows that safe and unsafe class-mean probe scores separate more with depth. That fits a simpler story just as well: deep layers carry the safety signal, so one well-chosen deep layer or an ordinary multi-layer classifier would be enough. The method trains a separate probe per layer and then hand-builds features on the scores (adjacent differences, onset, persistence, and so on). I don't see what this buys over, say, training a classifier on the concatenated layer scores, and the paper doesn't compare against such baselines.
W2. The gains are hard to credit to trend modeling specifically. Per-sample layer shuffling (Table 5) destroys both the order of the layers and which layer each score came from, so its drop to 2.56% may come from losing layer identity rather than depth dynamics. Also, in Table 5 the attack FNRs of Trend-Abs and Scores-only are nearly the same (all at or below 0.02%). The real difference is MM-Vet FPR (1.37% vs. 4.13%) at a fixed threshold t = 0.5, which could be a calibration difference rather than a better detector. Comparisons at matched FPR, and against stronger multi-layer baselines, would make the case much more convincing.
Questions for authors
Q1. How does TrendGuard compare with (a) the best single deep-layer probe picked on validation data and (b) a standard multi-layer classifier, such as logistic regression or a small MLP on the concatenated layer scores? "Last-layer only" and "Selected mid-late layers" in Table 5 partly cover (a); (b) is missing.
Q2. Does Trend-Abs still beat Scores-only when both are evaluated at the same benign FPR? Could you also add a control that keeps layer identity but breaks depth order, for instance a single fixed permutation of layers applied to every sample before computing the trend features? That would separate the effect of depth dynamics from that of layer identity.
Q3. All unsafe training data come from JailBreakV (600) and all safe data from MM-Vet (218) (lines 319-322). The guard could be learning "looks like JailBreakV vs. looks like MM-Vet" instead of unsafe vs. safe. How do you rule this out? Results on matched safe/unsafe pairs that share format and image source would help. Also, is the reported MM-Vet FPR computed only on MM-Vet examples that were not used for fitting or model selection?
Q4. Each layer has its own independently trained probe, so scores at different layers may differ in scale or calibration. How do you know the trend reflects the safety signal changing with depth, rather than differences between probes? Do the trends and the gains survive per-layer calibration (e.g., temperature scaling each probe on validation data)?
Q5. The robustness test lowers unsafe scores by δ = 0.2 on 8 of the 28 layers. That is a feature-space perturbation, not an attack anyone could actually run. How does TrendGuard hold up against an adaptive image-text attack that optimizes the input to fool both the guard and the underlying LVLM?
We clarify what the Scores-only ablation measures and add comparisons with LoD and One-head.
W1
Scores-only in Table 5 is already a direct baseline based on concatenating scores from multiple layers. It retains all probe scores in layer order, concatenates them, and feeds them to an MLP, omitting differences between adjacent layers and statistical features. On Qwen2.5-VL-3B, the full Trend-Abs method has an average error rate of 0.28%, compared with 0.83% for Scores-only.
W2&Q2
We used widely adopted methods as references to make comparisons easier. Thank you for your feedback. The code for Learning to Detect Unknown Jailbreak Attacks in Large Vision-Language Models became available relatively late. We have added these experimental results and compared performance using the metric from that paper. We will include the results in the final version. We reproduced and evaluated LoD and One-head. We sampled 1,000 examples from each of the datasets we used to form a combined dataset of 3,500 examples and compared them with our method on Qwen2.5-VL-3B. The evaluation metric is TPR at FPR < 0.05. Our method outperformed both methods. The released One-head code supports only LLaVA-1.6. We adapted it to Qwen2.5 following the paper's description and found that it generalized very poorly, producing a very high misclassification rate on Qwen2.5. To ensure a rigorous comparison, we also evaluated One-head on LLaVA-v1.6-Vicuna-13B. One-head relies on a single critical attention head with limited capacity to capture safety signals, which makes it less able to generalize to different attack types. As a result, the signal from a single head is insufficiently stable across datasets under a strict low-FPR constraint.
Qwen2.5-VL-3B
LLaVA-v1.6-Vicuna-13B
The TPR evaluation requires FPR < 0.05, so the One-head decision threshold was raised to 5.5. We also evaluated it at the fixed threshold of 0.3 specified in the paper.
Q1
The Scores-only ablation in Table 5 was designed to distinguish explicit cross-layer trend features from simple multilayer score aggregation. Scores-only and the full Trend-Abs method use the same frozen backbone, the same layer-wise safety probes, and the same ordered safety scores from all decoder layers. Scores-only concatenates the layer-wise scores and feeds them to an MLP. Trend-Abs additionally includes changes between adjacent layers and statistics such as onset, persistence, peak location, and late-layer correction. Scores-only is therefore already an order-preserving multilayer score aggregation baseline that retains all multilayer information and layer positions. We may have explained the purpose of this experiment unclearly in the paper. We will clarify the definition of Scores-only and the rationale for the experiment. Selected results from Table 5 are shown below. All rates are in percent.