- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates how downstream VAD processing reshapes the anomaly-scoring behavior of pretrained VLMs. Through cue-level, stage-wise, and temporal analyses across multiple models and datasets, the authors examine which scoring behaviors are preserved or modified.
Critical strengths
The paper conducts extensive experiments across a diverse set of VLM backbones, VAD methods, and benchmark datasets. The evaluation covers multiple aspects of anomaly-scoring behavior, providing a systematic empirical analysis beyond conventional detection performance metrics.
Critical weaknesses
1. Unclear motivation and practical implications. The term "VLM" is overly broad, as this work specifically focuses on generative, GPT-like multimodal models. More importantly, although the authors investigate how anomaly-scoring behavior changes from pretrained VLMs to downstream VAD systems, the motivation behind this question remains insufficiently justified. It is unclear how answering it could benefit practical VAD development or contribute to theoretical understanding.
2. Limited informativeness of the findings. The main conclusions are largely descriptive and lack clear, generalizable insights. For instance, the finding that cue-score associations may be preserved, weakened, reversed, or newly introduced depending on the VLM and VAD method is rather inconclusive. Despite extensive experiments, the paper provides limited explanations of why these changes occur or what meaningful insights can be drawn from them.
3. Insufficient rigor in matched-pair construction. The matched-pair strategy only controls a few coarse contextual factors, such as anomaly status, people count, scene category, and motion level. It does not ensure that the target cue is the primary difference between paired segments, as other factors such as lighting, backgrounds, and additional semantic cues may vary substantially. These uncontrolled differences could confound the observed cue-score associations, undermining the reliability and interpretability of the conclusions.
Questions for authors
-
What concrete theoretical or practical benefits can be gained from understanding how downstream VAD processing reshapes pretrained anomaly-scoring behavior?
-
Can the authors identify any consistent and generalizable insights beyond the observation that different VLM-VAD combinations produce different scoring behaviors?
-
How can the authors ensure that the observed cue-score associations are not confounded by uncontrolled differences between matched video segments?