- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses a critical methodological concern in video anomaly detection research: whether above-chance probe scores on frozen video features genuinely indicate that the representation captures anomaly semantics. The authors propose a benchmark-audit protocol that incorporates four low-dimensional controls (scene complexity, video identity, position in video, and detected-agent counts) with scene-grouped folds, paired rows, and video-clustered uncertainty. The protocol is applied to a frozen V-JEPA 2 encoder over UCF-Crime and NWPU-Campus datasets. Key contributions include: (i) a reusable control protocol for diagnostic probes, (ii) evidence that simple controls, readout selection, and aggregation materially change conclusions on two surveillance corpora, and (iii) an artifact-backed reporting discipline that separates diagnostic probing from native anomaly detection and temporal anticipation. The paper's central finding is that a pre-event video-level diagnostic reaching AUROC 0.899 on UCF-Crime reflects video identity rather than temporal anticipation, and that object counts serve as a strong comparator under certain readouts yet fail under the benchmark's native protocol.
Critical strengths
- The paper carefully separates diagnostic probing, native anomaly detection, and anticipation, which are often conflated in the literature.
- The paper addresses a fundamental issue in how the community interprets probe scores, which has implications for a broad range of video understanding research.
- The finding that a linear probe on the first encoder window achieves AUROC 0.899 on UCF-Crime, and that object counts can rival learned representations under specific readouts, provides valuable cautionary evidence.
Critical weaknesses
- The evaluation is restricted to only two surveillance datasets (UCF-Crime, NWPU-Campus) and a single frozen encoder (V-JEPA 2). This narrow scope limits the generalizability of the conclusions.
- The paper does not include comparisons with recent state-of-the-art anomaly detection methods, such as those based on large language models, diffusion models, or other self-supervised approaches
- The paper does not deeply analyze why the frozen representation fails to beat control variables, nor does it investigate how different layers of the encoder, different pooling strategies, or fine-tuning might change the results.
Questions for authors
- How do you reconcile the claim that video identity is a strong predictor with the practical AD use case where models must generalize to new scenes?
- Have you tested whether other recent video encoders (e.g., VideoMAE, InternVideo, etc.) show different patterns? Would your conclusions hold for contrastive or reconstruction-based encoders?
- Could you provide more analytical discussion of what kinds of anomaly signals are preserved vs. removed?
- How sensitive are the conclusions to the choice of anomaly score aggregation?
- How do you address the concern that your control variables (e.g., object counts) may themselves be legitimate anomaly signals in real surveillance scenarios?