- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work presents Vigil, a VLM‑based online video anomaly understanding system. It uses decoder causal attention for temporal modeling and a verdict‑first paradigm to get anomaly scores directly from token logits, paired with KV‑cache reuse for streaming inference. Though practically motivated, the work has incremental novelty, relies heavily on dense annotations, leaves critical failure modes unaddressed and uses unfair comparisons.
Critical strengths
-
The work points out a real pain point of existing two‑stage video anomaly understanding pipelines: detection and explanation come from different model states, which causes inconsistency. It provides a simple way to unify scoring and description within one single forward pass.
-
KV‑cache reuse for streaming video is practically useful, it reduces redundant computation for overlapping frames and supports low‑latency inference for edge‑side surveillance scenarios.
Critical weaknesses
-
This paper mostly assembles existing components for the target task and delivers limited innovation. For example, reading classification scores from LLM logits, utilizing decoder self‑attention for temporal modeling and KV‑cache reuse for multimodal streaming are all known techniques.
-
SOTA performance depends heavily on fine‑grained window‑aligned labels from HIVAU‑70k. Under video‑level weak‑supervision, performance degrades substantially. Cross‑domain transfer results also show poor generalization without target‑domain fine‑tuning, limiting real‑world deployment.
-
Two key failure patterns are only discussed but not mitigated. False alarms triggered by large normal visual motion, and missed subtle anomalies such as tiny low‑resolution weapons. These are critical pain‑points for surveillance applications.
-
Most compared online baselines are zero‑shot training‑free methods, while Vigil is fully supervised fine‑tuned. There are no controlled experiments running competing fine‑tuned VAU approaches on the identical backbone under matching online setup. It is hard to quantify how much gain comes from verdict‑first design instead of supervised finetuning or base model capacity.
-
The performance‑latency trade‑off brought by rotated KV‑cache reuse is not systematically quantified with ablations.
-
Despite the title referencing reasoning, the model only generates post‑hoc captions without explicit reasoning chains linking historical frames and current anomaly judgment.
Questions for authors
-
This paper emphasizes reasoning, but the model only generates descriptive captions after prediction, without reasoning steps linking history frames and current anomaly. How do you define reasoning in this manuscript? Why do you avoid inserting intermediate reasoning steps especially for low‑confidence windows?
-
Table13 shows description‑first setting yields worse result than verdict‑first. Is the performance drop mainly caused by hallucinations from self‑generated text, or other factors? Have you tried inserting short fixed prompt reasoning text between visual input and verdict instead of letting model generate open‑ended reasoning content?
-
See the above weakness about tther questions.
3 comments
5. Meaning of reasoning, historical evidence, and explanation faithfulness
By reasoning, we refer to forming an anomaly judgment from historical and current visual context, rather than explicitly generating a verified step-by-step reasoning trace. Natural-language descriptions follow the verdict and express the event content. We will clarify this usage to avoid suggesting that causal explanations or faithful chains of thought have already been established.
In the supplemental history experiments, using 8-second, 4-second, and 2-second histories reduces UCF AUC by 0.92, 1.23, and 1.90 percentage points relative to the default configuration; perturbing history reduces it by 1.74 points. These results support the contribution of historical information to judgment, but do not prove that generated descriptions expose every factor behind a decision.
Description quality is evaluated on the same fixed set of windows for all methods, rather than on different sets selected by each method's detections. This measures description capability on common inputs, not explanation faithfulness. We agree that a shared model state is not itself proof of faithfulness and will qualify the corresponding claims.
6. Verdict-first prediction, fixed-text prompts, and reasoning on uncertain windows
In Table 13, verdict-first achieves AP/AUC of 91.05/96.95 on XD-Violence, compared with 88.82/96.04 for description-first. Both settings include descriptions for normal windows, preventing label leakage through description presence. We acknowledge that the comparison does not fully separate content, length, verdict position, and hallucination, and will describe text interference as a possible mechanism rather than the sole established cause.
The direct motivation for verdict-first prediction is that routine anomaly scores can be obtained from first-position logits without decoding text beforehand. A fixed reasoning prompt is a useful additional control, but we have not conducted that independent experiment. We therefore draw no conclusion about its effectiveness and do not use the current results to reject all forms of prompting before the verdict.
Triggering additional reasoning for uncertain windows is also a reasonable extension and is discussed in the paper's future-work section. It requires a triggering policy and an evaluation of its accuracy and latency trade-off, and is not implemented in the current system. This work focuses on the basic unified path for detection and on-demand description.
7. Cache positional correction and the accuracy–efficiency trade-off
Section 3.4 describes an initial full prefill followed by reuse of overlapping visual KV states with positional updates and processing of newly arriving frames. The task suffix and generated responses are excluded from subsequent reuse, the cache is reset between videos, and a full refresh is performed every 20 steps. The main table uses this approximate cache configuration.
In the supplemental comparison, full prefill changes UCF AUC by −0.02 and XD AP by +0.08 relative to reuse on the percentage scale. Processing time per window decreases from 445 ms to 160 ms, approximately a 2.78× speedup. This supports the practical accuracy–computation trade-off of the default configuration. The 20-step interval is an empirical preset rather than an established optimum, and close aggregate metrics do not imply identical scores for every window.
Thanks for the authors' rebuttal, but my concerns have not been addressed, including the incremental novelty, reliance on dense annotations, and the use of unfair comparisons. Thus, I maintain the original score.
Response to Reviewer QKda
Thank you for recognizing the practical value of unified detection and explanation and streaming cache reuse. We take your concerns about novelty, supervision fairness, and generalization seriously. We clarify our contribution as a unified design for online anomaly detection and on-demand explanation, supported by its empirical results.
1. Novelty and contribution
We do not claim logits-based classification, decoder self-attention, or KV caching as individually new techniques. Vigil's contribution is their integration into a single model for online anomaly understanding: the existing decoder processes historical and current visual observations; first-position Normal/Anomaly logits provide a continuous anomaly score; descriptions can be generated from the same model state when needed; and streaming cache reuse reduces repeated computation over overlapping history.
This design supports routine detection without an additional detection head, temporal aggregator, or full text generation, while retaining on-demand explanation capability. We limit the performance claim to competitiveness under specified supervision and evaluation conditions, rather than novelty of each component or universal superiority over other approaches.
2. Fairness with respect to supervision, backbone, and target-domain fine-tuning
Our main contribution is a single model that combines competitive anomaly detection with on-demand explanations, achieving the best reported results among the methods compared in Table 2 under their respective settings. Beyond optimizing detection alone, Vigil retains the language-generation capability needed to describe anomalous events while using the same decoder for detection.
A pretrained decoder offers strong semantic understanding, but its pretraining is not specifically optimized for the temporal discrimination required by anomaly detection. Task-specific fine-tuning helps adapt these representations to anomaly scoring. We view this as a plausible explanation for the benefit of fine-grained supervision, rather than evidence that decoder-based temporal modeling is inherently inferior to I3D.
Under video-level supervision, Vigil still achieves 82.12 AP on XD-Violence, compared with 77.71 AP for online REWARD, showing that its utility is not restricted to fine-grained labels. We acknowledge that the cross-domain gap limits deployment without adaptation. Our claim is therefore a unified model offering strong detection performance and explanation capability under the stated training conditions, rather than domain-independent detection or supervision-free superiority.
Description training primarily aims to preserve explanation and language-generation capabilities, while freezing the vocabulary projection preserves the pretrained output space. Our experimental observation is that description supervision did not noticeably change detection performance, but this does not constitute a complete attribution study. A frame-supervised I3D comparison is currently running; we do not report unfinished results or claim that a fully matched backbone and training comparison has already been completed.
3. Cross-domain generalization and deployment scope
Table 6 reports transfer without training on the target domain: training only on UCF-Crime yields 72.49 AP on XD-Violence, while training only on XD-Violence yields 85.99 AUC on UCF-Crime. The corresponding target-domain training results are 91.00 AP and 90.42 AUC, respectively, showing the substantial impact of target-domain data.
We acknowledge that this limits direct deployment in new environments. Vigil does not solve open-world anomaly detection: the anomaly definitions and visual distributions in its training data affect its decisions. Joint training achieves 89.91 UCF AUC and 90.54 XD AP, showing that one model can cover these two benchmarks, but not establishing generalization to arbitrary unseen domains. We will qualify the manuscript's interpretations of transfer and pretrained capability and discuss adaptation to the deployment domain as a practical consideration and future direction.
4. Failure cases and possible mitigation
False alarms on normal scenes with large motion and missed detections of small or low-resolution weapons are important limitations. The former suggests possible confusion between motion patterns and learned anomaly cues; the latter suggests insufficient local visual evidence. We do not present these possible explanations as experimentally established mechanisms.
Adding targeted normal scenes with substantial motion and improving local-region or resolution handling are plausible future directions, but their benefits have not been validated in this work. We will present these cases as limitations and distinguish observed evidence from proposed improvements rather than imply that the failure modes have been resolved.