- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a training-free framework combining video anomaly detection and understanding through active observation and two-level semantic feedback. Starting from URF-HVAA predictions, frozen vision-language models describe adaptively selected frames. These descriptions guide video-level score modulation and visually verified local refinement. Experiments report improvements on several VAD benchmarks.
Critical strengths
- Separating global semantic interpretation from locally verified refinement addresses the risk of applying descriptions without sufficient temporal evidence.
- The framework integrates pretrained models and existing detector predictions without additional model-weight optimization.
Critical weaknesses
-
Temporal localization benefits require more direct evaluation. Table 4 reports additional AP gains from local feedback, and Table 5 shows increased separation between normal and anomalous regions. However, these results do not fully distinguish improved temporal localization from score recalibration. Per-video localization metrics or event-level temporal overlap analysis would more directly substantiate the claimed benefit.
-
Dependence on initial predictions. Local verification operates at the window level, while anchor promotion favors existing high scores. The minimum retrieval score of 0.50 may exclude missed anomalies and leave incorrectly high-scoring normal anchors eligible for reinforcement.
-
Unclear detection benefit of active observation. Although description quality improves, URF-HVAA descriptions yield comparable detection results, particularly on UCF-Crime. A comparison with one-shot ATS descriptions under identical feedback would better isolate the benefit of adaptive observation.
-
Unclear parameter-selection protocol. Appendix D provides sensitivity analyses but does not specify how final parameters and rules were selected. The absence of weight training alone does not establish independence from evaluation annotations.
Questions for authors
- Were annotations or evaluation-set results used to select feedback parameters, lexical rules, or thresholds?
- Can local feedback recover anomalous intervals below the initial retrieval threshold?
- Could tied scores introduced by Eq. (4)’s peak-score floor cause Eq. (5)’s quantile-based promotion to reinforce more anchors than intended?
- How does one-shot ATS compare with active observation under the same feedback pipeline?
2 comments
Active observation under identical feedback
Unclear detection benefit of active observation. Although description quality improves, URF-HVAA descriptions yield comparable detection results, particularly on UCF-Crime. A comparison with one-shot ATS descriptions under identical feedback would better isolate the benefit of adaptive observation.
How does one-shot ATS compare with active observation under the same feedback pipeline?
To evaluate the detection benefit of active observation, we compared feedback using one-shot ATS and active-observation descriptions on UCF-Crime, with feedback parameters and verifier settings held fixed.
Table 1. Downstream detection on UCF-Crime using ATS and active-observation descriptions. Scores are percentages; bold and underlined values indicate the best and second-best results, respectively.
| Configuration | UCF AUC ↑ | UCF AP ↑ |
|---|---|---|
| URF-refined base | 84.356 | 36.164 |
| Feedback with ATS descriptions | ||
| Feedback with active-observation descriptions | 86.246 | 38.363 |
Under identical feedback settings, active-observation descriptions outperform one-shot ATS by 1.790 percentage points in AUC and 1.348 in AP on UCF-Crime. This shows that the benefit of active observation extends beyond description quality to downstream anomaly detection.
Use of evaluation annotations and results
Unclear parameter-selection protocol. Appendix D provides sensitivity analyses but does not specify how final parameters and rules were selected. The absence of weight training alone does not establish independence from evaluation annotations.
Were annotations or evaluation-set results used to select feedback parameters, lexical rules, or thresholds?
Test-set results were used to select the URF-HVAA feedback configuration shared across all evaluated datasets. We constructed the anomaly vocabulary from UCF-Crime class names, using ChatGPT to expand them with synonyms and related expressions. The vocabulary was not adjusted based on evaluation results.
To assess whether the improvements depend on the exact selected values, we subsequently conducted one-parameter-at-a-time sensitivity analyses. For example, AUC and AP on UCF-Crime and XD-Violence exceed the URF-refined base at every tested value of the peak minimum from 0.25 to 0.80, with the other parameters held fixed. These results show that the gains are not confined to the exact reported configuration. The sensitivity results are summarized in the General response under “Parameter selection and sensitivity”.
Quantile ties and number of promoted anchors
Could tied scores introduced by Eq. (4)’s peak-score floor cause Eq. (5)’s quantile-based promotion to reinforce more anchors than intended?
Yes. At a quantile of 0.85, the tie-inclusive rule promotes 29.13% of anchors on UCF-Crime and 33.68% on XD-Violence, exceeding the nominal 15%.
To assess whether resolving these ties improves detection, we evaluated a variant that breaks ties using the scores before peak-score flooring. The table reports changes relative to the original tie-inclusive rule in percentage points.
Table 2. Effect of breaking floor-induced ties using the original scores. Changes are tie-breaking minus the original rule, in percentage points.
| Dataset | Δ AUC | Δ AP |
|---|---|---|
| UCF-Crime | +0.015 | -0.427 |
| XD-Violence | -0.028 | -0.826 |
Breaking ties lowers AP on both datasets, while producing only small changes in AUC. These results support retaining the original tie-inclusive promotion rule. We will clarify that the quantile defines a score threshold rather than a fixed promotion quota.
Temporal localization versus score recalibration
We measured temporal overlap separately in each test video at the same score threshold (0.5) for both methods. We computed IoU separately for normal and anomalous frames, averaged the two IoUs within each video, and gave every video equal weight, including normal-only videos. Full feedback increased temporal mIoU from 72.69% to 72.90% on UCF-Crime and from 63.88% to 64.74% on XD-Violence. Thus, the predicted regions overlap the ground truth more closely at this threshold. Appendix A (p. 14) of the revised paper gives the metric definition.
Retrieval thresholds, missed anomalies, and incorrect promotion
Local feedback can increase scores within an anomalous interval even when individual anchors initially score below 0.50. The 0.50 threshold filters candidate windows. If a window passes retrieval and visual verification, anchors inside it can be promoted when their current scores meet the local quantile criterion. An interval outside all such windows receives no direct local update.
To test whether verification limits incorrect reinforcement, we compared local feedback with verification disabled and enabled:
Verification reduced promotion counts more in normal than in anomalous regions: 37.65% versus 10.88% on UCF-Crime and 23.25% versus 6.89% on XD-Violence. Figure 4 of the revised paper (Appendix A, p. 13) compares frame-level precision and recall. On both datasets, the full method achieves higher precision than the URF-refined base over broad portions of the recall range.