- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3(+1)
- Soundness
- 3(+1)
Read review
Paper summary
This paper introduces DisCo, a novel weakly supervised video anomaly detection (WSVAD) framework that employs knowledge distillation from a pretrained vision–language model (VLM). Based on observations from two widely used video anomaly detection benchmarks, UCF-Crime and XD-Violence, the authors identify complementary characteristics between motion-based anomaly detection and VLM predictions. They exploit this discrepancy to estimate the utility of VLM supervision and selectively distill semantic knowledge into a WSVAD model. Experimental results demonstrate substantial improvements over existing baselines in terms of Average Precision (AP) on both UCF-Crime and XD-Violence, providing empirical support for the effectiveness of the proposed selective distillation strategy. If the authors adequately address all the concerns raised in the Weaknesses section, I would be willing to increase my score.
Critical strengths
S1. Strong empirical performance with extensive ablation studies.
The proposed method demonstrates substantial improvements over existing baselines on both UCF-Crime and XD-Violence, particularly in terms of Average Precision (AP). The authors also conduct extensive ablation studies to investigate the effectiveness of individual components, including utility-based event selection, knowledge distillation strategies, and different teacher and student architectures. These experiments provide convincing evidence of the method's effectiveness on the evaluated benchmarks.
S2. Interesting motivation based on complementary characteristics of motion-based and semantic representations.
The observation that motion-based WSVAD models and VLMs exhibit complementary strengths in detecting different types of anomalies is interesting. The proposed strategy of selectively distilling semantic knowledge based on this discrepancy offers a potentially useful direction for improving WSVAD while retaining lightweight inference.
Critical weaknesses
W1. Insufficient evidence supporting the central motivation. (resolved)
The discrepancy between motion-based predictions and VLM confidence is central to this paper, yet the supporting evidence remains limited. Figures 1 and 4 mainly demonstrate this behavior on UCF-Crime, while Figure 2 shows category-wise performance differences rather than directly validating the proposed relationship.
I would raise my score if the authors could provide further quantitative evidence, particularly on XD-Violence, demonstrating that semantic-motion conflict reliably identifies beneficial distillation opportunities.
W2. Limited generalizability across teacher–student combinations. (resolved)
Although Appendices C.2.5 and C.2.7 provide some evidence of generalizability, I remain unconvinced that DisCo consistently works beyond the InternVL3-14B and UR-DMU combination. In particular, the improvements with alternative VLM teachers are considerably smaller.
I would consider raising my score if the authors could provide more systematic evidence across different teacher–student combinations.
W3. Dependence on event-level supervision and computational cost. (minor)
The framework relies on known event categories to estimate teacher utility and selectively distill knowledge. I question whether this approach remains effective under heavily imbalanced or evolving anomaly distributions, as commonly encountered in practice. Although Table 4 partially addresses this concern, the robustness of event-level selection remains unclear.
Additionally, offline VLM inference requires substantial computational resources, which may limit practical adaptability.
W4. Poor presentation and insufficient methodological justification. (resolved)
The introduction has significant presentation issues that substantially weaken the paper's overall impression. The authors repeatedly describe their methodological choices as "natural" without sufficiently explaining the underlying rationale. In particular, the motivation for combining VLMs with motion-based WSVAD models through knowledge distillation is not convincingly developed, despite being central to the proposed framework.
Furthermore, the distinction from previous work and the rationale for selecting UR-DMU as the primary student are insufficiently explained. Given the considerable unused space in the manuscript, I expected a more thorough introduction that clearly establishes the motivation, contributions, and methodological choices.
Although the experimental results are compelling, the weak presentation makes it difficult to fully appreciate the significance of the proposed approach. A substantially improved introduction would positively influence my assessment.
Questions for authors
See weaknesses.
4 comments
W2. Limited generalizability across teacher–student combinations:
Please refer to our response to Reviewer fBk7, W3.
We conducted experiments with different teacher models using event-specific prompts (our final configuration) and also evaluated vanilla KD with these teachers. Moreover, our method generalizes to feature families beyond I3D, such as CLIP, and also provides additional gain from other distillation-based methods (DAKD and -VAD) as reported in the table below.
Table 11. Compatibility of DisCo with different top- MIL-based weakly supervised methods. Encoder denotes the student inference encoder. Performance is reported in AP (%).
| Method | Encoder | Additional Supervision | UCF-Crime Original | UCF-Crime + DisCo | UCF-Crime Gain | XD-Violence Original | XD-Violence + DisCo | XD-Violence Gain |
|---|---|---|---|---|---|---|---|---|
| UR-DMU | I3D | None | 35.48 | 42.29 | +6.81 | 79.14 | 85.96 | +6.82 |
| VadCLIP | CLIP | Text Semantics | 33.55 | 40.15 | +6.60 | 84.50 | 86.07 | +1.57 |
| PE-MIL | I3D | Semantic Prompt Learning | 33.41 | 38.81 | +5.40 | 87.27 | 89.06 | +1.79 |
| -VAD | I3D | Multi-encoder KD | 33.99 | 38.54 | +4.55 | 82.65 | 86.64 | +3.99 |
| DAKD | I3D | Multi-encoder KD | 29.41 | 37.36 | +7.95 | 83.71 | 86.83 | +3.12 |
W3. Dependence on event-level supervision and computational cost
Both UCF-Crime and XD-Violence have unequal video counts across event categories. To assess selection robustness, we vary event-level imbalance on UCF-Crime from 1:1 to 5.1:1 (largest-to-smallest category ratio). Table 12 reports results using fixed utility-estimation budgets of 351 (27 per category, matching the smallest original category) and 500 videos. We recompute event selection under each distribution while keeping student training unchanged.
Table 12. Robustness of DisCo under varying event-class imbalance on UCF-Crime. OR denotes overlap with the event selected by DisCo on full training videos.
| Budget | Distribution | Imbalance | OR (%) | AP (%) |
|---|---|---|---|---|
| 351 | Balanced | 1:1 | 80.8 | |
| 351 | Mild | 2.0:1 | 79.6 | |
| 351 | Moderate | 3.0:1 | 78.1 | |
| 351 | Severe | 5.1:1 | 73.9 | |
| 500 | Balanced | 1:1 | 84.7 | |
| 500 | Mild | 2.0:1 | 86.1 | |
| 500 | Moderate | 3.0:1 | 82.5 | |
| 500 | Severe | 5.1:1 | 78.2 | |
| DisCo (full data, 810 videos) | 100 | 42.29 | ||
| Vanilla KD | – | 35.94 | ||
| Baseline | – | 35.48 |
Across different imbalance levels, DisCo maintains over 70% selection overlap with the full-data reference, retaining approximately 4–5 of the six reference events on average. Although reducing the utility-estimation data affects selection stability and performance, DisCo consistently outperforms vanilla KD (35.94% AP) across all evaluated settings. Under the strongest imbalance (5.1:1), where some categories contain as few as 12 videos for utility estimation, DisCo achieves 38.65% and 37.77% AP with 351 and 500 videos, respectively, exceeding vanilla KD by 2.71 and 1.83 points.
Our analysis considers changes in the frequency of known event categories. For settings without event labels or with evolving anomaly types, DisCo can instead group videos by clustering VLM-generated segment descriptions. This fully event-agnostic variant (Table 4 of the main paper) still achieves 39.27 AP, compared with 35.48 for the baseline and 35.94 for vanilla KD.
Computational cost: The VLM inference cost is a one-time offline pre-processing step, with teacher predictions computed and cached before student training. Once pre-processed, the VLM is not required during each student training iteration. Crucially, after training the student model, DisCo requires no additional VLM inference overhead at test time or in its regular deployment. Thus, the computational expense is confined to offline knowledge extraction, while deployment retains the efficiency of the original lightweight student model.
The total GPU-hours required for different teacher models are reported below.
Table 13. Approximate offline VLM inference cost for five runs on UCF-Crime.
| Teacher | GPU-hours (5 runs) | Seconds/ segment | Seconds/ video |
|---|---|---|---|
| InternVL3-14B | 54 | 0.58 | 48 |
| InternVL3-9B | 24.6 | 0.27 | 21.8 |
| LLaVA-NeXT-Video-7B | 20.6 | 0.22 | 18.3 |
| Qwen3-VL-8B | 17.4 | 0.19 | 15.5 |
W4 Presentation: We have substantially revised the introduction (highlighted in blue in the revised manuscript, including Figure 2), particularly the motivation for complementary VLM–WSVAD learning and the rationale for selective knowledge distillation, following the analysis presented in our response to W1.
Thank You for the Thorough Rebuttal!
Thank you for the comprehensive rebuttal and substantial revisions.
I have carefully reviewed the additional experiments and revised manuscript. All of my original concerns (W1–W4) have been satisfactorily resolved. I appreciate the authors' efforts in strengthening the paper.
I am therefore increasing my rating from 2 to 3 (Weak Accept) and remain open to further upward revision during the discussion period.
Good job, and good luck with the rest of your research!
Thank you!
Thank you for your valuable feedback and for taking the time to carefully review our rebuttal. The additional experiments and analyses you suggested have helped strengthen our paper. We greatly appreciate your positive reassessment of our work and decision to increase the rating. Thank you again for your support.
We would like to thank Reviewer Xj2m for reviewing and providing feedback on our work.
W1. Quantitative evidence supporting the central motivation:
We present analysis on test dataset in Table 10 to quantitatively validate our central motivation on both XD-Violence and UCF-Crime. We use the utility score (Cr) (Eq. 7) as the quantitative measurement for semantic-motion conflict (the same metric we use to select the event categories) for this analysis to demonstrate that it reliably identifies the gaps in the MIL-based learning that can be mitigated by VLM's semantic knowledge.
As discussed in the paper, the MIL-based learning overlooks subtle anomalies with low-motion changes, and this is where VLM's semantic knowledge is helpful. Table 10 reports recall for such low-motion segments i.e.segments whose motion change is below the median value. In the Table, UR-DMU represents MIL-based learning model, used as a base model in our paper.
Table 10. Recall on low-motion anomalies across semantic–motion utility groups on XD-Violence and UCF-Crime. Bold values indicate the better performance between the VLM and UR-DMU. Values in parentheses indicate gains over UR-DMU.
(1) MIL-based learning struggles with low-motion anomalies. UR-DMU achieves only 15.7% and 64.1% recall on low-motion anomalies in UCF-Crime and XD-Violence, respectively, highlighting the difficulty of detecting subtle anomalies using motion-dominated MIL supervision.
(2) VLMs provide complementary semantic evidence. On these low-motion anomalies, the VLM achieves higher recall than UR-DMU on both datasets: 33.2% vs. 15.7% (+17.5 points) on UCF-Crime and 70.1% vs. 64.1% (+6.0 points) on XD-Violence. These results quantitatively support our motivation that VLMs can recognize semantically identifiable anomalies that motion-based learning may overlook.
(3) Semantic–motion utility identifies useful VLM evidence.
On XD-Violence, for videos with the top 20% utility scores, the VLM's recall is higher (89.4%) than UR-DMU (76.1%), indicating that transferring knowledge from the VLM could be beneficial. However, for videos with the bottom 20% utility scores, the VLM's recall is lower (35.0%) than UR-DMU (48.2%), suggesting that knowledge transfer may be less beneficial in such cases. Similarly, on UCF-Crime, the VLM's recall is substantially higher (84.6%) than UR-DMU (39.7%) for the top 20% utility group, while for the bottom 20%, its recall is very low (3.8%), indicating that the VLM provides limited reliable supervision in such cases. This indicates that higher utility scores are associated with more informative VLM supervision, supporting their use for identifying beneficial distillation opportunities.
(4) DisCo improves low-motion anomaly detection. DisCo increases overall low-motion anomaly recall over UR-DMU by 11.3 percentage points on XD-Violence (64.1% to 75.4%) and 14.2 points on UCF-Crime (15.7% to 29.9%). Importantly, in the top-utility groups, DisCo improves recall by 14.4 points on XD-Violence and 10.3 points on UCF-Crime, demonstrating improved detection in regions where the VLM provides complementary semantic evidence.
Interestingly, DisCo also improves recall in low-utility regions, particularly on UCF-Crime (+24.2 points). Our category-level analysis indicates that this improvement arises predominantly from Arson videos, despite Arson being excluded from direct event-wise distillation due to a lower utility score. One possible explanation is that distillation on selected categories such as Explosion enables the student to generalize shared visual patterns, such as fire and smoke, to related Arson.
Moreover, we have also revised Figure 4 to include the relationship between anomaly score and motion on XD-Violence.