- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates anomaly information in the routing and hidden states of frozen multimodal MoE models. It reports concentrated anomaly-related expert activity, channel-level alignment, and targeted expert-knockout effects. RoMod combines pseudo-label-based layer selection, routing-driven multiplicative channel modulation (RoMF), and a temporal network (RoTN), trained using 5% of weakly labeled videos. On XD-Violence, UCF-Crime, and UBnormal, the offline variant reports 92.49% AP, 91.32% AUC, and 79.17% AUC, respectively. The validation includes module and fusion ablations, supervision-budget studies, alternative backbones, and a causal-attention streaming variant.
Critical strengths
- Routing is developed into a practically useful feature source, with controlled same-backbone evidence. RoMF raises XD-Violence AP from 84.87% to 90.95% without RoTN, and Appendix E.1 compares it with routing-only, concatenation, additive fusion, and FiLM. These comparisons support an improvement beyond merely using a stronger backbone.
- The diagnostic study connects expert activity to downstream representations through complementary measurements and interventions. Appendix B includes channel alignment, another architecture, and targeted versus random knockout. This makes the analysis more informative than an expert-activation visualization alone, while still leaving room for a more carefully matched intervention control.
Critical weaknesses
- The claimed cross-domain advantage of the fusion mechanism is not directly demonstrated. Appendix E.1 interprets a larger operator gap on UBnormal as transfer evidence, but the reported models use each dataset's own weak supervision; Appendix E.2 instead tests native zero-shot backbone outputs. Separate in-domain training on visually different datasets does not establish source-to-target transfer of RoMF or prove that concatenation transfers poorly. This weakens a central explanation of why the proposed constraint is useful.
- The headline superiority and label-efficiency comparison do not isolate representation quality from the proposed method. Prior baselines use different feature extractors, and the paper explicitly lacks a same-backbone hidden-only temporal baseline trained with all weak labels (Appendix G). The dense reference also changes both architecture and readout. The existing ablations establish a conditional gain on this backbone, but support a narrower conclusion than a controlled advantage over competing training regimes.
Questions for authors
- Do any reported fusion experiments train on one dataset and evaluate on another without target training labels or target-specific fitting? If so, please identify the source, target, selection procedure, and corresponding results; otherwise, can the cross-domain claims be restricted to the evidence actually reported?
- How does a hidden-only temporal model on the same frozen backbone perform when trained with 5% and 100% of weak labels under the same selection and smoothing protocol? These results would determine how much of the headline advantage belongs to routing modulation.