- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
AI-generated video detection (AIGVD) is an important research topic today. However, existing methods may exploit shortcuts introduced by preprocessing, such as duplicated frames caused by temporal resampling. This raises concerns about whether these methods capture the intrinsic characteristics of AI-generated videos. To investigate whether temporal information contributes to AIGVD, the authors conduct targeted controlled experiments, revisit the role of temporal modeling, and propose a decomposition hypothesis to reassess temporal detection methods.
Critical strengths
1 The paper identifies a key phenomenon in AIGVD and raises a thought-provoking research question that offers valuable insights. The topic is both novel and practically useful.
2 The paper presents extensive, targeted experiments that support its central arguments, making the study coherent, comprehensive and interesting.
Critical weaknesses
The experimental details in the current version require further refinement. Only a small number of videos remain after filtering, raising concerns about the generalizability of the findings and potential selection bias. Could excluding very short clips affect the results, given that their stylistic characteristics may differ substantially from those of longer videos? These concerns limit the justification for a higher rating.
Questions for authors
The reduction in sample size after filtering raises concerns about potential selection bias. Evaluating the proposed approach on the excluded short videos would help assess its applicability to real-world data. If such an evaluation is infeasible, could the authors explain the constraints and their implications?
3 comments
Thank you for the response. My main concerns have been addressed, and I maintain my positive rating.
Thank you for your positive feedback. We sincerely appreciate your constructive comments and support.
Response to Reviewer UQ8m
Response: We thank the reviewer for raising this concern and agree that evaluating the excluded short videos is important for assessing the generalizability of our findings. Our original experiments follow the shortcut-controlled protocol of Michels et al. (2026). Note that the MSR-VTT real videos released with GenVideo are only 3 FPS; we replaced them with their original high-frame-rate source videos, so real videos are not removed due to frame rate. Under this protocol, 14.45% of the GenVideo test videos are excluded.
To examine whether this filtering affects our conclusions, we further adopt a relaxed 1-second, 8 FPS protocol, which keeps the frame interval unchanged and only shortens the duration. Under this protocol, only 0.09% of the videos are excluded, covering nearly all previously excluded short clips, including HotShot, a generator entirely excluded under the original protocol due to its short video duration.
As shown below, each step of the progressive analysis consistently improves AUC on all eight generators, raising the overall AUC from 0.799 to 0.942, comparable to 0.949 under the original protocol. This indicates that our main findings do not depend on the original filtering condition and remain valid when short videos are included.
Moreover, HotShot directly corresponds to the case raised by the reviewer: as its videos are all shorter than 2 seconds, it was entirely excluded under the original protocol and may differ stylistically from longer videos. Even on HotShot, each step of the progressive analysis consistently improves AUC, from 0.593 to 0.859, further confirming the applicability of our findings to short videos. The full results have been added to the manuscript (Appendix D.8, marked in blue).