- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper raises an interesting question: can AI-generated video detectors trained today reliably detect videos produced by the next generation of AI models? To address this question, the authors first establish the generalization limitations of existing detectors through evaluation on large-scale datasets. They then use these findings to guide the design of a new detector. Extensive experiments support the paper’s motivation, substantiate its claims, and evaluate the effectiveness of the proposed method.
Critical strengths
1 A key contribution of the paper is its extensive empirical support for an intuitive observation: detector performance varies substantially across groups of future generators, and many methods exhibit an overall decline over time. In light of these findings, the proposed benchmark has considerable practical value.
2 The proposed method is based on findings from extensive experiments, and the ablation studies further support its effectiveness.
Critical weaknesses
1 Generalization is a challenge across many research areas and is particularly pronounced in AI-generated video detection. Approaches such as online and continual learning have been developed to address this challenge. Could the authors clarify whether the proposed method offers a more effective solution than these approaches?
2 The paper’s methodological contribution appears somewhat limited, as the proposed method seems to be a straightforward combination of existing techniques. The paper might present a more focused research narrative by concentrating on introducing the benchmark and systematically analyzing the decline in detection performance on future generative models.
Questions for authors
1 Although the proposed method demonstrates effectiveness, is it a suitable approach to addressing generalization challenges, particularly compared with techniques such as continual learning?
2 Could the strong performance of the proposed method be primarily attributed to its use of a stronger backbone or other recent advances?