- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents FOVEA (Forensic Open-generator Video Evidence Acquisition), a training-free neuro-symbolic framework for detecting fully AI-generated videos from unseen generators. It combines VLM-based hypothesis formation and adaptive routing with deterministic CV measurements, including optical flow, frequency analysis, error-level analysis, temporal tracking, and geometric consistency. FOVEA reports 97.39% accuracy and 0.99 AUROC on GenVideo, outperforming the strongest supervised baseline in the reported setting. Additional experiments examine watermark removal, video duration, cross-benchmark transfer, backbone sensitivity, and component ablations.
Critical strengths
- FOVEA combines high-level VLM reasoning with explicit computer-vision measurements, providing a more interpretable alternative to relying solely on unconstrained VLM judgments. Its structured evidence records also facilitate tracing the basis of individual predictions.
- The reported results are strong, and the component ablations suggest that CV-based analysis and adaptive tool routing contribute substantially to performance.
Critical weaknesses
-
Incomplete validation of the core design choices. Although the paper provides component ablations, it does not sufficiently compare the proposed fusion and routing strategies against simpler alternatives, such as majority voting, fixed-weight aggregation, or running all analysts. Consequently, it remains unclear whether the reported gains depend on the specific proposed mechanisms or primarily result from combining multiple existing tools.
-
Limited evidence for cross-generator generalization. The decision process relies partly on VLM-generated confidence estimates and thresholds calibrated using only 100 labeled videos. High-confidence correctness on this calibration set does not establish calibration on unseen generators or different backbones. In addition, although the framework records evidence chains, the correctness and causal relevance of the extracted evidence are not independently validated.
Questions for authors
- What specific algorithmic contribution distinguishes FOVEA's evidence-fusion and tool-routing mechanisms from existing tool-augmented reasoning frameworks and conventional ensemble methods? Can the authors provide direct comparisons against simpler fusion and routing strategies?
- How well do the confidence estimates remain calibrated on held-out videos from unseen generators? What evidence supports the correctness and forensic relevance of the intermediate evidence records?