- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes 3DMoC, a training-free detector for AI-generated videos that combines tracked appearance consistency with reconstructed 3D motion continuity. Frozen DINOv3 features provide global appearance statistics and trajectory-aligned local feature differences, while VGGT supplies correspondences and reconstructed 3D points. The motion branch measures relative second-order trajectory variations and aggregates them using an entropy-based score. The two branches are normalized and fused. Real-only calibration uses approximately 33K VATEX videos. Experiments report improvements over the evaluated baselines on VideoFeedback, GenVideo, and ComGenVid.
Critical strengths
-
The problem is important, and combining correspondence-aligned appearance with reconstructed geometry offers a plausible direction for generalization beyond generator-specific artifacts. The method avoids task-specific detector optimization and synthetic training samples, using real-only calibration data explicitly stated to be disjoint from the evaluation benchmarks.
-
The reported improvements over STALL are consistent across all three benchmarks, and Table 2 demonstrates the complementary benefits of the appearance and motion branches. Component ablations, alternative motion statistics, and perturbation and temporal-sampling studies provide useful initial evidence supporting the proposed design.
Critical weaknesses
W1. The motion score and its normalization require stronger validation.
Equation (14) sums valid trajectory-time responses without normalizing their number. For identical positive responses , ignoring numerical stabilizers, the score becomes
With the default , the score depends strongly on response count, so visibility, track survival, and sampling density may affect detection independently of motion abnormality. Moreover, Equation (13) measures the distribution of response mass over trajectory-time indices rather than directly measuring motion-magnitude dispersion, and Equation (11) is sensitive to uniform coordinate rescaling. Equation (15) also leaves the inference protocol unclear: batch-level median and MAD normalization can make scores and fused rankings depend on batch composition, while singleton batches produce zero normalized scores. The authors should clarify the validity, coordinate-scale, and normalization protocols and provide controlled sensitivity analyses. The current evidence does not sufficiently distinguish physical motion inconsistency from reconstruction or correspondence errors.
W2. The reliability of the incremental gains and the contributions of individual components remain insufficiently established.
The AUC improvements over STALL are 0.0053, 0.0173, and 0.0113, but uncertainty estimates are absent, and all ablation, robustness, and sensitivity studies are limited to VideoFeedback, which contains only 80 real videos. The positive class, metric aggregation, real-video sampling procedures, and separation between hyperparameter selection and final evaluation also require clarification. Real-only calibration and fixed hyperparameters do not by themselves establish that evaluation labels were excluded from parameter selection. Several ablation results are difficult to reconcile: in Table 5 and “w/o Local Patch” in Table 2 should both remove the local appearance contribution under Equation (7), yet their results differ substantially; “w/o Entropy” in Table 2 and “Relative Motion” in Table 8 likewise lack a clear configuration-level explanation. Finally, removing tracking reduces AUC by only 0.0016, whereas removing Global CLS reduces it to 0.5141, warranting a more measured discussion of tracked local appearance. Paired uncertainty analyses and explicit evaluation and ablation protocols would strengthen the empirical claims.
Questions for authors
- How are query points selected, and what visibility/confidence criteria define valid three-frame trajectories? Does the motion-branch benefit persist when the number of valid responses is fixed, or when Equation (14) uses an average? How informative is valid-track count alone?
- What determines the coordinate scale in Equation (11), and how sensitive are scores to uniform coordinate rescaling? Can the authors provide a controlled analysis separating motion irregularity from reconstruction confidence or error?
- Which samples determine the median and MAD in Equation (15)? Can the authors report results with fixed independent normalization statistics and clarify how a single video is scored?
- Can the authors reconcile the ablation pairs identified in W3 and provide the precise metric aggregation, sampling, and hyperparameter-selection protocols, together with uncertainty for the comparison against STALL?