acceptodds
Withdrawn from ICLR 2027

3DMoC: Training-Free AI-Generated Video Detection via 3D Motion Consistency

Withdrawn from ICLR 2027, so left out of the paper lists and the map.

Abstract

Existing methods for detecting AI-generated videos can identify common 2D spatiotemporal anomalies. However, there remain two limitations for detecting high-quality videos: (1) These methods primarily detect local pixel artifacts but lack spatial modeling, making it difficult to identify appearance differences from different views. (2) They primarily measure temporal inconsistencies based on inter-frame differences, thus struggling to identify motion anomalies in space. To address the above issues, we propose a training-free generated video detection via 3D Motion Consistency (3DMoC), which captures 3D appearance and motion anomalies in video, thereby achieving more accurate identification of AI-generated videos. Specifically, to characterize the appearance consistency of elements, we devise a Tracked Appearance Consistency module that aligns the same region across views through trajectory tracking to capture appearance differences in scene. Furthermore, we design a 3D Motion Continuity module that measures the degree of motion variation between tracked 3D world points to identify motion anomalies. Benefiting from the collaborative designs, our 3DMoC effectively captures both anomalies in 3D appearance and motion within generated videos. Extensive experiments demonstrate that our method achieves state-of-the-art detection accuracy on different generated-video benchmarks.

Primary area:
alignment, fairness, safety, privacy, and societal considerations
Keywords:
AI-generated video detection, 3D Motion Consistency, Tracked Appearance Consistency, 3D Motion Continuity

Reviews

Among:
Shape:
1234this paper, Bottom 27%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.00 over 3 reviews, above 27% of the others.
Reviewer_KdEgOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes 3DMoC, a training-free detector for AI-generated videos that combines tracked appearance consistency with reconstructed 3D motion continuity. Frozen DINOv3 features provide global appearance statistics and trajectory-aligned local feature differences, while VGGT supplies correspondences and reconstructed 3D points. The motion branch measures relative second-order trajectory variations and aggregates them using an entropy-based score. The two branches are normalized and fused. Real-only calibration uses approximately 33K VATEX videos. Experiments report improvements over the evaluated baselines on VideoFeedback, GenVideo, and ComGenVid.

Critical strengths
  1. The problem is important, and combining correspondence-aligned appearance with reconstructed geometry offers a plausible direction for generalization beyond generator-specific artifacts. The method avoids task-specific detector optimization and synthetic training samples, using real-only calibration data explicitly stated to be disjoint from the evaluation benchmarks.

  2. The reported improvements over STALL are consistent across all three benchmarks, and Table 2 demonstrates the complementary benefits of the appearance and motion branches. Component ablations, alternative motion statistics, and perturbation and temporal-sampling studies provide useful initial evidence supporting the proposed design.

Critical weaknesses

W1. The motion score and its normalization require stronger validation.

Equation (14) sums valid trajectory-time responses without normalizing their number. For MM identical positive responses rr, ignoring numerical stabilizers, the score becomes

Smot=M(r/log⁡M)γ.S_{\mathrm{mot}}=M(r/\log M)^\gamma.

With the default γ=0.05\gamma=0.05, the score depends strongly on response count, so visibility, track survival, and sampling density may affect detection independently of motion abnormality. Moreover, Equation (13) measures the distribution of response mass over trajectory-time indices rather than directly measuring motion-magnitude dispersion, and Equation (11) is sensitive to uniform coordinate rescaling. Equation (15) also leaves the inference protocol unclear: batch-level median and MAD normalization can make scores and fused rankings depend on batch composition, while singleton batches produce zero normalized scores. The authors should clarify the validity, coordinate-scale, and normalization protocols and provide controlled sensitivity analyses. The current evidence does not sufficiently distinguish physical motion inconsistency from reconstruction or correspondence errors.

W2. The reliability of the incremental gains and the contributions of individual components remain insufficiently established.

The AUC improvements over STALL are 0.0053, 0.0173, and 0.0113, but uncertainty estimates are absent, and all ablation, robustness, and sensitivity studies are limited to VideoFeedback, which contains only 80 real videos. The positive class, metric aggregation, real-video sampling procedures, and separation between hyperparameter selection and final evaluation also require clarification. Real-only calibration and fixed hyperparameters do not by themselves establish that evaluation labels were excluded from parameter selection. Several ablation results are difficult to reconcile: λ1=1\lambda_1=1 in Table 5 and “w/o Local Patch” in Table 2 should both remove the local appearance contribution under Equation (7), yet their results differ substantially; “w/o Entropy” in Table 2 and “Relative Motion” in Table 8 likewise lack a clear configuration-level explanation. Finally, removing tracking reduces AUC by only 0.0016, whereas removing Global CLS reduces it to 0.5141, warranting a more measured discussion of tracked local appearance. Paired uncertainty analyses and explicit evaluation and ablation protocols would strengthen the empirical claims.

Questions for authors
  1. How are query points selected, and what visibility/confidence criteria define valid three-frame trajectories? Does the motion-branch benefit persist when the number of valid responses is fixed, or when Equation (14) uses an average? How informative is valid-track count alone?
  2. What determines the coordinate scale in Equation (11), and how sensitive are scores to uniform coordinate rescaling? Can the authors provide a controlled analysis separating motion irregularity from reconstruction confidence or error?
  3. Which samples determine the median and MAD in Equation (15)? Can the authors report results with fixed independent normalization statistics and clarify how a single video is scored?
  4. Can the authors reconcile the ablation pairs identified in W3 and provide the precise metric aggregation, sampling, and hyperparameter-selection protocols, together with uncertainty for the comparison against STALL?
Reviewer_5LWFOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper proposes 3DMoC, a training-free framework for AI-generated video detection that aims to move beyond conventional 2D spatial artifacts and inter-frame temporal differences by exploiting 3D appearance and motion consistency. The method consists of two complementary components: Tracked Appearance Consistency (TAC) and 3D Motion Continuity (3DMC). TAC combines global DINOv3 appearance statistics with local patch-level appearance variations aligned along VGGT trajectories, while 3DMC analyzes second-order variations of reconstructed 3D point trajectories and aggregates them using an entropy-normalized motion score. The two branches are normalized and fused to produce the final video-level detection score. The detector does not require generated samples or task-specific fine-tuning, although it relies on a real-only calibration set to estimate reference statistics.

Experiments on VideoFeedback, GenVideo, and ComGenVid show that 3DMoC achieves strong overall performance, outperforming the compared training-free baselines in both AP and AUC. The ablation study also indicates that TAC and 3DMC provide complementary information, as the full model substantially outperforms either branch used alone.

Critical strengths
  1. The paper explores a meaningful direction beyond conventional 2D detection cues. The central idea of detecting inconsistencies in tracked scene elements rather than relying only on fixed image locations or frame-level differences is well motivated. In particular, associating local DINO features through VGGT trajectories provides a more scene-aware way of evaluating temporal appearance consistency.

  2. The method is training-free with respect to task-specific detector optimization and does not require generated training samples. The method uses frozen DINOv3 and VGGT models and estimates only reference statistics from real videos. This is attractive for cross-generator generalization, since the detector is less directly tied to artifacts from specific generation models.

  3. The experimental results are strong across multiple benchmarks and generation models. 3DMoC achieves an overall AP of 0.8720 and AUC of 0.8345, outperforming the compared baselines, including STALL. The performance is also relatively consistent across multiple generators and datasets.

  4. The two main branches appear complementary. TAC-only and 3DMC-only achieve lower performance than the full model, suggesting that appearance consistency and 3D motion continuity capture partially different failure modes.

  5. The authors provide useful ablation and robustness analyses. The paper evaluates component removal, motion weighting, aggregation choices, temporal sampling, and several common perturbations, which helps clarify the behavior of the proposed framework.

Critical weaknesses
  1. The construction and reliability of VGGT tracks are insufficiently specified and analyzed. The method relies on a set of valid VGGT tracks Ωt\Omega_t, but the paper does not clearly describe how these points are selected or filtered in practice, how many points are used, or how confidence and visibility are incorporated. Since both TAC and 3DMC depend on these correspondences, this missing detail makes it difficult to assess computational cost and sensitivity to track quality.

  2. The method may be vulnerable to tracking or reconstruction errors, especially due to max-based aggregation. The local appearance branch takes the maximum anomaly over tracked points and then the maximum over time. Thus, a single erroneous correspondence may dominate the local score. This is especially concerning for challenging real videos involving occlusion, fast object motion, rapid camera motion, motion blur, low-texture regions, or unstable reconstruction. The current robustness analysis mainly considers image-space corruptions such as blur, noise, JPEG compression, and cropping, rather than motion-specific failure modes that are directly relevant to the proposed method.

  3. The necessity of the tracked local appearance component is not fully demonstrated. In the supplementary ablation, λ1=1.0\lambda_1=1.0, which removes the local tracked appearance contribution from TAC, achieves AP 0.8764 and AUC 0.8189, compared with AP 0.8814 and AUC 0.8205 for the default λ1=0.8\lambda_1=0.8. Likewise, removing Track only causes a modest degradation. This suggests that the strong global DINO appearance statistics may already explain much of the TAC performance, and the incremental benefit of trajectory-aligned local appearance deserves clearer isolation.

  4. Although TAC and 3DMC appear complementary, the paper does not explain what complementary information they actually capture. The full model clearly outperforms TAC-only and 3DMC-only, which indicates that the two branches are not fully redundant. However, the paper does not analyze which types of videos are detected by TAC but missed by 3DMC, or vice versa. An error-overlap analysis or qualitative breakdown would make the claimed complementarity much more convincing.

  5. The calibration-domain robustness is insufficiently evaluated. All reference statistics are estimated from 33K real VATEX videos and then reused across all evaluation datasets. Although the calibration set is disjoint from the benchmarks, the paper does not examine how much the results depend on the choice of real-video calibration domain. This is particularly important because the global appearance branch contributes strongly to overall performance.

  6. The score normalization protocol is ambiguous and may introduce test-batch dependence. Eq. (15) defines the median and MAD using a set of scores "in batch". If these statistics are computed from the current test batch or the full evaluation set, then the score of one video may depend on the other test samples, which would complicate independent single-video inference and potentially affect comparison across datasets with different class proportions. The paper should clarify exactly where these statistics are computed.

  7. The 3D motion branch appears useful but less reliable when given a larger fusion weight. The ablation shows that TAC and 3DMC are complementary, but increasing λmot\lambda_{\mathrm{mot}} substantially degrades performance. This suggests that the 3D motion cue may be helpful as a corrective signal but comparatively noisy when emphasized too strongly. A more detailed failure analysis would help explain this behavior.

  8. It is unclear to what extent 3DMC captures intrinsic motion inconsistency versus VGGT reconstruction uncertainty. Since 3DMC is computed from reconstructed 3D trajectories, reconstruction noise can also produce large second-order variations. The current experiments do not disentangle these two effects. Analysis of VGGT confidence or reconstruction quality on real versus generated videos would strengthen the interpretation of 3DMC as a genuine 3D motion-consistency measure.

  9. Computational efficiency is not sufficiently reported. The method jointly uses DINOv3 ViT-L/16 and VGGT-1B, but the paper does not report per-video inference time, memory usage, throughput, or sensitivity to the number of tracked points. These costs are relevant for assessing the practicality of a training-free detector.

Questions for authors
  1. How are the VGGT tracking points selected and filtered in practice? The paper defines valid tracks Ωt\Omega_t, but the construction of this set is unclear. How many points are typically used per frame, and what confidence or visibility thresholds are applied? It would also be useful to report how detection performance and runtime change with the number of tracked points.

  2. How robust is 3DMoC to VGGT tracking and reconstruction errors? Since the local appearance score uses max aggregation over both points and time, a single incorrect correspondence may strongly affect the video-level score. Have the authors evaluated more robust aggregation schemes such as top-k mean or percentile pooling, or different confidence thresholds?

  3. Could the authors evaluate motion-specific robustness? The current robustness study mainly considers blur, noise, JPEG compression, and cropping. Since the method relies on reliable tracking and 3D reconstruction, it would be important to evaluate fast object motion, rapid camera motion, camera shake, motion blur, occlusion, low-texture scenes, and scene transitions.

  4. How necessary is the tracked local appearance component? Since λ1=1.0\lambda_1=1.0 performs close to the default λ1=0.8\lambda_1=0.8, and removing Track only causes a limited performance drop, could the authors report a clearer comparison among: (i) global DINO only, (ii) global DINO + 3DMC, (iii) global + local appearance without tracking, and (iv) the full model?

  5. Could the authors provide an error-overlap or qualitative analysis of TAC and 3DMC? For example, it would be informative to show cases correctly detected by TAC but missed by 3DMC, and vice versa, to clarify what complementary information each branch captures.

  6. How sensitive is the method to the choice of calibration dataset? All calibration statistics are derived from VATEX. Could the authors evaluate alternative real-video calibration datasets or cross-domain calibration settings to verify that the reported performance is not specific to VATEX?

  7. Where are the median and MAD in Eq. (15) computed? Are they obtained from each test mini-batch, the entire evaluation set, or a fixed calibration set? If test-set statistics are used, could the authors additionally report results with fixed calibration statistics to support independent single-video inference?

  8. Why does the 3D motion branch become detrimental when assigned a larger fusion weight? The full model benefits from 3DMC, but performance drops notably at larger λmot\lambda_{\mathrm{mot}}. Could the authors provide an error analysis explaining which samples benefit from 3DMC and which are harmed by it?

  9. How much of the 3DMC signal is attributable to actual motion inconsistency rather than VGGT reconstruction uncertainty? It would be useful to compare VGGT tracking/reconstruction confidence between real and generated videos and analyze whether the 3D motion score remains discriminative after controlling for reconstruction quality.

  10. Could the authors report the computational cost of 3DMoC? Inference time, GPU memory, throughput, and the effect of track density would help assess the practical applicability of the proposed method.

Reviewer_GiLCOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

3DMoC detects AI-generated videos by combining tracked appearance consistency with reconstructed 3D motion continuity. It uses frozen DINOv3 features and VGGT correspondences to compare tracked regions against real-video reference statistics, alongside a motion score derived from second-order 3D trajectory variations and entropy-based aggregation. The method requires real-only calibration but no task-specific model optimization. Experiments on three benchmarks report consistent improvements over STALL, supported by component ablations and robustness evaluations.

Critical strengths
  1. Well-motivated use of complementary cues. Tracking corresponding regions avoids comparing unrelated content at fixed image locations, while reconstructed motion offers information beyond appearance statistics. The approach requires no task-specific model fine-tuning and uses a disjoint real-only calibration set.

  2. Consistent improvements across benchmarks. Relative to STALL, the method improves average AUC from 0.8232 to 0.8345 and AP from 0.8363 to 0.8720. The improvements occur on all three benchmarks, and the component ablations support combining appearance and motion cues.

Critical weaknesses
  1. The benefit of 3D motion consistency is not clearly established. Equation (14) sums motion responses without explicitly accounting for the number of valid tracked points. Videos with more successfully tracked points may therefore receive higher scores, even when their motion is equally consistent. Comparing videos with a fixed number of tracks, and comparing against an equivalent 2D-motion baseline, would help establish whether the gains come from 3D motion information. Removing tracking also reduces AUC only from 0.8205 to 0.8189. Without uncertainty estimates, this small difference provides limited evidence for the importance of trajectory alignment.

  2. Important evaluation details are unclear. Equation (15) normalizes scores using statistics from the current batch, so a video’s final score may change depending on which other videos are evaluated alongside it. If applied to a single video, both normalized scores become zero. The authors should clarify how these statistics are computed and how individual videos are evaluated. The AP calculation also needs clarification: VideoFeedback contains 680 fake and 80 real videos, but several reported AP values do not match what is mathematically possible when treating fake videos as positive and evaluating the full dataset together. The authors may use a different positive class, sampled subsets, or averages across generators, but this is not specified. These missing details make the results difficult to reproduce and interpret.

Questions for authors
  1. Motion-score clarification: Is the number of valid trajectory responses fixed across videos? Does the improvement persist with a fixed number of tracks or count-normalized aggregation, and how does an otherwise identical 2D motion baseline perform?

  2. Normalization clarification: Are the median and MAD in Equation (15) computed over the full test set, individual mini-batches, or calibration data? How are individual videos scored, and how sensitive are the results to batch composition?

  3. Metric clarification: Which class is positive for AP, and are results pooled over each complete dataset or averaged over generator-specific subsets? Please explain how Table 1 is computed from the dataset counts in Table 4.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Discussion (0)

Sign in to comment.