- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Drift Forcing replaces the initialization stage of a few-step autoregressive video distillation pipeline. It generates student rollouts and trains them with attraction toward positive teacher-generated clips and repulsion among sibling rollouts in the feature space of a frozen causal teacher. The main recipe first matches clip-pooled features and then chunk-pooled features, before handing the student to an unchanged asymmetric DMD stage. The experiments hold the downstream DMD recipe fixed and compare several initializations on VBench, distributional metrics, and blinded human ratings. The main outcome is a motion-versus-stability trade-off: the proposed initialization gives the highest VBench Total, while consistency-distilled alternatives retain better teacher coverage and human-rated stability.
Critical strengths
-
Training the initialization on its own causal rollouts is a sensible and technically concrete alternative to per-trajectory imitation. The downstream comparison is well controlled: the DMD trainer, data, batch, and iteration budget are held fixed. The two-stage schedule and repulsion ablations also test actual components of the proposed recipe. At iteration 1000, removing repulsion reduces the final Total from 84.63 to 83.84 despite nearly equal VBench scores before DMD. This supports evaluating an initialization by what the next stage makes of it.
-
The paper does not hide the limitations of the aggregate metric. It includes teacher-reference precision/coverage, per-dimension results, learned preference measures, and a blinded human comparison. Section 4.5 shows that higher dynamic degree is not simply synonymous with better perceived video: raters distinguish the models on stability even when motion compliance is similar. That analysis is a useful contribution in its own right.
Critical weaknesses
-
The main proposed recipe is not the better product under the paper's own human evaluation. Section 4.5 reports clear instability on roughly one in five clips for the two-stage product versus one in twenty for TF-dCM. Motion-compliance rates are essentially unchanged, 0.77 versus 0.78. Table 1's VBench improvement over TF-dCM is 0.51, and the paper explains that dynamic degree contributes more than the entire gain. Coverage also falls from 0.223 for TF-dCM's DMD product to 0.137 for the proposed product. The authors acknowledge these trade-offs, which I appreciate, but the evidence does not yet make a compelling case for choosing the main recipe when perceived stability and fidelity matter. A favorable aggregate score is too narrow a basis for that choice.
-
The practical value of paying for the initialization is not established at equal total cost. DMD from the stage-1 model reaches 84.37, only 0.26 below the proposed 84.63. The proposed initialization adds about 400 H800-hours before the roughly 200-H800-hour DMD stage. The comparison with 2,900 A800-hours is from a different reported consistency-distillation setup; Table 3 lists the actual TF-dCM initialization cost as unpublished. Those numbers cannot establish a hardware-matched speedup. The main comparison does not show what happens when the full initialization budget is instead allocated to the no-initialization baseline. Evaluation seeds and prompt bootstrap intervals also do not quantify variation between independently trained models, which matters for the small aggregate lead.
The authors could also consider discussing BAgger [Po et al., 2026] and History-Guided Video Diffusion [Song et al., 2025]. BAgger offers a related perspective on learning from self-generated trajectories, while History Guidance is relevant to the tradeoff between motion and temporal consistency. Both would help position the contribution, although neither is a direct substitute for the initialization stage studied here. These are optional references to consider, rather than requests for additional experiments.
Optional references: [Po et al., 2026] Ryan Po, Eric Ryan Chan, Changan Chen, and Gordon Wetzstein. "BAgger: Backwards Aggregation for Mitigating Drift in Autoregressive Video Diffusion Models." CVPR 2026.
[Song et al., 2025] Kiwhan Song, Boyuan Chen, Max Simchowitz, Yilun Du, Russ Tedrake, and Vincent Sitzmann. "History-Guided Video Diffusion." ICML 2025.
Questions for authors
-
Assessment-changing comparison: At the same total H800-hour budget, how does the proposed pipeline compare with spending that budget on DMD from the stage-1 model, including human preference and stability as well as VBench?
-
Clarification: Is there a checkpoint or configuration that retains the motion gain while matching TF-dCM's human-rated stability? If not, which concrete use case makes the measured trade-off preferable?
-
Clarification: How variable are the matched-budget Total, dynamic-degree, and stability differences across independent training runs? The reported generation-seed probes do not answer this question.
Revised Manuscript Uploaded
We have uploaded the revised manuscript incorporating the updates and additional results discussed in our initial rebuttal (highlighted in blue), including the multi-run statistics and best-in-1k operating point (Abstract, §4.3), the additional blind human evaluation (§4.5, Appendix M), expanded related work (§2), and clarifications on feature-space design, hardware comparisons, and experimental scope (§1, §3.2, §4.2, §6).
Thank you again for your valuable feedback, and please let us know if you have any further questions.