- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
In this work, the authors target the initialization stage of few-step autoregressive (AR) video distillation, where Causal Forcing trains an intermediate AR teacher and distills its causal ODE trajectories before asymmetric DMD. The authors argue that latent regression favours posterior-mean predictions, and observe that ODE initialization still leaves fine detail unresolved at four steps. RepForcing replaces the teacher and the ODE stage with a single teacher-forced phase: the causal student (Wan2.1-1.3B) predicts clean blocks, and the loss is a token-wise cosine distance between features of the predicted and target latents, read from block 8 of a frozen Wan2.1-14B. DMD is unchanged and no ODE trajectory dataset is generated. After DMD, the four-step model reports the best VBench Total, Quality, VisionReward and Instruction Following among distilled AR models in both settings.
Critical strengths
- This work presents a genuine simplification: it deletes the intermediate teacher and the ODE trajectory dataset while leaving the student, the data and DMD untouched.
- The final numbers are strong in both settings, and the reward gains are large rather than marginal (VisionReward 6.326 to 10.074 chunk-wise, 6.798 to 10.598 frame-wise). The comparison reuses Causal Forcing's dataset, backbone and evaluation prompts, so it is better controlled than a typical cross-paper table.
- The paper reports where it loses and does not overclaim: it says plainly that deterministic ODE targets alone do not account for the few-step quality gap.
Critical weaknesses
- The matched harness behind Table 2 is never pointed at the two comparisons the thesis requires: a latent-MSE Stage 1, and an ODE or CD initialization.
- Pipeline simplification is the headline benefit, yet no Stage-1 hyperparameters or training costs are reported.
- Novelty is modest, essentially a perceptual loss with a frozen video DiT as the feature network. The related work is honest about this, and on its own I would not weigh it against the paper.
Questions for authors
- Can you report pre-DMD metrics (VBench Quality, Semantic, Dynamic Degree, VisionReward at 4, 8 and 12 steps) for RepForcing and at least one intermediate-teacher initialization?
- What is your DMD configuration (teacher, guidance scale, update budget), and does it match the runs behind the Causal Forcing and Causal Forcing++ numbers you quote?
- What are the Stage-1 hyperparameters and total training cost, and how do they compare with teacher training plus ODE generation? Are target features cached?
- Wan2.1-14B is the extractor, the DMD teacher and, via the bidirectional Wan model, the source of the training videos. Does the benefit survive when the extractor is decoupled from the teacher and the data generator?
6 comments
Our Response to Reviewer oULG (2/2) [W3, Q4]
W3. Novelty. We agree that the loss is a perceptual-style objective with a frozen video DiT as the feature network, and we appreciate the reviewer's note that this alone should not count against the paper. The contribution is showing that, for few-step causal autoregressive video initialization, changing the regression metric is enough to replace the intermediate AR teacher and the ODE trajectory stage, together with the analysis and design findings that make it work: the condition under which the representation loss rejects averaged predictions (new Corollary, Appendix C.3), video-diffusion features outperforming DINOv2 and InternVid, the role of intermediate depth (Table 2), and the irrelevance of the extractor's attention mask (Table R5).
Q4. Does the benefit survive when the extractor is decoupled from the teacher and the data generator? We first clarify that the shared training videos are generated by bidirectional Wan2.1-1.3B, whereas the feature extractor and DMD teacher are Wan2.1-14B.
Table 2 already decouples the extractor from the DMD teacher: with the Wan2.1-14B teacher fixed, DINOv2 and InternVid extractors perform worse, so part of the benefit comes from using video-diffusion features rather than from sharing a model with the teacher. Table R5 adds that the benefit does not depend on how the extractor attends over time. Replacing the extractor with a video DiT from a different family requires re-encoding through that model's VAE and is beyond what we could run in the rebuttal period; we list it, together with training on videos from another generator, as a limitation and future work in the revision.
Summary. We thank the reviewer again for the careful reading and for recognizing the simplification and the honesty of the paper. Following the reviewer's suggestions, the matched harness now covers the latent-MSE AR-diffusion model and the causal-ODE and CD initializations before DMD (Tables R1 and R3), the DMD configuration is shown to match the quoted baselines, Stage-1 hyperparameters, cost and caching are fully specified (Table R6), and the extractor-coupling question is answered with Table 2 and a new attention-mask ablation (Table R5). We believe these additions resolve the reviewer's main concerns (W1 and W2), and we would be grateful if the reviewer would consider updating the score accordingly. We remain available for any further questions.
Dear Reviewer oULG,
We hope this message finds you well. We understand that this is a busy period, and we sincerely appreciate the time you have devoted to reviewing our submission.
We have posted our responses to your comments and uploaded a revised manuscript that incorporates your suggestions. As the discussion period will close on November 18, we would be grateful if you could take a moment to let us know whether our responses have addressed your concerns. If anything remains unclear, we would be glad to provide further clarification or additional results.
Thank you again for your thoughtful feedback.
Best regards,
RepForcing Authors
Our Response to Reviewer oULG (1/2) [W1, Q1, W2, Q2, Q3]
We thank the reviewer for the detailed summary and for recognizing that the comparison reuses Causal Forcing's data, backbone and prompts, and that the paper does not overclaim.
W1 / Q1. The matched harness is not pointed at a latent-MSE Stage 1 or at an ODE/CD initialization; report pre-DMD metrics at 4, 8 and 12 steps. We provide quantitative pre-DMD comparisons between RepForcing and the causal-ODE and CD initializations on the full evaluation set at 4, 8 and 12 sampling steps. RepForcing consistently improves VBench Total, Quality and VisionReward over both baselines across these sampling schedules, supporting its generation-quality and reward gains before DMD. The detailed results are presented in Table R3 (reply to Reviewer NQeq, W1 / Q1).
W2 / Q2 / Q3. Training configuration, cost, and feature caching.
DMD configuration (Q2). Yes, our DMD stage matches the runs behind the quoted baselines: RepForcing follows the asymmetric DMD recipe of Self Forcing, Causal Forcing and Causal Forcing++, sharing the teacher, guidance scale, auxiliary score model, optimizer, schedule, batch and training prompts, and only the initialization differs. The post-DMD differences in Table 1 therefore reflect the initialization rather than the distillation recipe. The table below specifies our four-step configuration and update budget.
Stage-1 hyperparameters and cost. We use AdamW with learning rate 2×10⁻⁶, β = (0, 0.999), weight decay 0.01, global batch 64 videos (16 GPUs × 1 video per GPU × 4 accumulation steps), gradient-norm clipping at 10, bf16 with FSDP and gradient checkpointing, no EMA, and 3,000 iterations. Each block draws an independent noise level from the 1000 training timesteps with timestep shift 5.0. The extractor is the frozen Wan2.1-14B with native bidirectional attention, read at block 8 (one-based) with τ = 0 on clean latents; the loss is the token-wise cosine distance. RepForcing's pre-DMD training costs 660 A800 GPU-hours, compared with 905 GPU-hours for Causal Forcing's AR-teacher training and additional ODE stage, reducing the total cost by 27.1%. Peak memory per GPU is 54 GB for RepForcing and 46 GB for Causal Forcing. The detailed comparison is presented in Table R6 (reply to Reviewer NQeq, W3 / Q3); DMD is not included.
Target feature caching. Target features are not cached in our implementation; they are recomputed at every step under stop-gradient. They can be cached, since the target branch is detached and its input (the clean latent at τ = 0) is fixed.
We will include these training settings and cost details in the revision.