- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper addresses the problem of one-step autoregressive video generation, where existing distillation methods degrade significantly in quality when sampling is reduced to a single denoising step. The authors make two main observations: (1) trajectory-based consistency distillation fails for video because teacher trajectories exhibit concentrated curvature near the high-noise endpoint (unlike image teachers), and (2) DMD-based methods like Self Forcing produce blurry outputs because low-frequency components dominate DMD updates. To address these issues, they propose One-Forcing, which augments the DMD objective with an adversarial loss using a shared fake-score backbone as discriminator, trained on real video data. They further find that framewise autoregression (one latent frame per block) stabilizes adversarial training compared to chunkwise autoregression. Experiments on VBench show One-Forcing achieves 83.76 total score, outperforming prior one-step causal methods and approaching multi-step quality.
Critical strengths
The trajectory curvature analysis is a novel and actionable diagnostic. The finding that Wan video trajectories concentrate 92.5% of curvature mass at t ≥ 0.9, unlike EDM2 image trajectories, provides a principled explanation for why consistency distillation collapses to one step. This is consequential because it reframes the problem from "distillation is hard" to a specific geometric obstacle, and it motivates the distribution-matching alternative. The rectification experiment (Table 1) provides supporting evidence that trajectory geometry matters.
The framewise vs. chunkwise finding is practically significant and non-obvious. The demonstration that framewise autoregression stabilizes adversarial training (no R1/R2 needed, converges in 200 vs. 750 iterations) and yields better quality (83.76 vs. 81.60) is a useful empirical contribution. The hypothesis about finer temporal credit assignment is plausible and the result is clean. This finding has value beyond this specific method.
Critical weaknesses
Limited evidence for robustness of the main result. The headline VBench score (83.76) is from a single training run with no seed variance reported. Given that the gap to the strongest baseline (ASD at 79.12) is ~4.6 points and the gap to four-step Self Forcing (83.46) is only 0.3 points, knowing the run-to-run variance is important for assessing whether the improvement is meaningful. The extended training result (step 400: 83.93) is reassuring for stability but does not address seed variance.
The one-step curvature claim is not directly tested. The paper argues that high-noise curvature concentration explains why one-step CD fails, but the rectification experiment (Table 1) is conducted at four steps. A direct one-step rectification experiment, or a comparison of one-step CD with rectified vs. original trajectories, would substantially strengthen the causal claim. As presented, the geometric story is compelling but the evidence chain has a gap at the critical operating point.
Questions for authors
Seed variance: Can you report results across at least 2–3 training seeds for the main framewise configuration? Given the small gap to four-step Self Forcing (83.76 vs. 83.46), this would help assess whether the improvement is robust.
One-step rectification: The rectification experiment in Table 1 is at four steps. What happens if you run consistency distillation with rectified trajectories at one step? Does rectification alone recover any of the gap, or does one-step CD still fail? This would directly test the geometric hypothesis at the relevant operating point.
Prompt rewriting consistency: The main results use Qwen-rewritten prompts while some ablations use original prompts. Could you report the main comparison (Table 2) with original prompts as well, or clarify why rewriting was necessary for the main table but not the ablations?
2 comments
Dear Reviewer,
Given that there is just over a day left in the discussion period, we wanted to reach out to see if our rebuttal above addressed all your concerns or if any others still remained? Please let us know if any further clarification would be helpful. If all your concerns are addressed, we would be really grateful if you could acknowledge that soon.
Thanks, We sincerely appreciate your time reviewing our work and your insightful feedbacks.
Authors
Thank you for recognizing the trajectory analysis and the practical value of framewise adversarial training. We address your questions on training-seed variation, one-step rectification and prompt rewriting below.
W1&Q1. Results across independent training seeds.
We have additional framewise runs at 200 iterations, evaluated with one-step generation plus FFE on Qwen prompts:
Across the two runs, the mean VBench Total is 83.24, with a standard deviation of 0.30 and a 95% t-confidence interval of [80.55, 85.93]. These repetitions give a clearer picture of variability, showing our method is stable under variant seeds.
W2&Q2. Does rectification help one-step distillation directly?
Thanks for your insightful question!
To obtain one-step students, we adopt progressive distillation. Specifically, starting from the same autoregressive (AR) teacher model released in Causal-Forcing stage 1, we train two four-step students using the original and rectified trajectories, respectively, following the procedure described in the paper. We then progressively distill each four-step student into a two-step student and subsequently into a one-step student, with each stage trained to reproduce the outputs of the preceding model. This controlled setup allows us to isolate and evaluate the impact of trajectory rectification on the final one-step generation performance.
We found that using the rectified trajectory improves the VBench score of the one step student from 55.46 to 57.22. This provides direct evidence that trajectory simplification can help one-step compression, and it is not limited to the original four-step experiment.
Q3. Why use rewritten prompts for the main results and original prompts for the ablation?
Thank you so much for your careful review. Sorry for the confusion. Please see the aligned results below, we will make sure to correct our writings in our future version.
The +3.59-point gain confirms an adversarial benefit under the rewritten-prompt protocol as well.