- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
When distilling a bidirectional diffusion model into a few-step AR student model, the trajectory supervision for the PF-ODE stage can be reduced to a single trajectory, by splitting the denoising trajectory between two different experts based on noise levels.
Each of the two experts is supervised using a loss function with a different granularity, and the final results show improvements over previous baselines, demonstrating the effectiveness of this simple approach.
Critical strengths
- The diagnostic is well supported in the motivation section. Around 92pp of the total curvature mass at t >= 0.9 is a surprising but solid discovery.
- The huge improvement in Initialization time cost and extra data storage cost is stunning. If this advantage can be transferred to bigger backbones like LTX 2.3 / MiniMax H3, it will significantly reduce the computational resources required to distill these models.
- The figures in the paper are concise and easy to understand.
Critical weaknesses
-
Question on the novelty. The Glance Forcing framework closely follows DCM (Lv et al., ICCV 2025)[1], which the paper does not cite. In general, both work split the ODE trajectory into a high-noise expert and a low-noise expert. In detail, the two papers also share many similarities, including:
a. Sec. 3.3's sub-trajectory definition (L257-L263) tracks DCM Sec. 3.2 almost sentence by sentence
b. Eqs. (9) and (10) are identical to DCM Eqs. (6) and (7) apart from renaming the experts (F_SemE, F_DetE → F_Slow, F_Fast).
c. Highly similar drawing styles in the figures. For example, Fig.5 (a) (b) v.s. DCM Fig.3 (a) (b); Fig.10 v.s. DCM Fig. 10. In addition, Fig. 5's caption and DCM Fig. 3’s are also close paraphrases.Given so many similarities, it is strange that DCM is not cited. The author should re-examine the novelty of his contributions.
-
The user study involved only 3 participants, so the results may lack statistical significance. Additionally, the appendix mentions that human evaluation covered four aspects, while the authors did not report the win rate for each.
-
In supplementary video3 (train video), the movement of the train and the shape of the smoke are clearly unnatural.
[1]. Lv, Zhengyao et al. “Dual-Expert Consistency Model for Efficient and High-Quality Video Generation.” 2025 IEEE/CVF International Conference on Computer Vision (ICCV) (2025): 14983-14993.
Questions for authors
-
Scope of the efficiency claim. Fig. 1 says “GF reduces training cost by 11600×”, but how much does GF improve efficiency across the entire training process?
a. Please report the cost of the three stages separately in a consistent unit, ideally GPU-hours, so that the share corresponding to the 11,600x reduction is visible.
b. State whether the baseline rows in Tab. 1 were re-run under this pipeline or quoted from the original papers. If re-run, report their measured GPU hour cost on the same hardware; if quoted, label them as such. -
Please clarify the reasons for the similarities between your paper and DCM, and restate the originality of your contributions.
3 comments
We are grateful to the reviewer for the thoughtful feedback. We have carefully considered all the comments and provided detailed responses in rebuttal. If there are any remaining questions that require further clarification, we would be glad to address them.
I appreciate the authors' addition of the supplementary experiments.
However, the authors have not provided the necessary clarification regarding the similarities noted in points a., b., and c. of W1 concerning the two papers mentioned. So I have decided to maintain my score.
Q1(a). Three Stages Cost
We report the training cost and extra storage of each stage to provide a comprehensive comparison of the entire pipeline:
As shown in the table, the ODE distillation stage is the primary computational bottleneck in Causal Forcing, accounting for approximately 70% of its total training cost. By leveraging our single-trajectory PF-ODE initialization, Glance Forcing reduces the cost of this stage from 11,600 to just 1 GPU-hour.
Notably, the subsequent DMD stage is retained in Glance Forcing with the same training cost as in Causal Forcing. Since DMD distills directly from online teacher predictions using 25k text prompts, it eliminates the need to pre-generate or store a large-scale text-video pair dataset, resulting in zero extra storage."
Consequently, the overall training cost of the entire pipeline is reduced by approximately 70%, while the extra storage requirement drops by about 99%.
Q1(b). Setup
Table 1 results are quoted from the original papers, mostly from Causal Forcing [1]. For a fair comparison, we follow its hardware (H100 GPUs) and evaluation protocols.
Q2. Contributions
Thank you for raising this important concern. We acknowledge that DCM is closely related to our work, and that its omission from the submitted manuscript was an oversight. In fact, DCM was discussed in an earlier version of our Related Work section on phase-aware diffusion modeling, but this discussion was removed accidently during revision. We sincerely apologize.
We have updated the PDF (changes in blue). For more details, please refer to the Phase-aware Denoising section on page 10 of the main manuscript.
Regarding the originality, we would like to clarify fundamental differences from DCM:
Motivation and timestep allocation. DCM adopts uniform timestep allocation across phases. In contrast, Glance Forcing is motivated by the varying sensitivity of different denoising phases and employs an asymmetric training schedule, densely sampling four steps in the Slow phase while sparsely sampling four steps in the Fast phase.
Training strategy. DCM trains a full-parameter high-noise expert to initialize a low-noise LoRA expert. In contrast, Glance Forcing independently trains two LoRA experts, treating the phases as distinct tasks. Experiments confirm that this strategy achieves better performance (see Q3 of Reviewer 1Tvy for details).
Distillation objective. Glance Forcing addresses representation interference under single-trajectory supervision, enabling extremely low-cost AR diffusion distillation, while DCM requires tens of thousands of text-video pairs for training.
We will include DCM in Related Work and clarify these distinctions.
W2. User Study
We acknowledge that the original user study was limited in scale. To align with Causal Forcing [1], which involved 10 annotators, we recruited seven additional participants. All newly recruited participants hold or are currently pursuing master's or doctoral degrees and have substantial experience in generative modeling, ensuring a level of expertise comparable to that of the original annotators.
The results are summarized below:
The expanded study yields results consistent with our original findings, showing that our method is consistently preferred over both baselines.
Regarding the missing aspect-wise win rates, we would like to clarify that the four aspects mentioned in the appendix were considered jointly by annotators when making judgment. They were not designed as four independently rated evaluation dimensions. Therefore, Table 2 reports the aggregated overall preference results.
W3. Train Video
To further investigate this issue, we have updated the supplementary materials with additional comparisons in Demo/Train, including Causal Forcing, Self Forcing, and CausVid, on the same train example.
These methods exhibit similar unnatural motion and smoke artifacts, suggests that such artifacts are primarily inherited from the base model's generation limitations, rather than being introduced by our framework.
References
[1] Zhu, Hongzhou, et al. "Causal forcing: Autoregressive diffusion distillation done right for high-quality real-time interactive video generation." arXiv preprint arXiv:2602.02214 (2026).