- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
This paper proposes PDMD to reduce the training instability of DMD, a widely used distillation method for diffusion models. The fix is simple but effective: the DMD update is projected onto the orthogonal complement of the student-critic endpoint residual. The authors show that this residual is a conditionally unbiased estimate of critic endpoint error and analyze error removal and signal retention under additional assumptions. Experiments demonstrate improved training stability and video quality.
Critical strengths
-
The proposed method is simple, intuitive yet effective.
-
The claim that projecting the DMD update improves training stability is well supported by both the theoretical analysis and the synthetic experiments. The theory shows that a constant fraction of the critic error (under mild high-dimensional assumptions) necessarily lies along the student-critic endpoint residual direction and is therefore removed by the projection, while the controlled experiments in Figs. 4 and 5 are consistent with these predictions. Together they make PDMD's motivation and solution very convincing.
-
The experimental design is good. Comprehensive experiments show PDMD's improved video quality, clear advantages in human preference, and the improvement in training stability (Fig. 10).
Critical weaknesses
Overall, I consider this a solid work and have no major concerns. My minor concerns are:
- The paper evaluates only benchmark scores and does not assess how the student's diversity differs from the teacher's. A supplementary analysis on diversity would strengthen the evaluation.
- In most cases, small metric advantages in automatic evaluation cannot be valided in human-evaluation win rates. PDMD exhibits the opposite pattern: on Wan2.1/VBench its metric margins over AnyFlow/DMD2 are marginal, while its advantages in the user study are obvious. I would like to hear the authors' thoughts on this discrepancy.
After reading the rebuttal, I think the authors have addressed my concerns, so I will raise my rating to 4.
Questions for authors
See "Critical Weaknesses" 2.
Response to Reviewer jkw2
Thank you for your thoughtful review and for describing our method as “simple, intuitive yet effective.” We appreciate your assessment that the theoretical analysis and controlled experiments make PDMD's motivation and solution “very convincing,” and your overall judgment: “Overall, I consider this a solid work and have no major concerns.” Thank you also for rating both the paper's informativeness and presentation 3/3.
We warmly welcome further discussion and hope our responses encourage you to raise your score to 4.
We address your concerns below.
W1. Student diversity relative to the teacher
Four-step PDMD achieves 95.5% of the full-step teacher's LPIPS diversity score on Wan and 94.2% on H3. We evaluate all 944 Wan/VBench prompts and all 387 H3/VideoGen-Eval prompts, with five generation seeds per prompt. We compute LPIPS diversity among the five videos for each prompt and average over all prompts. Higher values indicate greater perceptual diversity.
PDMD ranks among the top two four-step methods in LPIPS diversity on both benchmarks, without a discriminator or multi-stage training. It outperforms its fair baseline DMD on both backbones, as well as the four-step teacher and Turbo LoRA on H3.
PDMD closely preserves the full-step teacher’s perceptual diversity on both backbones, reaching 95.5% of its LPIPS diversity score on Wan and 94.2% on H3. This consistent result shows that four-step distillation retains rich variation across seeds for the same prompt, alongside PDMD’s improvements over DMD in generation quality and diversity.
W2/Q1. Why the VBench and human-preference margins differ
We appreciate the reviewer’s thoughtful comments on video-quality evaluation. Reliable video-quality evaluation remains a challenging and rapidly evolving research area. Our interpretation is that aggregate metrics may respond less strongly to more natural colors and textures and better motion than human viewers do.
We therefore see automatic evaluation and the user studies as helpful complementary evidence. Both automatic evaluation and the user study consistently favor our method by different margins.
We would qualify the observation about small automatic-metric gains: clear human preferences can coexist with close benchmark scores. Recent peer-reviewed video-distillation studies report this pattern:
Our human preferences are consistent with the more natural colors and textures in Figs. 6 and E5 and the motion comparison in Fig. E2. We warmly invite you to inspect the full videos under Benchmarks → Check qualitative comparisons side by side in the submitted supplementary website.
Thank you again for your thoughtful feedback. We welcome further discussion and sincerely hope you will consider raising your score to 4.