- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Parallel Decoding Distillation(PDD), a trajectory-based distillation framework for accelerating image and video generation with diffusion and flow matching models. PDD introduces a parallel decoder that predicts the mean velocities of multiple consecutive denoising intervals within a single network evaluation. The student is trained through on-policy trajectory regression, using teacher velocities approximated by Euler or Midpoint solvers as supervision. During inference, multiple prediction heads are fused into a single linear layer, enabling efficient few-step sampling with flexible NFE budgets. The method avoids computationally expensive JVPs, finite differences, adversarial objectives, and multi-stage distillation. Experiments on ImageNet-256, Qwen-Image, Wan2.1, and LTX-2.3 demonstrate competitive or state-of-the-art generation quality at 4–8 NFEs, while preserving greater sample diversity than distribution-based distillation baselines.
Critical strengths
- The proposed method is theoretically well-grounded and technically elegant, featuring a simple, efficient on-policy regression objective and a parallel decoding architecture that supports flexible inference budgets.
- The experiments are comprehensive and convincing, covering multiple large-scale image and video generation models, with competitive generation quality and strong preservation of sample diversity.
Critical weaknesses
The methodological novelty relative to Pi-Flow remains insufficiently justified. The paper lacks a clear explanation of why discrete mean-velocity prediction and its regression objective are methodologically necessary or fundamentally advantageous compared to Pi-Flow's continuous policy parameterization.
Questions for authors
Thank you for the solid work. The paper is theoretically well-grounded and supported by comprehensive experiments. My main concern is the methodological novelty compared to Pi-Flow. Could the authors clarify why discrete mean-velocity prediction and its regression objective are necessary compared to continuous policy parameterization? Do these designs offer advantages beyond architectural simplicity and computational efficiency that continuous policy methods cannot easily achieve? If the authors can clearly justify these differences through theoretical analysis or targeted experiments, I would like to raise my score to 4.
2 comments
Authors' response
We are glad that the provided discussion addressed the reviewer’s concerns. In the final version of the paper, we will further clarify and stress these points. We are grateful to the reviewer for dedicating their time to carefully review our paper, for providing constructive comments that helped us better emphasize the paper’s contributions, and for raising their score.
Concern Addressed
Thank you for the detailed rebuttal. The clarification of the unified time discretization, mean-velocity supervision, and state-independent policy with layer fusion has largely addressed my concerns about the methodological novelty relative to Pi-Flow. I particularly appreciate the explanation of how these design choices enable flexible NFE budgets and efficient inference. I encourage the authors to clarify the scope of the any-NFE claim and further discuss the role of policy parameterization in the final version. Overall, I am satisfied with the response and will raise my score to 4.