- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies on-policy distillation (OPD) of diffusion models from a large teacher to a smaller student, and finds that the standard DiffusionOPD recipe produces severe artifacts in this setting. To diagnose this, the authors propose Fixed-State KL, which evaluates the student–teacher KL divergence on a shared set of samples from teacher trajectories and noised real images. Their analysis attributes the failure to classifier-free guidance (CFG): a smaller student cannot match the teacher's conditional and unconditional branches, and the CFG composition amplifies their errors. They propose Guidance Folding Distillation (GFD), which trains the student's conditional branch to directly match the teacher's CFG-guided velocity, combined with a reward-extrapolated target adopted from ExOPD. Empirically, GFD-OPD achieves promising performance on SD3.5 (Large to Medium) and FLUX.2 (9B/32B to 4B) over OPD baselines.
Critical strengths
The paper studies an important and practical setting, large-to-small on-policy distillation of diffusion models.
Critical weaknesses
- Limited Novelty: My main concern lies in the actual contribution of this paper. Training the student's conditional branch to match the teacher's CFG-guided output is essentially guidance distillation [1], which is well established in the diffusion distillation literature, yet the paper neither cites nor discusses it. The reward-extrapolated target is directly adopted from ExOPD [2]. In this regard, GFD-OPD reads as combining guidance distillation [1] and ExOPD [2] within the DiffusionOPD framework. The paper would benefit from positioning the method with respect to the guidance distillation literature and clarifying what is new in the on-policy, large-to-small setting.
- Inconsistency between Motivation and Deployment: The method is motivated by removing the CFG composition so that "nothing is left to amplify". However, GFD is deployed with CFG at , where the unconditional branch is never trained, which reintroduces the composition the method aims to avoid. The claim that the unconditional branch "co-evolves" with the conditional branch is only asserted, not examined.
- Fairness of Comparison: The baselines are evaluated at , while GFD-OPD uses and an extrapolated target with . Since reward extrapolation is orthogonal to guidance folding, it could also be applied to the baselines. For a fair comparison, the baselines should also be evaluated with their best guidance scale on the task rewards and with the same extrapolated target.
[1] Meng, Chenlin, et al. "On distillation of guided diffusion models." CVPR (2023).
[2] Yang, Wenkai, et al. "Learning beyond teacher: Generalized on-policy distillation with reward extrapolation." arXiv preprint arXiv:2602.12125 (2026).
Questions for authors
- In Table 5, the "Standard OPD" row (on the SD3.5-Medium student) does not match the DiffusionOPD L→M results in either Table 2 or Table 3. Could you clarify the setting of this ablation and the difference between "Standard OPD" and DiffusionOPD?
- Since GFD trains the conditional branch to absorb the guidance, it can be deployed at with a single forward pass, halving the inference cost. Could you report the task rewards and image quality at in the main tables?
- How do DiffusionOPD, PDM and split-KL perform when combined with the same extrapolated target ()? Table 5 adds extrapolation only on top of guidance folding, so it remains unclear how much of the gap to the baselines in Tables 2–4 is due to extrapolation alone.