- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the loss of same-prompt diversity in few-step diffusion models trained with distribution-matching distillation. Through a teacher-prefix intervention on a four-step SD3-Medium student, the authors observe that replacing the first student interval with the corresponding teacher trajectory recovers most of the measured diversity gap, even when the remaining student steps are left unchanged. Motivated by this observation, the paper proposes ReSeed, a lightweight post-distillation correction. ReSeed inserts trainable per-channel biases into transformer blocks, enables them only during the first denoising step, and optimizes them to match the teacher’s secant velocity over the corresponding interval. Experiments cover SD3-Medium, SD3.5-Medium, FLUX.1-dev/SenseFlow, and Wan2.1 text-to-video generation. ReSeed substantially increases feature-space diversity and often improves FID
Critical strengths
- The teacher-prefix replacement experiment shows that replacing only the first student step recovers most of the lost diversity, while the frozen suffix can preserve the restored seed differences. This observation leads naturally to ReSeed. Repairing diversity in an existing distilled checkpoint, instead of modifying or repeating the original distillation, is both practically useful and relatively novel.
- ReSeed keeps the student backbone frozen and trains only a small set of first-step bias parameters. It introduces only 0.002–0.004% additional parameters, requires no target images or perceptual/adversarial losses, and adds no extra denoising steps. The reported inference overhead is also negligible.
- The method is evaluated on three image-generation model families and one video generator. The main image experiments use multiple training seeds, while matched prompts and initial noises are used throughout the comparisons. The paper also reports multiple diversity and quality metrics rather than presenting diversity gains alone.
Critical weaknesses
- The current controls do not fully isolate whether the proposed bias parameterization is especially effective. Comparisons with a parameter-matched first-step LoRA or adapter, as well as the same bias applied to later steps, would help clarify which design choice matters.
- The regression target is constructed by running the teacher for a fixed number of microsteps over the first student interval, but the effect of this choice is unclear. It would be useful to vary the number of teacher steps used to compute the secant target. If fewer steps achieve similar results, the training cost could be reduced substantially
Questions for authors
In the qualitative comparisons in Appendix F, ReSeed appears to produce more complex and cluttered backgrounds than the teacher and other student baselines. This is particularly noticeable in the first case of Figure 11, “a couple of buckets in a white room,” where the ReSeed samples often introduce colorful objects and detailed environments, seemingly weakening the “white room” constraint. Have the authors observed a systematic trade-off between recovered diversity and prompt adherence, especially for prompts specifying simple backgrounds or compositions?
Thank authors for detail reply. I've had a good faith in this paper already hence its score of 3. Unfortunately, I don't think the paper is super good enough to raise to 4. So I've decided to maintain my score of 3.