- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies a two-stage approach for one-step generation: reconstruction pretraining followed by distribution-matching fine-tuning. The main finding is that pretraining at a single noise level can already provide a good initialization. The paper also tests different combinations of pretraining and fine-tuning objectives and finds a recipe that achieves strong results. I think the paper has useful findings and a strong training recipe. My main concerns are the overclaims, the lack of a controlled comparison for the noise distribution, and the unclear FLOPs accounting. I would be willing to raise my score if the authors address these points.
Critical strengths
-
The paper shows that single-noise pretraining works for one-step generation. I think this is an interesting finding, since it suggests that we do not need to learn the full denoising process to get a useful initialization.
-
The ablations show that different pretraining objectives and distribution-matching losses can work well together. They provide useful evidence that this two-stage approach is efficient and can achieve reliable results.
-
The authors find a training recipe that achieves state-of-the-art results on the reported benchmarks. The results benefit substantially from perceptual supervision, as shown by the ablation. However, many existing works also use such losses, so I do not consider this a separate weakness.
Critical weaknesses
-
I think the paper overclaims its novelty. The method relies on a combination of many existing tools, including pretraining, feature-space distribution matching, multiscale features, OT-based objectives, and perceptual losses. The paper does show that these components work well together, and this is valuable. But this does not automatically make the combination an entirely new method. The “Priming Models” framing should be more precise about what is actually new.
-
Fixed-noise denoising pretraining followed by downstream fine-tuning also has prior work, including Brempong et al. [1] for semantic segmentation and Zaidi et al. [2] for molecular property prediction. These papers should be cited and discussed. They are not about one-step generation, but they do show that fixed-noise pretraining itself is not new.
-
I also think “entirely alleviate the difficulty of distributional training” is too strong. The experiments show that pretraining helps in the tested settings. They do not show that the difficulty has been entirely removed. I see the main contribution as showing that single-noise pretraining provides a good initialization for one-step generation, backed by useful ablations and a strong training recipe.
-
Single-noise pretraining works, but why prefer it? The paper does not clearly answer this question. Multiple-noise pretraining performs better in the text-to-image experiments, although it also uses a different training budget. The supplementary ImageNet comparison uses different settings from the main experiment. I would like to see a comparison under the main ImageNet settings, with only the noise distribution changed. This would tell us whether single-noise pretraining has an advantage or is simply one choice that works.
-
I am not sure what is included in the reported EFLOPs. Does the calculation include online generation of both active and reference samples? Does it include feature extraction for real and generated samples, and backpropagation through the frozen feature encoders to the generated images? These costs matter for the efficiency comparison and should be counted consistently across methods.
Questions for authors
-
Could the authors repeat the main ImageNet experiment and only replace the fixed noise level with reweighted logit-normal? Please keep the architecture, training budget, perceptual losses, fine-tuning settings, and evaluation the same.
-
Could the authors explain the EFLOPs calculation, including the costs mentioned in W3, and clarify whether the baselines use the same accounting?
9 comments
[W4 + Q1] noise distribution
Following the reviewer’s suggestion, we conducted an additional experiment under the Priming-B-80 setting in ImageNet, replacing the fixed noise level with a JiT-style reweighted logit-normal distribution while keeping everything else unchanged.
| Pretraining | FID ↓ | FDr⁵ ↓ |
|---|---|---|
| Fixed 0.8 | 1.47 | 12.71 |
| JiT-style reweighted logit-normal | 1.52 | 13.81 |
Under this controlled setting, single noise level pretraining at s=0.8 performs better than reweighted logit-normal pretraining on both FID and FDr^5. This result supports the effectiveness of single noise level pretraining, while also showing that a noise distribution that doesn’t cover the entire noise level is not necessarily beneficial for our training recipe. We will include this comparison in the revised paper.
We further provide an intuition for why a single, carefully selected noise level can be effective. Prior works have highlighted the importance of noise-level selection in diffusion model training (Choi et al., 2022; Hang et al., 2023, 2025). In particular, Hang et al. (2025) show that emphasizing noise levels around log SNR = 0 can improve training efficiency. Furthermore, Hoogeboom et al. (2023) and Chen (2023) demonstrate that the appropriate noise level depends on image resolution.
Interestingly, our empirical results suggest that the optimal fixed noise levels, s=0.8 for ImageNet (256x256) and s=0.35 for CIFAR-10 (32x32), both correspond to an effective log SNR close to zero when accounting for resolution. Specifically, under our noising formulation , the resolution-based log SNR becomes , following Hoogeboom et al. (2023), with 64x64 as the reference resolution. Setting this quantity to zero yields s=0.8 for 256x256 and s=0.333 for 32x32, closely matching our empirical findings.
These observations suggest that the benefit of fixed-noise pretraining may come from concentrating the pretraining objective on an effective intermediate denoising regime, where the corrupted image retains meaningful structure while requiring substantial denoising. Rather than implying that fixed-noise pretraining is better, our results indicate that a carefully chosen fixed noise level can also be effective.
One thing to also note is that when we use the reweighted logit-normal pretrained model as a flow matching model to generate samples with 100-step Euler, FID=10.09 and FDr^5=31.79, underperforming poorly to its post-training counterpart. This result shows how effective the distributional post-stage is, demonstrating that an appropriate recipe (our method) can significantly enhance the performance of a generative model.
[W5 + Q2] Training compute accounting
I am not sure what is included in the reported EFLOPs. Does the calculation include online generation of both active and reference samples?
We clarify that our reported training EFLOPs already include the cost mentioned by the reviewer, including active and reference sample generation, feature extraction for real and generated images, and backpropagation through the frozen feature encoders to the generated images. The detailed breakdown of the training cost is provided below.
| Component, EFLOPs | B160 | L160 |
|---|---|---|
| Pretraining, including perceptual loss | 76.8703 | 175.3278 |
| Active + reference generation, plus active generator backward | 6.5575 | 22.8711 |
| Real-image feature extraction | 13.5423 | 13.5423 |
| Active-image feature extraction | 6.7711 | 6.7711 |
| Reference-image feature extraction | 6.7711 | 6.7711 |
| Active encoder forward replay | 6.7711 | 6.7711 |
| Encoder input-backward + counted OT operations | 6.8996 | 6.8996 |
| Total | 124.1831 | 238.9542 |
We apply the same FLOPs counting protocol consistently to our models and baselines, ensuring a fair training-compute comparison.
References
- Vincent et al., “Extracting and Composing Robust Features with Denoising Autoencoders,” ICML 2008.
- Hang et al., “Improved Noise Schedule for Diffusion Training,” ICCV 2025.
- Choi et al., “Perception Prioritized Training of Diffusion Models,” CVPR 2022.
- Hang et al., “Efficient Diffusion Training via Min-SNR Weighting Strategy,” ICCV 2023.
- Hoogeboom et al., “simple diffusion: End-to-end diffusion for high resolution images,” ICML 2023.
- Chen, “On the Importance of Noise Scheduling for Diffusion Models,” arXiv 2023.
Thank you for your hard work. Your additional experiments have provided useful evidence for the effectiveness of fixed-noise pretraining on ImageNet, and your detailed compute breakdown has addressed my concern about training compute accounting. However, I still have some questions about the generality of the fixed-noise pretraining claim, as well as concerns regarding the writing, framing, and literature attribution.
W1. As I said in my review, I did not question the value of discovering that these tools work efficiently in combination. My concern was, and remains, that the terminology and framing obscure the precise nature of the contribution.
First, my concern is what the term "Priming Models" refers to. I see the contribution primarily as an insight or a training technique rather than an entirely new model family, so I find the term confusing.
Second, to answer the question in the title, the evidence does not suggest that we are overthinking one-step generation. Every component of this recipe builds on existing tools and techniques, including denoising pretraining, LPIPS and ConvNeXt perceptual losses, multi-scale features from frozen encoders, and Sinkhorn OT distribution matching. The results demonstrate that this two-stage training recipe can be effective, but they do not establish that previous approaches to one-step generation were unnecessarily complicated.
Another source of confusion is that while the additional experiments on ImageNet demonstrate the effectiveness of fixed-noise pretraining, the best-performing text-to-image configuration and the world modeling experiments still use the reweighted logit-normal noise distribution. The paper should explicitly explain the motivation for using logit-normal noise in these tasks and clarify whether the claimed sufficiency of fixed-noise pretraining extends beyond ImageNet. Otherwise, the scope of the claims regarding fixed-noise pretraining should be reconsidered.
The framing of this paper should describe the contribution accurately and give due credit to prior work. In my view, a more accurate framing would be that reconstruction-based pretraining provides an effective initialization for feature-space distributional post-training, improving its efficiency and performance.
W2. Again, I agree that using fixed-noise denoising pretraining for downstream generative modeling serves a different purpose from earlier discriminative work. However, the paradigm of fixed-noise denoising pretraining followed by downstream fine-tuning has already been explored in Brempong et al. and Zaidi et al. Citing general denoising autoencoders does not replace discussing prior work that specifically established fixed-noise pretraining. Notably, your rebuttal contrasts your task with Brempong et al. and Zaidi et al., but does not state whether you will include them in the revision. At a minimum, the paper should explicitly cite and discuss its connection to those earlier studies and give them due credit.
I will reconsider my score based on how the authors address these remaining concerns.
References
[1] Brempong et al., “Decoder Denoising Pretraining for Semantic Segmentation,” arXiv:2205.11423, 2022. https://arxiv.org/abs/2205.11423
[2] Zaidi et al., “Pre-training via Denoising for Molecular Property Prediction,” arXiv:2206.00133, 2022. https://arxiv.org/abs/2206.00133
We thank the reviewer for the valuable feedback and suggestions. We address the concerns below.
[W1 + W3] Novelty and contribution
We would like to clarify that our main contribution is to demonstrate that combining simple, established techniques enables effective and efficient one-step generation. We do not claim novelty for the individual components in our manuscript.
We believe this finding constitutes a substantial contribution in its own right. In particular, it is striking that a combination of long-established tools (such as denoising pretraining and Sinkhorn-based distribution matching) can achieve such strong empirical performance. The novelty lies in identifying a simple training recipe and demonstrating its effectiveness.
Regarding the phrase “entirely alleviating the difficulty of distributional training,” we agree that this wording is too strong. We will revise it to “substantially improving the efficiency of distributional training” to better reflect the scope.
[W2] Prior work on denoising pretraining
We would like to point out that denoising pretraining itself has been widely used and has become a conventional technique in representation learning, starting with denoising autoencoders (Vincent et al., 2008).
The works by Brempong et al. and Zaidi et al. also demonstrate its usefulness for downstream discriminative tasks, including semantic segmentation and molecular property prediction.
Crucially, our work uses denoising pretraining for generative modeling, whose purpose significantly differs from conventional representation learning tasks.