- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The work introduces Correction Training, which is a technique that helps in improving the quality of samples produced by diffusion processes by learning to enhance the predictions of the denoiser. The suggested corrector receives as input the clean sample predicted by denoiser and is trained to recognize the same ground-truth target without needing further supervision. Though the corrector is trained with one step of correction, it can still be used iteratively for enhancing the generated samples during inference.
This approach is tested with conditional as well as unconditional ImageNet generation by applying the four following types of architecture (DiT, SiT, SiT-REPA, and JiT) and also with using NanoGen for creating images from text. The results show significant improvement in FID values especially for unconditional generation. Furthermore, it offers results comparable to those acquired by the classifier-free guidance (CFG) technique utilizing the same inference budgets.
Critical strengths
- The proposed correction seems simple and without any modifications in diffusion objective or proposing any additional supervision, it learns to improve the denoiser’s output by correcting it based on ground truth targets.
- The work validates itself on four different ImageNet architectures (DIT, SiT, SiT-REPA, and JiT) and in all of them, as shown in table 1, it shows consistent improvement in FID.
- In unconditional generation, shown in table 2, the work shows that it can improve FID (24.82 -> 5.37) and can outperform autoguidance (9.37) with same NFE and without using class conditioning or external guidance.
Critical weaknesses
- Most quantitative experiments use ~ 250 NFEs. Even the distilled model in table 6 is evaluated in 83 NFEs. I understand that the goal is to reduce numerical integration error as much as possible and focus on modeling error but it is currently unkown how the proposed method works in low NFE, a budget that is more commonly used in practice, and whether the the numerical integration error becomes significant or not. a FID-versus-NFE curves at 10, 20, 50, 100 NFE and comparing the baseline, baseline + correction, and distilled student can better help us gain insight in how the correction works in low NFE settings.
- Table 14 uses different correction iteration counts and active interval across different architectures used in the experiment. For example, DiT uses for the full trajectory but JiT uses for . This should complicate the usage of correction to a new method because it appears that it might be helpful for some if it is applied for full trajectory and for some in subset of trajectory and with different value of K.
- The work mentions “reduced diversity” as one of the main issues of CFG. However ifigure 6 and 8 show that increasing K makes precision better but reduces recall. Although the method can achieve a more favorable trade-off than CFG, it still suffers from underlying loss of distributional coverage that CFG has.
- Although the work has tested several ImageNet architectures, for T2I configuration in section 3.2 it only tests a DiT with a DDT head and there is no evidence if it can transfer to another T2I architecture or a substantially larger production-scale model that can generate with higher-resolution. This concern is also related with number of NFEs because with those production-scale models 250 NFE is not practical and correction should work in low NFE.
- For the human evaluation in table 4, even though both CFG baseline and CFG + correction use 50 denoising steps, the CFG baseline has 100 NFE but in CFG + correction we have (i) the CFG scale is different and (ii) with K=8 we have 50 * (2+8) =500 NFE that is 5x the CFG baseline. Therefore it is not an apple-apple comparison as the CFG + correction uses more NFE and different CFG scale.
Questions for authors
- How the hyperparameters in table 14 is selected?
- Could the authors explain how the prediction error (e.g., mean square error of predicted vs. actual labels) changes when K increases at different noise levels. This would help understand if the enhancement of quality of generated samples is achieved by correct denoising predictions or due to moving the produced distribution to more visual samples.
5 comments
Response to Reviewer SXZP (2/3)
C2. "Table 14 uses different correction iteration counts and active interval across different architectures used in the experiment. For example, DiT uses for the full trajectory but JiT uses for ."
Q1. "How the hyperparameters in table 14 is selected?"
Correction has two inference-time hyperparameters (correction count and correction interval) analogous to CFG's guidance scale and guidance interval. Both can be adjusted using the same trained checkpoint without retraining, making them relatively cheap to tune. Such inference-time sweeps are also standard practice for guidance parameters, as in REPA and JiT. As with CFG, suitable settings can vary with the model family, size, and whether generation operates in pixel or latent space. Also, In practice, users can inspect a few samples to identify plausible settings.
For Table 14, we sweep using FID@5K and evaluate the selected setting with FID@50K. We follow each baseline’s sampling conventions when deciding whether to tune the interval. For DiT and SiT, we apply correction throughout the trajectory, as their baselines do for CFG. For SiT-REPA and JiT, the baseline evaluations include guidance-interval sweeps, so we also sweep correction intervals. We search interval endpoints on a coarse grid and try nearby values in steps of when needed.
C3. "The work mentions “reduced diversity” as one of the main issues of CFG. However ifigure 6 and 8 show that increasing K makes precision better but reduces recall. Although the method can achieve a more favorable trade-off than CFG, it still suffers from underlying loss of distributional coverage that CFG has."
Thank you for pointing out this. Our wording was not very clear: we meant to say that while reduced diversity is one of the main issues of CFG, it is much less pronounced with our method, as can be seen in qualitative figures (Fig. 9 in the update manuscript). However, this qualitative improvement is not well captured by the Recall metric in Fig. 6 and Fig. 8, due to its well-known limitations: outliers can inflate the estimated manifold of generated samples and increase recall without improving coverage of realistic samples [1]. We therefore complement Recall with the Coverage metric [1], which was proposed to address this outlier sensitivity. As can be seen in the table below, correction improves coverage over the unguided baseline despite lower recall, suggesting that recall alone may not fully characterize the change in sample diversity. We revised the manuscript to add the coverage metric (Fig. 6 and Fig. 8) and cleaned up this explanation.
Response to Reviewer SXZP (3/3)
C4. "Although the work has tested several ImageNet architectures, for T2I configuration in section 3.2 it only tests a DiT with a DDT head and there is no evidence if it can transfer to another T2I architecture or a substantially larger production-scale model that can generate with higher-resolution."
Thank you for raising this point. Our study centers on ImageNet, following the evaluation scope of architectural studies such as DiT and JiT. We validate correction across four architectures spanning latent and pixel spaces, and additionally demonstrate its applicability to text-to-image generation. Broader evaluation on other T2I architectures and production-scale models would be valuable, but these experiments are too costly to perform and are beyond the scope of this paper. We do agree with the reviewer that larger-scale T2I experimentation is an important future direction.
C5. “For the human evaluation in table 4, ... it is not an apple-apple comparison as the CFG + correction uses more NFE and different CFG scale.”
Thank you for pointing out this confounder. We repeated the human evaluation using the same CFG scale (w=6), the same total inference budget (250 NFEs). Under these controlled settings, CFG + correction (K=6) remains preferred over CFG alone for both quality (62.9%) and diversity (55.8%). We have updated Table 4 with these results.
| Method | Quality ↑ | Diversity ↑ |
|---|---|---|
| CFG baseline | 37.1% | 44.2% |
| CFG + Correction | 62.9% | 55.8% |
Q2. "Could the authors explain how the prediction error (e.g., mean square error of predicted vs. actual labels) changes when K increases at different noise levels. This would help understand if the enhancement of quality of generated samples is achieved by correct denoising predictions or due to moving the produced distribution to more visual samples."
Thank you for this insightful question. We have updated our discussion section in an attempt to provide better intuition for why this method works. In Fig. 27, we report the prediction MSE across different correction counts and noise levels, as requested by the reviewer. Interestingly, the MSE increases as we apply more correction iterations (note that the error is measured on noisy real data, not on inference states). But the final sample quality improves.
This may seem counterintuitive at first glance. One possible explanation for this is the training–inference gap. During diffusion sampling, prediction errors due to neural network approximation can accumulate across steps, so the denoiser encounters states different from the noisy real images seen during training, potentially degrading sample quality. By sharpening and refining predictions before constructing the next noisy state, correction may bring subsequent inputs closer to the training distribution. We quantify the gap with a two-sample classification test, and it shows that iterative correction narrows this gap (Sec. D.3 and Fig. 28). Bringing the inputs to subsequent denoising steps closer to the training distribution may help explain the improvement in sample quality. We present this analysis in Section 4 and Sections D.3–D.4 of the appendix.
Response to Reviewer SXZP (1/3)
We thank the reviewer for their careful reading of our manuscript and detailed feedback, which helped us strengthen the experimental evaluation and explore how iterative correction improves sample quality. We are happy that the reviewer found the proposed correction "simple" and noted that it improves the denoiser's output "without any modifications in diffusion objective or proposing any additional supervision". Below, we address the reviewer's concerns and clarify a few points about our method and experimental setup.
C1. "Most quantitative experiments use ~ 250 NFEs. … a FID-versus-NFE curves at 10, 20, 50, 100 NFE and comparing the baseline, baseline + correction, and distilled student can better help us gain insight in how the correction works in low NFE settings."
C4-2. "This concern is also related with number of NFEs because with those production-scale models 250 NFE is not practical and correction should work in low NFE."
Thank you for this suggestion. We would like to note that 250 NFE is indeed a standard setting for many academic papers on ImageNet generation, and works including DiT, SiT, REPA all adopt this setting, and we follow the standard practice. Nonetheless, we are happy to further examine both the effect of using few denoising steps and performance under a limited total inference budget, which may provide better insight on how the method works in more commonly used budget in practical text-to-image generation
First, when the number of denoising steps is fixed, adding correction improves FID even in the few-step regime (Table A). This shows that correction remains effective when the denoising trajectory is coarsely discretized.
Table A. FID@5K for the baseline and the baseline with correction (K=2) at matched denoising step counts. See Fig. 18 in Appendix C.1 for the corresponding plot.
Second, Table B reports FID for the baseline, baseline + correction, and distilled student at matched total NFE budgets, including 10, 20, 50, and 100 NFEs. Under very small budgets, allocating evaluations to correction leaves too few denoising steps (e.g., only 3 denoising steps in total NFE=10), so an increased numerical integration error may outweigh the benefits of correction. By distilling one denoising step + multiple correction steps into a single student step, the distilled student can outperform the baseline even in the low NFE regime.
Table B. FID@5K across different NFEs on baseline, baseline + correction, distilled student (SiT-XL/2, guidance scale w=1). See Fig. 19 in Appendix C.1 for the full FID-versus-NFE curves.
We also note that, at higher inference budgets, adding correction yields FID scores that the baseline cannot match even with additional denoising steps. Together, baseline + correction and the distilled student form the Pareto frontier for inference compute (total NFE) and sample quality (FID), achieving lower FID than the baseline at both practical low-NFE budgets and higher inference budgets.