- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LPNSR, a learnable noise prediction framework built on ResShift, a four-step residual-shifting diffusion model for image SR. The authors observe that, when the initial latent and pretrained denoiser are fixed, the intermediate noise samples determine the variation in the final reconstruction. Instead of sampling these noise maps from a standard Gaussian distribution, LPNSR introduces an additional network that predicts a conditional Gaussian distribution at each intermediate reverse step. Specifically, the paper proposes two training schemes: 1) LPNSR-A: The reverse diffusion chain is unrolled, and the noise predictor is optimized using latent-space L2, LPIPS, and adversarial losses on the final reconstruction. 2) LPNSR-B: The network predicts the residual between the ground-truth latent and the frozen denoiser's estimate. The authors derive the optimal noise mean from per-step KL minimization and train the residual predictor using L2 and LPIPS losses, while keeping the noise variance fixed.
Critical strengths
-
Clear formulation and implementation: The paper is well organized, and the proposed modification to ResShift is straightforward. The pretrained denoiser remains frozen, and the noise predictor is incorporated into the existing reverse update through a clearly specified parameterization.
-
Useful ablations: The authors investigate sensitivity to inference seeds (Table 2), loss functions (Table 4), deterministic versus stochastic prediction (Table 8), initialization versus intermediate noise prediction (Table 10), and inference efficiency (Table 7). The inclusion of computational overhead is particularly useful for assessing the method's practical value.
-
Perceptual performance: LPNSR-A achieves the best perceptual metrics among the compared methods, without relying on large-scale text-to-image pretraining.
Critical weaknesses
- Novelty: The novelty discussion would also benefit from a more careful distinction from prior work* on learned reverse-process variances, learned diffusion samplers, and adversarially trained reverse transitions. The distinction between learning a noise distribution and adding a residual-correction network is insufficiently established. The proposed formulation is presented as learning the distribution of intermediate diffusion noise. However, the interpretation of this contribution differs substantially between the two training schemes.
- Bridging the Distribution Gap to Harness Pretrained Diffusion Priors for Super-Resolution, ICLR 2026
- Arbitrary-steps Image Super-resolution via Diffusion Inversion, CVPR 2025
-
The comparisons do not adequately control for additional model capacity, training data, and loss functions: LPNSR increases the parameter count from 173.92M to approximately 292.52M, corresponding to a 70% increase. It also requires approximately 30% more FLOPs and 37% greater inference latency. These are substantial additional resources, yet the main comparisons do not include a baseline with a matched parameter or computational budget.
-
Fairness: The noise predictor is trained on approximately one million images collected from LSDIR, DIV2K, Flickr2K, and filtered web images, using objectives that include LPIPS and, for LPNSR-A, adversarial supervision. These training conditions are not matched to those of the frozen ResShift baseline. A particularly important missing comparison is to fine-tune the original ResShift denoiser, or train a larger denoiser, using the same data, objectives, and computational budget. Such experiments would help determine whether LPNSR provides benefits beyond conventional perceptual fine-tuning or increased network capacity. Although Table 9 includes a capacity-matched experiment, it uses considerably smaller models trained from scratch. It therefore does not fully address the capacity and training-budget confounds in the main experiments. The authors also acknowledge that residual correction produces larger gains at this smaller scale, where the base denoiser is less accurately fitted.
-
Limited evaluation of generalization and practical applicability: The experiments are restricted to a single diffusion backbone, ResShift, with four reverse steps. The method is not evaluated on alternative diffusion architectures or longer sampling schedules, despite the broader framing of learnable intermediate noise distributions. The evaluation also lacks real-world SR benchmarks such as RealSR or DRealSR.
Questions for authors
- Ground-truth perceptual quality: Can the authors report no-reference perceptual metrics for the HR images in Table 1 to substantiate the claim that LPNSR-B approaches the perceptual ceiling of the ground truth?
3 comments
We would be grateful to know whether our response has addressed your concerns. Your feedback is important for us to further improve the paper, and we remain available for any further clarification during the discussion period.
As the discussion period closes on November 18 (AoE), we would like to check whether our response above has addressed your concerns. We have not yet received further comments from you, and any feedback before the discussion closes would be very helpful; we remain available to provide clarification immediately.
Response to Reviewer bhqH
We thank the reviewer for the constructive comments and we address the questions below point by point.
Response for Q1:
To substantiate this claim, we compute the three no-reference metrics on the HR ground-truth images and compare them with the outputs of Origin and LPNSR-B:
On both datasets the ground truth scores highest on all three metrics, and LPNSR-B lies strictly between Origin and the ground truth in every case: the perceptual quality of LPNSR-B moves toward the ceiling set by the ground truth.
Response for weakness:
Distinction from InvSR and DM-SR. Both methods attempt to construct a diffusion starting point that improves the quality of the generated image. Our target is instead the noise injection at the intermediate diffusion steps. InvSR already considered a predictor for the intermediate steps (InvSR-Int), but its training scheme brought no gain; our contribution is to provide effective ways of training such a predictor.
For matched parameter and computational budgets, Table 9 in Appendix A.5 trains two models from scratch with comparable capacity (48.19M vs 50.16M) and the same total budget of 300k iterations. In this setting the residual-correction scheme improves PSNR by 0.39 dB over the monolithic model, more than the 0.10 dB it gains at full scale, which indicates that the benefit comes from the formulation rather than from the additional parameters. We understand the concern about the inference latency and the additional parameters. We would point out that our focus and contribution is the training of an intermediate noise predictor rather than these costs, and that reducing the overhead by optimizing the capacity and architecture of the predictor is an interesting direction for future work.
Under the same training setting and budget, we fine-tune the ResShift backbone. The results are as follows:
Fine-tuning decreases fidelity slightly and increases perceptual quality slightly, but the change is small: the ResShift backbone is already well trained on natural images, so further fine-tuning can hardly yield a noticeable benefit. We would also point out that the gain of LPNSR-A over Origin at full scale (MUSIQ +4.32) is far larger than what fine-tuning provides, so it cannot be attributed to compensating an under-fitted base denoiser.