- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes high-order diffusion solvers for linear inverse problems, building on the posterior-mean corrections of DiffPIR and DDNM. The authors formulate conditional diffusion ODEs and SDEs that retain a semilinear structure and use the singular value decomposition of the forward operator to efficiently compute operator-dependent coefficients in the spectral domain. Existing numerical approximation strategies from DPM-Solver++ and UniPC are then applied to the remaining nonlinear model prediction, with guidance strength and stochasticity controlling measurement influence and sampling noise. Experiments on CelebA and ImageNet evaluate random inpainting, compressed sensing, and motion deblurring, reporting improved reconstruction quality over several baselines at 5–10 neural function evaluations (NFEs).
Critical strengths
-
The paper is well-written and clearly organized. The motivation, mathematical formulation, and numerical implementation are presented coherently, making the proposed approach relatively easy to follow.
-
The paper provides a systematic formulation connecting existing diffusion inverse solvers with high-order numerical integration. In particular, identifying the shared structure of DiffPIR/DDNM measurement corrections and exploiting spectral diagonalization to efficiently handle operator-dependent coefficients is technically useful.
-
The experiments demonstrate substantial improvements in the few-step regime, particularly for random inpainting. The evaluation covers multiple datasets and inverse tasks, and the appendices provide additional comparisons, numerical-order ablations, guidance and stochasticity studies, and runtime analyses with closed-form baseline implementations.
Critical weaknesses
-
The technical novelty appears limited. The method builds on the posterior-mean corrections of DiffPIR/DDNM and adopts numerical approximation strategies from DPM-Solver++ and UniPC. Guidance scaling and controllable stochasticity are also established components. Although combining these techniques into a spectral formulation for conditional diffusion is useful, the paper does not clearly establish a distinctive numerical principle beyond adapting and combining existing methods. The overall contribution therefore appears relatively incremental.
-
The source of the large reconstruction gains remains insufficiently isolated. In Table 1, DiffPIR improves from 17.53 dB to 26.10 dB with the proposed first-order DPM-1 variant, while UniPC-2 further improves this to 27.13 dB. Table 14 also shows that the same UniPC-2 solver at NFE = 5 and improves from 18.37 to 27.13 dB when increases from 1 to 4. These results suggest that the reformulation and guidance settings contribute substantially to the reported baseline gap, but their effects are not adequately separated from those of higher-order integration.
-
The experimental comparisons are restricted to very small sampling budgets. While equal-NFE comparisons at 5 and 10 steps are appropriate for evaluating few-step performance, existing methods such as DDRM, DDNM, and DiffPIR typically operate at 20–100 NFEs, as acknowledged in the introduction. The paper does not compare the proposed solvers against these baselines at their commonly used sampling budgets. Consequently, it remains unclear whether the proposed methods can achieve comparable reconstruction quality with substantially fewer evaluations. Such comparisons would provide stronger evidence of their practical acceleration benefits.
-
The hyperparameter-selection protocol is insufficiently specified. Appendix A reports parameter values and their sources, but does not describe the validation data, selection criterion, search ranges, or tuning budgets. The proposed methods use task-specific guidance settings, whereas most baseline settings are inherited from earlier work. Given the strong guidance sensitivity shown in Appendix F.3, it is unclear whether the reported advantage persists when baseline parameters and timestep schedules receive comparable tuning for the evaluated NFE budgets.
-
The statistical reporting requires clarification. The quantitative tables report PSNR, SSIM, and LPIPS with values, but do not specify whether these represent standard deviations, standard errors, or variability across repeated sampling runs. Although Section 4.1 states that 100 test images are used, the aggregation procedure and number of stochastic sampling repetitions are not clearly described.
Questions for authors
-
Could the authors further isolate the contributions of the conditional reformulation, guidance strength, and numerical approximation order to the reported reconstruction gains? The existing ablations are informative, but additional matched controls would help establish how much of the improvement is specifically attributable to higher-order integration.
-
Could the authors explain why the performance improvement observed for random inpainting is substantially larger than for compressed sensing?
-
Could the authors additionally evaluate the baselines at their commonly used sampling budgets (e.g., 20–100 NFEs) and compare their reconstruction quality with the proposed 5–10 NFE results? Reporting the corresponding total inference runtimes would help establish whether the proposed solvers achieve comparable reconstruction quality at lower computational cost.
-
How were hyperparameters selected for each method, including the validation split, selection metric, search ranges, and tuning budgets? Were baseline parameters and timestep schedules adjusted for each NFE budget?