- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper develops a convergence theory for modern Plug-and-Play (PnP) reconstruction by interpreting annealed PnP iterations as discretizations of stochastic differential equations.
The key observation is that, through the connection between denoiser residuals and score functions, a PnP update can be interpreted as an Euler--Maruyama discretization of a time-inhomogeneous SDE. This shifts the theoretical perspective from classical fixed-point analysis, which typically relies on non-expansiveness, Lipschitzness, or contraction properties of the denoiser, toward an SDE perspective based on dissipativity and ergodicity.
Under appropriate assumptions, the paper establishes discretization-error bounds, proves existence and uniqueness of an invariant distribution and geometric ergodicity of the limiting dynamics, and bounds the distance between the invariant distribution and a variance-inflated Bayesian posterior in terms of score approximation error. The resulting theory covers a regime with bounded but potentially non-contractive denoisers, dissipative data-consistency dynamics, and a non-vanishing noise floor.
The paper complements the theoretical analysis with experiments using diffusion priors and conventional denoisers across several inverse problems, examining convergence behavior, discretization error, stability conditions, and reconstruction performance.
Critical strengths
-
I find the main conceptual shift of the paper interesting and potentially important. Viewing modern PnP reconstruction as a discretized stochastic process rather than primarily as a deterministic fixed-point iteration provides a natural way to analyze annealed denoisers and score-based priors that do not fit comfortably within classical contraction-based PnP theory.
-
The paper provides a substantial theoretical development rather than only pointing out the connection between denoising and score estimation. It derives discretization-error bounds, establishes conditions for ergodicity and weak convergence, and quantitatively relates the invariant distribution of the resulting dynamics to the target posterior.
-
The theory appears to cover a practically relevant regime that is difficult to handle using traditional PnP convergence analyses: bounded but non-contractive denoisers combined with dissipative data-consistency dynamics and a non-zero terminal noise level. I think this extension beyond contraction-based assumptions is one of the strongest aspects of the paper.
-
I also appreciate the connection between the theoretical quantities and empirical experiments. The paper tests multiple denoisers and inverse problems and includes experiments targeting specific theoretical predictions, such as discretization error and the stability role of the terminal noise level.
-
More broadly, I think the paper provides a useful conceptual bridge between the PnP and score/SDE perspectives. This may be valuable for understanding modern reconstruction methods in which the prior is increasingly implemented through diffusion or score-based models.
Critical weaknesses
My main concern is presentation and motivation rather than the technical direction of the work.
I found the central conceptual contribution unnecessarily difficult to extract, especially for a general ICLR reader who is not already familiar with PnP reconstruction, score-based models, Tweedie's identity, Euler--Maruyama discretization, and SDE ergodicity. The paper moves relatively quickly into the mathematical development, while the high-level conceptual shift is both simple and important.
In my understanding, the central message is that modern annealed PnP should not necessarily be analyzed as a deterministic map converging to a fixed point. Once the denoiser residual is interpreted as a score, the iteration can instead be viewed as a discretized stochastic process. The relevant theoretical question then changes from whether the iteration is contractive to whether the associated SDE is well-posed and ergodic, what invariant distribution it approaches, and how close that distribution is to the desired posterior. I think this conceptual transition should be made substantially more explicit near the beginning of the paper.
Relatedly, the paper would benefit from a much clearer explanation of the practical significance of the theoretical results. The authors establish a new convergence regime based on dissipativity, boundedness, and a non-vanishing noise floor rather than classical contraction assumptions. However, the introduction does not make sufficiently concrete which practically important modern PnP methods are excluded by previous theory but covered by the present results. Explicitly identifying representative modern denoisers or diffusion-based PnP procedures for which classical theory fails but the proposed theory applies would make the contribution much easier to appreciate.
I also strongly recommend adding a conceptual overview figure near the beginning of the paper. Currently, the first figure appears only in the experimental section. A simple figure contrasting the two theoretical perspectives could communicate most of the paper: classical PnP -> contraction/non-expansiveness -> fixed point, versus denoiser residual -> score -> Euler--Maruyama -> reverse SDE -> ergodicity -> invariant distribution close to the posterior. Such a figure would significantly lower the barrier to understanding the paper.
Finally, because the theoretical contribution depends on assumptions such as dissipativity, bounded drift/denoiser behavior, and a non-zero terminal noise level, I think the paper could do more to explain how restrictive these assumptions are in practical modern PnP systems. In particular, it would be helpful to distinguish assumptions that are primarily technical devices for the proof from assumptions that practitioners should actually enforce when designing an algorithm.
Questions for authors
-
Could the authors state more concretely which practically important PnP methods are newly covered by the proposed theory but are not covered by existing contraction/non-expansiveness-based analyses? A few explicit examples would make the significance of the theoretical contribution much clearer.
-
How restrictive is the dissipativity assumption in practice? For commonly used inverse problems and data-consistency operators, when should one expect it to hold, and when might it fail?
-
How should practitioners interpret the requirement that sigma_min > 0? Is the non-zero noise floor fundamentally necessary for the stochastic interpretation and convergence result, or mainly a sufficient condition required by the current proof technique? What should one expect as sigma_min approaches zero?
-
The theory assumes boundedness conditions on the denoiser/drift. To what extent are these conditions satisfied by practical neural denoisers such as DRUNet or diffusion-based score networks? Can they be verified or approximately measured empirically?
-
I would encourage the authors to add a conceptual overview figure near the beginning of the paper. Could the main contribution be summarized explicitly as a transition from the classical “PnP -> contraction -> fixed point” perspective to a “PnP -> score -> SDE -> ergodicity -> posterior” perspective?
-
More generally, could the authors provide a short intuitive explanation, before the formal theory, of why the SDE viewpoint enables convergence guarantees in cases where the classical fixed-point viewpoint fails? I think this would make the paper substantially more accessible to readers outside the PnP/SDE community.