- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies sampling from posteriors with nonsmooth convex composite potentials . It applies Moreau smoothing to the full potential and proposes iPULA, which replaces exact proximal evaluations in the resulting Langevin update with controlled approximations. The main result gives a non-asymptotic KL bound for averaged iterate laws with biased, potentially history-dependent errors. Further results concern objective gaps under a Polyak–Łojasiewicz condition and final-iterate Wasserstein bounds under strong convexity. Experiments consider Gaussian MRI deblurring and Poisson fluorescence-microscopy deconvolution with total variation regularization.
Critical strengths
-
Analysis accommodating biased and history-dependent errors. The general-convex KL analysis addresses an error model relevant to iterative proximal solvers without requiring unbiasedness. The explicit dependence on the error sequence, and the square-summability result, provide useful information about how inner approximation errors propagate through the outer sampling procedure.
-
Computable certificates linking optimization and sampling accuracy. The residual-to-gradient and gap-to-gradient bounds translate available inner-solver certificates into control of the Moreau-gradient error. This is a useful practical component: it makes the theoretical accuracy requirement more actionable than a condition involving the unknown exact proximal point alone.
Critical weaknesses
-
Insufficiently substantiated novelty claim for full-potential Moreau sampling. Section 1.2 claims priority for combining an inexact full-objective oracle with Moreau-based ULA. However, Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes already explicitly considers full-potential smoothing and uses iterative proximal computations in its experiments. Proximal-Based Generative Modeling for Bayesian Inverse Problems also studies joint-posterior proximal approximations and analyzes splitting error. These connections are not discussed.
-
Inaccurate and incomplete positioning against proximal-MCMC theory. Section 1.1 describes Ehrhardt et al. (2024) as replacing with its Moreau envelope while retaining . Their analyzed inexact PGLA instead uses a forward–backward update with Gaussian noise inside the proximal step, rather than the described MYULA construction. The paper also omits From stability of Langevin diffusion to convergence of proximal MCMC for non-log-concave sampling, which establishes ULA stability to drift approximations and PSGLA convergence for nonconvex potentials under strong convexity at infinity. A precise comparison of update rules, approximation models, assumptions, and convergence metrics is needed to assess the theoretical increment.
-
Restricted theoretical scope and an unresolved link to the implemented inner solver. All main results retain convexity, limiting their applicability to nonconvex posteriors; a discussion of weakly convex extensions would clarify this scope. More importantly, the different mean-square, conditional-mean-square, and almost-sure oracle conditions are not connected to the experimental implementation. Although residual and gap certificates are provided, the actual tolerance schedules, stopping rules, and inner iteration costs are insufficiently specified. The authors should identify which guarantees apply to the experiments and explain how the corresponding conditions are enforced.
-
Unquantified original-target error and insufficient justification of acceleration. Equation (23) acknowledges , but leaves this smoothing bias unquantified. The analysis therefore does not provide a joint choice of smoothing parameter, step size, chain length, and inner tolerances guaranteeing prescribed accuracy for the original posterior. Moreover, the convergence results add perturbation terms to standard ULA guarantees without establishing an improved convergence order or lower total computational complexity.
-
Limited empirical support for posterior accuracy and practical efficiency. The evaluation covers only two TV imaging settings, including real-source microscopy images. The reported ESS improvements are not normalized by total runtime, while time to peak PSNR is not a sampling-efficiency measure. Comparisons with directly related inexact and accelerated proximal samplers, including ESS per second at matched accuracy are needed. Broader inverse-problem evaluations and diffusion-based comparisons could strengthen generality.
Questions for authors
See Critical Weaknesses