- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Robust Ensemble Guidance (REG) for scientific inverse problems with pretrained diffusion-based priors. The method modifies ensemble Kalman guidance using predictive-spread weighting and residual clipping, with the goal of improving robustness to heterogeneous observation scales and large residuals. Both local theoretical analysis and numerical experiments on Navier--Stokes, black-hole imaging, and full-waveform inversion are provided to justify the effectiveness of proposed methodology.
Critical strengths
The method is simple, computationally inexpensive, and easy to incorporate into existing ensemble-guidance algorithms. The experiments also quite comprehensive by covering several challenging scientific inverse problems.
Critical weaknesses
The reviewer's main concern is that the methodological novelty relative to standard normalization/preconditioning and robust ensemble-Kalman methods is somewhat limited. In addition, the theoretical results are mainly local, while the implemented algorithm operates in a nonlinear iterative regime, so the connection between the theory and the observed empirical gains could be explained more clearly.
The empirical improvements are also somewhat uneven across settings. For example, the reported Navier--Stokes gain varies substantially with ensemble size, and some of the measurement-consistency claims in the black-hole experiment do not appear uniformly stronger than competing methods.
Finally, the manuscript quality could be further enhanced by expanding the discussion on related work. Ensemble-based sampling and reweighting ideas have also recently been studied from the perspective of inference/test-time scaling in diffusion models [1-7]. It would also be useful to clarify how REG relates to this broader family of ensemble-based inference algorithms and compare their performance in practice if possible.
Questions for authors
-
Would it be possible for the authors to clarify the main conceptual novelty of predictive-spread weighting and residual clipping relative to existing robust/regularized ensemble Kalman methods?
-
How sensitive is REG to the clipping quantile and ensemble size?
References:
[1] Singhal, R., Horvitz, Z., Teehan, R., Ren, M., Yu, Z., McKeown, K., & Ranganath, R. (2025). A general framework for inference-time scaling and steering of diffusion models. arXiv preprint arXiv:2501.06848.
[2] Skreta, M., Akhound-Sadegh, T., Ohanesian, V., Bondesan, R., Aspuru-Guzik, A., Doucet, A., ... & Neklyudov, K. (2025). Feynman-kac correctors in diffusion: Annealing, guidance, and product of experts. arXiv preprint arXiv:2503.02819.
[3] Uehara, M., Zhao, Y., Wang, C., Li, X., Regev, A., Levine, S., & Biancalani, T. (2025). Inference-time alignment in diffusion models with reward-guided generation: Tutorial and review. arXiv preprint arXiv:2501.09685.
[4] He, J., Hernández-Lobato, J. M., Du, Y., & Vargas, F. (2025). Rne: a plug-and-play framework for diffusion density estimation and inference-time control. arXiv e-prints, arXiv-2506.
[5] Wang, C., Wang, W., Ren, Y., Blanchet, J., & Lu, Y. (2026, May). Simple Approximation and Derivative Free Inference-Time Scaling for Diffusion Models via Sequential Monte Carlo on Path Measures. In Forty-third International Conference on Machine Learning.
[6] Ren, Y., Gao, W., Ying, L., Rotskoff, G., & Han, J. (2026, April). Driftlite: Lightweight drift control for inference-time scaling of diffusion models. In International Conference on Learning Representations (Vol. 2026, pp. 76664-76702).
[7] Chen, H., Ren, Y., Min, M. R., Ying, L., & Izzo, Z. (2025). Solving inverse problems via diffusion-based priors: An approximation-free ensemble sampling approach. arXiv preprint arXiv:2506.03979.
4 comments
Response to Reviewer pjbD (Part 2)
W1. Methodological novelty and connection between the local theory and empirical gains.
We address the methodological novelty relative to normalization/preconditioning and robust EnKF in Q1 above. Regarding how the local theory connects to the empirical gains of the nonlinear iterative algorithm, two pieces of evidence bridge this gap:
- Fig. 2(c) evaluates the one-step criterion (Eq. 14) on 120 problems: the analytic and Monte Carlo risk gains correlate at and agree in sign in 97.5% of cases.
- The experiments match the mechanisms the theory predicts. In the ablation (Table 2), weighting and clipping each improve over EnKG. In the new contamination test (Section 4.6 and Table 6, in red), clipping caps the effect of corrupted observations.
We also extend the analysis beyond a single step:
- Under the same local model, with the weights and threshold held fixed, repeated REG updates are preconditioned gradient descent on a convex Huber loss. The loss therefore decreases monotonically, and the ensemble converges to the Huber estimate. The deviation caused by clipping stays within the data-informed subspace and is bounded uniformly in the number of steps.
- When the linearization varies along the trajectory, the per-step errors add up linearly rather than multiplying, provided each step is non-expansive up to a summable factor.
A global guarantee for the nonlinear sampler is not available for any polynomial-time diffusion posterior sampler (Gupta et al., 2024). Moreover, Kalman-type updates are not posterior-consistent for nonlinear models (Ernst et al., 2015).
We have added the contamination test to Section 4.6 and Table 6 of the revised manuscript (in red).
W2. Uneven gains across settings.
(a) Dependence on in Navier–Stokes. REG improves over EnKG at every tested in Table 2. The size of the gain varies because the two methods are limited by different factors:
- At small , REG's weights are themselves estimated from few samples, and Eq. (14) predicts a smaller advantage.
- At large , particle-based methods generally become more accurate.
Our method reduces the standard deviation of the results, as shown in Table 1. Also, Q2 shows that the gain is consistent across in black-hole imaging and FWI.
(b) Measurement consistency in black-hole imaging. We agree that REG does not attain the lowest among all methods. Two observations put the results in context:
- is not aligned with image fidelity in this problem. It measures agreement with the closure data, with an ideal value near 1. Because closure quantities lose the absolute position and total flux, many images fit the data equally well. For example, at 3% observation time, SMILI attains the closure-phase closest to 1 (1.48) but the lowest PSNR (18.51 dB). REG attains the highest PSNR (26.97 dB) with a closure-phase of 4.28.
- Relative to EnKG, REG improves both values by factors of 3–70. It also reduces their case-to-case spread by up to two orders of magnitude, which removes the divergent cases of EnKG.
W3. Relation to ensemble-based inference-time scaling.
Thank you for these references. We have added a paragraph to Section 2 (Particle-based inference-time scaling, in red). The key difference lies in the correction mechanism:
- These methods correct the ensemble by reweighting and resampling. Their accuracy therefore relies on importance weights, which degenerate when the likelihood is sharp and high-dimensional (Snyder et al., 2008). This is the typical regime of scientific inverse problems with many precise measurements.
- REG instead transports every particle along an ensemble-estimated direction, so the ensemble cannot collapse onto a few particles. It also addresses observation-scale imbalance and residual dominance, two failure modes specific to transport-based corrections.
We have added this discussion to Section 2 (Particle-based inference-time scaling) of the revised manuscript (in red).
We hope these clarifications and the newly added experiments address your concerns, and we welcome any further discussion.
Response
The reviewer appreciates the authors' detailed response, which has satisfactorily addressed most of the concerns raised in the original review. Consequently, the reviewer would be glad to raise the rating from 2 to 3.
Thank you very much for your approval. Thanks again for your insightful comments and suggestions.
Response to Reviewer pjbD (Part 1)
We sincerely thank the reviewer for the constructive comments and helpful references. We address your concerns and questions below:
Q1. Conceptual novelty relative to existing robust/regularized ensemble Kalman methods.
REG starts from an analysis of why the diffusion counterpart of ensemble Kalman inversion fails with finite ensembles, and each component is derived from that analysis. Relative to existing ensemble Kalman methods, the conceptual differences are as follows:
In summary, REG is a Huber-robust, Jacobi-preconditioned ensemble Kalman update whose weights and threshold are designed for, and analyzed in, the finite-ensemble diffusion setting. We have added this comparison to Section 2 (Robust estimation, in red).
Q2. Sensitivity to the clipping quantile and the ensemble size.
The gain of REG over EnKG is consistent across both hyperparameters. We ran new experiments while keeping all other settings as in the paper:
We have added the q sweep to Section 4.5 and Table 5 of the revised manuscript (in red).