- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Uncertainty-Contraction Ensemble Guidance (UCEG), an adaptive observation selection method for Ensemble Kalman Guidance (EnKG) in black-box inverse problems. The method uses historical ensemble update activity as a proxy for uncertainty contraction to select informative observations at each correction step. Experiments on FWI, Navier–Stokes, and Darcy flow show improved reconstruction accuracy over EnKG, with substantial computational savings in FWI.
Critical strengths
The paper addresses a meaningful problem: improving the reliability and efficiency of finite-ensemble guidance in high-dimensional inverse problems. The proposed method is relatively simple and achieves promising results across multiple PDE benchmarks, particularly in FWI.
Critical weaknesses
- Limited methodological novelty. Observation selection based on information content or uncertainty reduction has been studied in ensemble data assimilation [1, 2], while observation subsampling has also been explored in ensemble Kalman inversion [3]. The theoretical connection between expected mean-update energy and covariance contraction also follows from standard linear-Gaussian conditioning. The paper does not sufficiently clarify its novelty relative to these existing lines of work.
- Insufficient justification and validation of the update-history monitor. The theoretical result connects expected mean-update energy to covariance contraction under a linear-Gaussian model, but does not directly justify using realized historical particle updates to predict the informativeness of future observations. Although the authors provide random-monitor ablations and empirical covariance-contraction analysis, the additional reconstruction improvements from the proposed monitor are relatively modest. More importantly, it remains unclear whether update history is a better selection criterion than simpler alternatives, such as ensemble variance or observation residuals.
[1] Migliorini, S. (2013). Information-based data selection for ensemble data assimilation. Quarterly Journal of the Royal Meteorological Society, 139(677), 2033–2054. https://doi.org/10.1002/qj.2104
[2] Shen, Z., Zhong, Q., & Chen, Z. (2022). Parameter estimation using adaptive observations toward maximum total variance reduction with ensemble adjustment Kalman filter. Frontiers in Climate, 4, 850386. https://doi.org/10.3389/fclim.2022.850386
[3] Hanu, M., Latz, J., & Schillings, C. (2023). Subsampling in ensemble Kalman inversion. Inverse Problems, 39(9), 094002. https://doi.org/10.1088/1361-6420/ace64b
Questions for authors
- Could the authors clarify the key methodological differences from existing information-based or uncertainty-based observation selection methods in ensemble data assimilation?
- Could the authors compare the update-history monitor with simpler adaptive selection criteria, such as ensemble variance or observation residuals, under the same observation budget?
- Is there empirical evidence that historical update activity is correlated with the actual uncertainty contraction induced by the selected observations at subsequent correction steps?
- Are the relatively small improvements over the random-monitor baseline statistically significant across test cases?
5 comments
Official Rebuttal to Reviewer bw2w (2/3)
Specifically, the EnKG correction uses the empirical state--observation cross-covariance and particle-dependent observation residuals. Let denote the resulting update activity at spatial location , and define , where is the scalar correction step size. Using Jensen's inequality and variance decomposition, we establish bounds on the expected squared activity in terms of the ensemble cross-covariance and predictive observation covariance. Combining these bounds with Proposition 1 yields
\lambda_{\min}^2 U_i(r;\mathcal I) &\leq \mathbb E_{y_{\mathcal I}} \left[\widetilde H_i(r;y_{\mathcal I})^2\right] \\\\ &\leq 2\lambda_{\max}^2 U_i(r;\mathcal I), \end{aligned}$$ where $U_i(r;\mathcal I)=\operatorname{tr}(L_r\Delta C_{xx}^{(i)}(\mathcal I)L_r^\top)$ is the projected covariance contraction, and $\lambda_{\min}$ and $\lambda_{\max}$ are the minimum and maximum eigenvalues of the positive-definite predictive observation covariance $S_{i,\mathcal I}$. We establish a mathematical connection between the practical EnKG update activity and the uncertainty-contraction utility in Proposition 1, with the proof provided in Appendix H. We thank the reviewer for motivating this analysis, which strengthens the theoretical foundation of our proposed history-adaptive observation selection for diffusion-based inverse inference. **Empirical Validation.** We further evaluate whether historical update activity identifies observations that produce stronger uncertainty contraction in subsequent EnKG corrections. We conduct a paired full-trajectory FWI experiment across 10 test cases. Both methods use the same initial ensemble, noise realization, correction schedule, observation budget, shot subsets, and uncertainty-extra receivers. The only difference is that UCEG selects the monitor-controlled receivers using historical update activity, whereas the randomized-monitor control replaces these selections with random receivers. We measure uncertainty using the empirical covariance trace of the physical-space ensemble. The relative contraction at correction step $k$ is $$\rho_k=\frac{T_k^{-}-T_k^{+}}{T_k^{-}}\times100\\%,$$ where $T_k^{-}$ and $T_k^{+}$ denote the covariance traces immediately before and after the correction. We average the relative contraction across correction steps within each case and then across the 10 test cases. UCEG increases mean relative covariance contraction from 19.607% to 20.119%, corresponding to a paired improvement of 0.512 percentage points (95% CI: $[0.283,0.719]$). It also reduces the final covariance trace from 549.19 to 521.15, with a paired difference of $-28.03$ (95% CI: $[-43.43,-12.24]$). History-guided selection achieves stronger contraction and lower final covariance in 9 of the 10 paired cases. The new theoretical analysis establishes the connection between update activity and covariance contraction, while the controlled FWI experiments demonstrate that historical update-guided observation selection achieves stronger uncertainty reduction throughout diffusion-based EnKG inference. ## Question 2: Comparison with Residual-Based and Variance-Based Selection We thank the reviewer for suggesting comparisons with simpler adaptive selection criteria. We added residual-based and variance-based baselines under the same correction observation budget, keeping all other components of UCEG unchanged. **Experimental Setup.** We evaluate the three selection criteria on FWI across 10 test cases. Residual-based selection uses the discrepancy between predicted and observed measurements, while variance-based selection uses the variance of ensemble-predicted observations. In contrast, UCEG constructs its selection scores from the realized history of EnKG particle corrections. All methods maintain the same correction observation budget and inference configuration. We measure the empirical uncertainty contraction induced by each selection strategy along the FWI inference trajectories, using the mean relative covariance contraction and final covariance trace defined in our preceding response. | Selection criterion | Mean relative contraction $\uparrow$ | Final covariance trace $\downarrow$ | |---|---|---| | Randomized monitor | 19.607% | 549.19 | | Residual-based | 19.690% | 548.26 | | Variance-based | 19.842% | 539.07 | | UCEG update-history | **20.119%** | **521.15** |Official Rebuttal to Reviewer bw2w (3/3)
Uncertainty-Contraction Results.
UCEG achieves the highest mean relative contraction and the lowest final covariance trace among all four selection strategies. Compared with variance-based selection, UCEG increases mean relative contraction from 19.842% to 20.119% and reduces the final covariance trace from 539.07 to 521.15. The residual-based criterion also improves over randomized selection, but produces smaller uncertainty reduction than the variance-based and update-history approaches.
Reconstruction Accuracy and Computational Efficiency.
We further compare the three adaptive selection criteria under the 4-random + 4-adaptively-selected-shot setting across 10 FWI test cases. All methods use the same shot and receiver budgets, ensemble size, and correction schedule. We report reconstruction accuracy and inference runtime in the following table.
| Method | Rel. | PSNR | SSIM | Time (min/case) |
|---|---|---|---|---|
| Residual-based | ||||
| Variance-based | ||||
| UCEG |
UCEG achieves the lowest mean relative error and highest mean PSNR, with comparable SSIM across the three methods. More importantly, UCEG requires only minutes per case, achieving and speedups over residual-based and variance-based selection, respectively. These efficiency gains arise because residual-based and variance-based scoring require additional forward evaluations, whereas UCEG reuses the particle corrections already generated during EnKG guidance. The results demonstrate that update-history-guided selection achieves competitive reconstruction accuracy with substantially lower computational cost.
Question 4: Statistical Significance of the Monitor Improvement
We thank the reviewer for suggesting a statistical analysis of the reconstruction improvements. We conduct paired comparisons between UCEG and randomized-monitor controls on FWI and Darcy flow under matched observation budgets. For each test case, we define and compute 95% paired bootstrap confidence intervals using test cases as the statistical units.
Experimental Setup.
For FWI, we evaluate the 4-random + 4-selected-shot configuration across 10 test cases. The randomized-monitor control replaces only the monitor-selected receivers while retaining the five uncertainty-extra receivers and all other inference components. For Darcy flow, we evaluate the same monitor-replacement strategy across 20 test cases at ensemble sizes and , using the same 20% observation budget.
| Task | Randomized monitor | UCEG | 95% CI () | Wins |
|---|---|---|---|---|
| FWI (4+4) | 0.02195 | 0.02081 | 7/10 | |
| Darcy () | 0.21613 | 0.21348 | 19/20 | |
| Darcy () | 0.18592 | 0.18327 | 19/20 |
Statistical Analysis.
On FWI, UCEG reduces mean relative error by 5.19%, achieving better reconstruction accuracy in 7 of the 10 paired cases. The mean paired improvement is , with a 95% CI of and a two-sided permutation -value of .
On Darcy flow, UCEG achieves consistent improvements across both ensemble sizes, reducing mean reconstruction error by 1.23% at and 1.43% at . At each ensemble size, UCEG outperforms randomized-monitor selection in 19 of 20 cases, with both paired confidence intervals strictly positive.
The paired analysis shows lower mean reconstruction error across the evaluated settings, with statistically significant improvements on Darcy flow and favorable results in the majority of FWI cases.
Official Rebuttal to Reviewer bw2w (1/3)
Weakness 1 and Question 1: Methodological Novelty and Related Work
We thank the reviewer for highlighting the connections to information-based observation selection and ensemble Kalman subsampling. These studies share our motivation of improving ensemble-based inference through informative observation selection and uncertainty reduction. Our work builds on Ensemble Kalman Guidance (EnKG) and focuses on developing an efficient, adaptive observation-selection mechanism for finite-ensemble diffusion guidance.
Diffusion models have emerged as powerful generative priors for high-dimensional inverse problems, offering expressive representations of complex solution distributions. EnKG makes these priors particularly attractive for scientific inverse problems by enabling derivative-free, measurement-informed guidance through empirical ensemble cross-covariances, even with expensive black-box forward models. However, with a limited ensemble, incorporating a large number of observation channels can introduce noisy correlations and reduce the reliability of the guidance correction. We address this limitation by adapting the observations used in each EnKG correction. Our theoretical analysis establishes a direct relationship between expected mean-update energy and covariance contraction under local linear-Gaussian conditioning. This connection motivates using realized ensemble update activity as an informative signal for uncertainty reduction.
The key methodological contribution of UCEG is an efficient, history-driven observation-selection mechanism that operates throughout the reverse diffusion trajectory. At each correction step, UCEG records the realized particle updates, aggregates their spatial activity, and projects the resulting monitor onto candidate observation units. These scores determine the observations used in subsequent EnKG corrections, allowing observation allocation to adapt continuously as inference progresses. Importantly, the selection signal is obtained directly from previous ensemble corrections, without additional forward-model evaluations for candidate scoring.
This mechanism differs from the three cited approaches. Migliorini (2013) identifies informative observation components through ensemble-based information analysis, while Shen et al. (2022) select observations by evaluating prospective total variance reduction using the ensemble adjustment Kalman filter. Hanu et al. (2023) study randomized data subsampling in ensemble Kalman inversion. In contrast, UCEG exploits the relationship between update activity and uncertainty contraction to construct an adaptive selection mechanism directly from the evolving history of diffusion-based EnKG corrections. This integrates observation selection into the guidance process rather than treating it as a separate information-evaluation procedure. We have expanded the Related Work section to acknowledge these studies and clarify UCEG's distinct update-history-guided observation selection mechanism.
We further validate this mechanism through observation-budget-matched experiments. In FWI, history-guided selection achieves greater mean relative covariance contraction than randomized-monitor selection (20.119% vs. 19.607%) and reduces the final covariance trace from 549.19 to 521.15, with improvements in 9 of 10 test cases. More details can be found in our Appendix E. We will also show additional comparisons with residual-based and variance-based selection in the below responses which demonstrate the computational efficiency of reusing correction history. These results establish the practical value of the proposed update-activity-driven mechanism for efficient uncertainty reduction in diffusion-based inverse inference.
Weakness 2 and Question 3: Theoretical Justification and Empirical Validation of the Update-History Monitor
We thank the reviewer for highlighting the connection between Proposition 1 and the practical update-history monitor. We have extended our theoretical analysis to establish a direct relationship between EnKG particle-update activity and uncertainty contraction, with the complete derivation and proof provided in the new Appendix H.
Theoretical Connection.
Proposition 1 establishes that expected mean-update energy equals covariance contraction under local linear--Gaussian conditioning. Building on the correction structure of EnKG, we further analyze how this relationship extends to the practical particle-update activity used by UCEG.