- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a method for sequential Bayesian optimal experimental design using a fixed diffusion prior. The main idea is to adapt the score-KL identity to estimate information gain, using DPS guidance in place of the likelihood score required at each noise level. The method evaluates candidate experiments by integrating the expected squared guidance across noise levels, using approximate posterior samples and, in the Darcy flow example, perturbed saved diffusion states. A key feature is that the same pretrained diffusion prior is reused as new observations are collected, without retraining the model. The paper provides a conditional error analysis and evaluates the approach on source localization, constant elasticity of substitution, and Darcy flow.
Critical strengths
-
The paper presents a useful approach to experimental design when a pretrained prior and a differentiable likelihood are available. Reusing the same prior throughout the experiment sequence avoids the need to train a separate acquisition policy, which is particularly appealing for scientific inverse problems involving spatially distributed parameters, where both inference and experimental design can be computationally expensive. The information identity is mathematically sound under the stated assumptions, and the analysis appropriately accounts for the residual error introduced by using a finite diffusion horizon.
-
The experimental evaluation includes several useful tests of the proposed method. In the source-localization example, the authors compare candidate rankings and selected designs against an sPCE reference, while the benchmark experiments use sPCE to evaluate entire acquisition sequences. The Darcy flow experiments further demonstrate the method on parameter-field reconstruction. The paper also discusses important limitations, including guidance bias and sensitivity to the sampling procedure, and clarifies that increasing the number of samples reduces Monte Carlo error but does not necessarily eliminate these other sources of error.
Critical weaknesses
-
My main concern is whether the proposed steering-cost surrogate can reliably identify informative experiments. In Equations (7) and (11), the DPS approximation replaces the likelihood averaged over the diffusion smoothing distribution with the likelihood evaluated at a denoised point estimate. This simplification can introduce systematic errors and potentially change the ranking of candidate experiments. Even in a linear Gaussian setting, where the prior denoiser and posterior samples are exact, the estimated scores may not agree with the true expected information gain. This issue is particularly important in sequential experimental design. As observations accumulate, the likelihood score should reflect the current posterior, whereas the proposed method continues to use the unconditional prior denoiser. Although Theorem 3 provides a conditional error bound, the error introduced by the guidance approximation remains unquantified. Moreover, the analysis considers an idealized estimator rather than the full method used in the experiments. The sensitivity results in Table 4 also show that the estimated information gain depends on the guidance strength and the number of diffusion steps, raising further questions about the stability of the resulting acquisition decisions. A controlled comparison with exact information gain, along with a clearer discussion of how sequential conditioning affects the approximation, would strengthen the paper's central claims.
-
The results on high-dimensional Darcy flow are promising, but it is difficult to determine how much of the reported improvement comes specifically from the proposed acquisition criterion. The comparison with ALINE involves differences in both the inference procedure and the acquisition strategy, making it challenging to attribute the gains in reconstruction quality to the information-gain estimate itself. A more direct comparison, in which different acquisition strategies use the same diffusion prior and posterior reconstruction method, would help isolate the contribution of the proposed approach. The random-patch comparison in Appendix G.2 is also limited to a few representative examples. Evaluating the method across more independent parameter fields and acquisition sequences would provide stronger evidence of its robustness. In addition, the paper does not provide enough information about computational cost to establish the practical benefits of repeatedly evaluating candidate experiments through guided diffusion sampling. Finally, the benefit of integrating likelihood guidance across diffusion time, rather than using a simpler score at a single noise level, remains unclear without a controlled comparison. These gaps matter because the main methodological contribution is the proposed acquisition criterion, and the experiments should more clearly demonstrate its advantages over simpler alternatives.
Questions for authors
-
How well does the guidance in Equation (11), which relies on a fixed, unconditional denoiser, approximate the history-conditioned likelihood in Equation (19)? I would appreciate clarification on how the reverse-drift and initialization assumptions in Appendix E relate to the posterior sampler used in the experiments. Does the error analysis also apply to the hybrid estimator used in the Darcy experiments?
-
Could the Darcy experiments be repeated using the same posterior reconstruction procedure for designs selected by MINDE-DPS, ALINE, and random acquisition? This would help isolate the contribution of the proposed acquisition criterion to the reported improvements. I would also appreciate clarification on the "static (t=0)" baseline in Table 3. In addition, how does the integrated steering-cost criterion compare with a score evaluated at a single noise level when both are given comparable computational budgets?
-
How are prospective observations generated when evaluating candidate designs? Appendix G.2 uses a fixed true parameter field to produce Figure 5, but it is not entirely clear how this analysis relates to the acquisition procedure used in the experiments. Could the authors clarify this connection and explain why the first-stage information-gain maps differ across the examples in Figure 6? For the source-position design problem, it would also be helpful to specify which solution values are observed after the forcing is applied.
-
What is the motivation for running a separate DPS sampler targeting the updated posterior for each prospective observation? An alternative would be to draw a parameter sample from the current posterior, generate a prospective observation conditioned on that sample, and then apply forward noising to the same parameter sample. If the current posterior can be sampled exactly, this approach appears to provide the joint distribution needed to evaluate the guidance expectation without an additional posterior-sampling loop. Is this alternative compatible with the proposed estimator, and if so, how would its performance and computational cost compare with the current implementation? A comparison of runtime and the number of forward-model evaluations would help clarify the practical efficiency of the proposed approach.
Thank you for the detailed responses. The common-DPS reconstruction comparisons and the additional Navier–Stokes evaluation have improved the empirical evidence. The explanations of the prior-only calibration baseline, the scope of Theorem 3, and the joint-sampling construction also address several of my questions. My main remaining concern is whether the implemented acquisition criterion reliably ranks candidate designs. The response acknowledges possible ranking errors, while the sequential calibration diagnostic uses a history-dependent Gaussian denoiser. Could you provide the requested controlled sequential linear-Gaussian comparison with exact EIG, including ranking agreement and the exact-EIG loss of the selected designs for the scoring implementation used in the experiments? Please reconcile the standard error versus standard deviation descriptions of the Navier–Stokes results and, if available, report uncertainty for paired performance differences. I acknowledge the improvements in the rebuttal, but currently retain my rating because the central acquisition validation concern remains open.