- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes FunBCS for PDE inverse problems with sparse solution observations. The method enforces measurement consistency by optimizing the input of a pretrained denoiser, combines this update with re-noising, and allocates optimization steps across noise levels. An analysis under a two-point prior explains how the method can correct measurement-nullspace errors and escape an incorrect mode, while motivating the allocation of computational effort. Experiments on Poisson, Helmholtz, Navier–Stokes, and Darcy problems demonstrate substantial improvements in reconstruction accuracy and favorable runtime relative to the evaluated baselines.
Critical strengths
- The paper addresses a relevant difficulty in sparsely observed PDE inversion, particularly the recovery of discontinuous coefficient fields. Reconstruction improvements are consistent across four tasks and especially substantial on Darcy flow. Sharing the pretrained prior and forward surrogate with DDIS strengthens this comparison.
- The theoretical analysis provides an interpretable mechanism for the proposed approach. Figure 4 demonstrates recovery from incorrect modes, while Appendix I.3 shows reduced nullspace errors in a discontinuous Poisson problem using a learned diffusion prior and a neural-operator surrogate.
- The empirical study includes runtime–accuracy comparisons, extensive scheduling ablations, and an application of the scheduler to DDIS. The independent calibration samples and the discussion of the spectral-metric discrepancy are also valuable.
- The detailed theoretical analysis contributes to understanding how denoiser-input optimization couples measurement consistency with nullspace correction, and how noise levels affect escape from incorrect modes. The paper is clearly written, with a well-organized presentation of the method, theoretical results, and supporting experiments.
Critical weaknesses
- The removal of the input-proximity constraint is insufficiently validated. FunBCS omits SITCOM’s [a] regularization term that penalizes deviations from the initial input, but provides no direct ablation of this choice. Under a matched computational budget, comparing variants with across different values of would clarify the benefits and trade-offs in reconstruction accuracy, escape from incorrect modes, and optimization stability.
- A comparison with prior-covariance-based preconditioning is missing. Under small-step gradient descent, the proposed input optimization can be approximately interpreted as an output-space update preconditioned by , whereas FAPS uses prior covariance to propagate measurement corrections to correlated unobserved components. I recommend adding a comparison with FAPS [b] and equipping DDIS [c] with covariance preconditioning under the same prior, forward model, computational budget, and optimization-step schedule to clarify the contributions of input parameterization and preconditioner choice. A separate scheduling ablation would help isolate the gains from optimization-step scheduling.
[a] SITCOM: Step-wise triple-consistent diffusion sampling for inverse problems. ICML 2025.
[b] Flow Annealing Posterior Sampling for Function-Space Regression and Inverse Problems. arXiv preprint arXiv:2606.22346 (2026).
[c] Decoupled diffusion sampling for inverse problems on function spaces. arXiv preprint arXiv:2601.23280 (2026).
Questions for authors
The connection between the linear nullspace analysis and the nonlinear experiments needs clarification. The nullspace guarantees rely on a linear observation map , while the experiments also include nonlinear Navier–Stokes and Darcy inverse problems. Although the simplified analysis provides useful insight, the paper should clarify which aspects of the proposed mechanism remain applicable in these settings and which conclusions depend on linearity.
3 comments
Response to Reviewer EXwU (2/2)
[Q1] Linearity of the forward operator in the theoretical analysis.
We thank the reviewer for raising this point. We agree that while our experiments on Darcy flow, which has a nonlinear solution operator, provide empirical evidence for the theoretical mechanism we discuss, the formal guarantees are only for linear solution operators (such as those of Poisson and Hemholtz).
We note that Prop. 1 continues to hold for the linearized forward operator , and FunBCS continues to precondition the measurement gradient per the chain rule (Prop. 7). However, nonlinear analogues of Cor. 1 and Thm. 1 are more involved, and we leave this to future work. We have updated the manuscript in App. D and Remark 11 in App. K to highlight this.
To provide further evidence of our theoretical results extending to nonlinear PDE, in App. I.5 of the revised manuscript, we examine if Prop. 3 continues to hold for nonlinear Darcy flow after linearizing the forward operator by taking the Jacobian. Specifically, we find that the unobserved error to the true discontinuity location is significantly lower across the reverse process for FunBCS than DDIS.
We provide a summary of these results in the table below, evaluating the unobserved pixel error (%) across the reverse process, with a figure in App. I.5 (Fig. 18a) of the revised manuscript:
| Reverse timestep | FunBCS unobserved pixel error (%) | DDIS unobserved pixel error (%) |
|---|---|---|
| 18.64 | 44.83 | |
| 9.89 | 13.38 | |
| 8.52 | 11.91 | |
| 8.52 | 11.91 |
Note that we use pixel error for Darcy, in line with our experiments and the DiffusionPDE paper, but we find that the trend described above holds similarly for the error used in our theory: FunBCS has lower unobserved error at each .
We again thank the reviewer and are happy to clarify further if any questions remain.
References
[A] I. Alkhouri et al. SITCOM: Step-wise Triple-Consistent Diffusion Sampling for Inverse Problems. ICML, 2025.
[B] M. Herde et al. Poseidon: Efficient Foundation Models for PDEs. NeurIPS, 2024.
[C] Y. Shi et al. Flow Annealing Posterior Sampling for Function-Space Regression and Inverse Problems. NeurIPS, 2026.
[D] T. Lin et al. Decoupled diffusion sampling for inverse problems on function spaces. arXiv preprint arXiv:2601.23280 (2026).
I thank the authors for thoroughly addressing most of my concerns, revising the manuscript, and providing additional experimental results. At this stage, I am inclined to maintain my current score.
Response to Reviewer EXwU (1/2)
We thank the reviewer EXwU for their useful feedback. We appreciate their positive remarks on our method's strong reconstruction accuracy (including on the challenging Darcy flow), the interpretability of our studied theoretical mechanism and its accompanying empirical analysis, and the presentation of our paper. We address the reviewer's questions below.
[W1] Regularization (proximity) term.
We thank the reviewer for this question. We did initially consider the regularization (proximity) term that comes with the SITCOM [A] sampler, but found that in most of the cases, its impact is negligible, so we decided not to include it in our original submission.
However, with the additional fifth PDE that we ran in the rebuttal (Wave-Layer, see our response to reviewer 2wEK Q1), we found that its impact is not marginal.
In the following table, we examine the regularization term (λ∥v−v0∥2) at the same budget of M=800 optimization steps as FunBCS-AC, on 50 test samples of each PDE including the Wave-Layer PDE, on a test set of 50 samples.
As observed, for all PDEs, other than the Wave-Layer, when λ>0, the improvement is negligible. For Wave-Layer, the error improves as λ increases.
This experiment is added to App. I.7 of the revised paper. We clarify the inclusion of the regularization term in the Setup section of Sec. 5.
Additionally, we study how the regularization term affects escaping the incorrect mode on Darcy flow, in a similar setting to our experiment in Sec. 5. We find that for λ zero or small, we achieve a strong escape rate in line with our theory. However, for λ large, the escape rate drops significantly. We hypothesize that this is because a large regularization makes the optimization variable close to the initialization. Consequently, the input to the denoiser is not substantially updated at a fixed tk; per our theory in Sec. 3/4, the input to the denoiser should be updated to escape to the true mode.
This experiment is added to App. I.7 of the revised paper.
[W2] Comparison with FLAPS and preconditioned DDIS.
As requested by the reviewer, we compare FunBCS to FLAPS [C] and a preconditioned version of DDIS [D] across all four of our PDE. We use the publicly available FLAPS Hugging Face checkpoints and code, and are able to reproduce the numbers reported in the FLAPS paper in their setting.
We provide results for FLAPS and preconditioned DDIS on our setting of 3% noiseless observations. We provide these results for both the methods with their original hyperparameters as well as matching our FunBCS (uniform) method. To be precise:
We provide the reconstruction error of these baselines compared to FunBCS (uniform) below, with full results (e.g., spectral error) in App. I.6 of the revised manuscript:
We find that both baselines do significantly worse than FunBCS. Additionally, we find that preconditioned DDIS diverges on Poisson and Helmholtz. However, a comprehensive analysis of this is outside the scope of our work, since our proposed method does not use the sample covariance matrix as a preconditioner.