- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose MF-PINP, a multifidelity neural operator that leverages abundant low-fidelity observations along with sparse high-fidelity ones to predict full-field solution data. Learnable spectral embeddings combined with “physics-informed” cross-attention adaptively downweight low-fidelity information in the presence of poor accuracy. PAC-Bayes theory is used to establish a probabilistic generalization bound on the spectral encoding, and a bound for controlling calibration error in the multifidelity prediction is also presented. However, it is hard to see a use case for this method since it requires observations of the field it is trying to predict, and it is unclear how the theoretical analysis is useful in practice. The paper is also hard to read, missing about 15 years of related work, and missing a stated benchmark. In general, I think its deficiencies outweigh its benefits and (weakly) recommend rejection.
Critical strengths
The idea of combining multifidelity methods with neural operators is interesting. The authors’ theoretical analysis is also appreciated.
Critical weaknesses
The use case of the authors’ method is not clear to me. When would observations of a high-fidelity solution on a regular grid be available without access to the entire solution? Typical physics-informed neural operators do not require solution data for the field they are trying to predict, while this work does. It is also hard to understand why a huge family of related work in multifidelity methods was omitted from the paper’s discussion (e.g., [1] and the survey [2] with over 200 references). These works tackle the same problem, and similarly do not require such detailed information. While I appreciate the analysis in section 4, it is unclear how it relates to the benchmarks the authors are actually implementing. Can you validate the bounds you have derived? It is claimed that table 4 validates theorem 4.2, but I don’t see how. For example, it’s not clear to me that the necessary assumptions are enforced. Speaking of experiments, the 2D Navier-Stokes benchmark mentioned in section 5 is not included in the body, and “vorticity formulation at Re=500” is so vague it is almost meaningless. Finally, the premise of the paper is misleading: traditional numerical solvers certainly do not “require solving [these] systems from scratch”, as any production code employs warm-starting from a converged solution (among other tricks) to accelerate convergence.
[1] Gorodetsky, Alex A., et al. "A generalized approximate control variate framework for multifidelity uncertainty quantification." Journal of Computational Physics 408 (2020): 109257.
[2] Peherstorfer, Benjamin, Karen Willcox, and Max Gunzburger. "Survey of multifidelity methods in uncertainty propagation, inference, and optimization." SIAM Review 60.3 (2018): 550-591.
Questions for authors
See weaknesses.
2 comments
I appreciate the authors' work in acknowledging my concerns. Since I still have concerns about the utility of the approach and substantial doubts about the relevance of the theory, I maintain my score of "weak reject".
Thank you for the review. MF-PINP reconstructs fine fields from partial observations by using PDE residuals to decide how much coarse information to transfer.
Q1. Practical use and test-time observations
Test-time observation budget. 2D Poisson u6, relative L2 error (mean ± SD, TBD seeds)
Q2. Relationship to classical multifidelity methods
Q3. Role of the theory and evidence in Table 4
Q4. Navier–Stokes benchmark
Q5. Warm starts in numerical solvers
Warm-start comparison. 2D Poisson parameter sweep (50 queries)
References