- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes IGA-ODIL to address the optimization difficulties of PINNs, particularly the dense and poorly conditioned Jacobians induced by neural-network parameterizations that limit the effectiveness of second-order optimization methods. IGA-ODIL replaces neural-network parameterizations with B-spline representations and optimizes the spline coefficients using Gauss–Newton methods. IGA-ODIL is evaluated on a lot of benchmarks. However, the paper suffers from extremely poor presentation and significantly lacks sufficiently comprehensive comparisons. Therefore, the reviewer believes that the paper requires substantial revision and is not yet ready for acceptance at ICLR.
Critical strengths
- The limitations described in this paper correspond to real problems in existing physics-informed learning methods.
- The motivation of IGA-ODIL is reasonable.
Critical weaknesses
- The paper suffers from extremely poor presentation and organization. First, the Introduction contains a large amount of discussion that is not directly relevant to the core argument, making the main logic of the paper difficult to follow. The reviewer suggests simplifying the Introduction to focus on the central motivation and moving broader discussions of existing approaches to a dedicated Related Work section. In addition, Section 2 largely repeats descriptions of existing methods while occupying a substantial portion of the paper. In contrast, the most important part (the description of IGA-ODIL) is overly compressed. The experimental section is also poorly organized and lacks ablation studies on the core components. Therefore, the reviewer believes that the paper requires substantial reorganization.
- IGA-ODIL appears to be interpretable as a special type of explicit basis-function method. In particular, IGA-ODIL represents the solution using a set of B-spline basis functions, while the optimization mainly operates on the spline coefficients. Based on this formulation, many alternative basis functions could potentially be used to construct similar methods, including RBFs, Fourier bases, and wavelets. The reviewer would like the authors to further analyze why B-splines are selected and what advantages they provide compared with other basis functions.
- The paper lacks sufficiently comprehensive baseline comparisons, making the experimental evaluation highly insufficient and preventing an effective assessment of whether IGA-ODIL truly outperforms existing methods.
Questions for authors
Please refer to the weaknesses above.