- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The manuscript uses a variant of the Method of Auxiliary Coordinates [Carreira-Perpiñán & Wang, AISTATS 2014] to train PINNs. Here it is called Layer Separation. Previous work has already applied it to PINNs [Liu & Gu, J. Comput. Phys. 543:114414, 2025]. It extends that work to higher-order derivatives (previously only derivatives up to order two were considered) and to nonlinear PDEs via Picard iteration (successive linearization).
As such, the contribution is a standard combination of existing ideas, and quite a foreseeable one. Beyond this, the manuscript has significant weaknesses, the lead me to recommend rejection. The two core weaknesses are weak baselines, and the restricted applicability of the method, I give details below.
Critical strengths
I see no obvious mathematical errors in the computational tools used (like Picard iteration or the layer separation process).
Critical weaknesses
There are two critical weaknesses:
(i) The baselines are weak. I ran a plain Levenberg–Marquardt method on the authors' problems. I prompted Claude Opus 5.5 with reasoning on high to do it for me with the prompt: "Can you take the examples of this paper, use JAX in double precision and a kernel formulation (or parameter space formulation if more appropriate) of Levenberg Marquardt with constant damping and backtracking line search with Armijo and quickly run their experiments and give me the relative L2 error"
Claude used constant damping (10⁻⁵; 10⁻⁷ for Navier–Stokes) and Armijo backtracking, and was applied directly to the nonlinear residual without Picard linearization. The manufactured solutions, collocation points, architecture and hard constraints were the same as in the manuscript. It clearly outperforms the proposed method.
KdV (solution): 6.1·10⁻⁶ vs. 2.9·10⁻⁴ Navier–Stokes (velocity): 8.0·10⁻⁶ vs. 2.3·10⁻⁵ MHD (velocity): 1.2·10⁻⁵ vs. 1.7·10⁻⁴
This is in line with my own experience in training PINNs, and was definitely to be expected. It is by now well-established in the literature [ENGD, DeepMind, Karniadakis] that Gauss-Newton/natural gradient type methods perform exceptionally well for PINNs. Not comparing to this development in the literature is therefore unacceptable and the results above show that even without tuning, the proposed method is far less effective.
(ii) The applicability of the method is severely restricted. It requires a network with exactly two hidden layers, has only been demonstrated for small widths, and is outperformed on simple benchmarks. I do not see promise for the method in the areas where neural PDE solvers are most promising, mainly high-dimensional problems in quantum physics and quantum chemistry.
Minor weakness: The write-up is verbose and hard to follow. It shows clear signs of heavy LLM-use with little human editing.
Literature:
[ENGD] https://proceedings.mlr.press/v202/muller23b/muller23b.pdf
[DeepMind] https://arxiv.org/html/2509.14185v1
[Karniadakis] https://arxiv.org/pdf/2604.05230
Questions for authors
I have none.