- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The manuscript proposes a regularizer for PINN training that penalizes oscillations. The proposed regularizer is evaluated on the 1D viscous Burgers equation for three viscosities (high, moderate, small). The manuscript does not contain theory. Based on the critical weaknesses listed below, I recommend rejection.
Critical strengths
The core question this paper assumes to be true---whether PINNs lead to oscillations around sharp gradients or shocks---is certainly interesting.
Critical weaknesses
The paper has significant problems:
-
The core issue it aims to address---the fact that PINNs suffer from oscillations in the vicinity of sharp gradient regions (or shocks)---is not demonstrated at all, and neither is it a well established failure modes of PINNs. I agree that it might(!) be a failure mode of PINNs, but as a matter of fact, I have not observed it myself either.
-
The experimental evaluations do not show a clear benefit of the proposed method. Three scenarios are tested: high, moderate, and small viscosity corresponding to smooth, moderate, and sharp gradients in the solution. The proposed regularizer deteriorates training for the smooth case, and performs on par with established methods in the moderate and small viscosity regime. The authors claim improved performance in the moderate regime, however confidence intervals overlap, so no conclusion should be drawn. The authors admit this themselves.
-
The original PINN paper [PINN] (in Appendix A.1) treat this exact setup of Burgers equation, and report much lower errors (around 1e-3 to 1e-4 relative L2), and no oscillating behavior, so the baseline PINN is not tuned correctly. Moreover, the manuscript ignores recent advantages in PINN training: It is by now well-established that Gauss-Newton (or natural gradient methods in ML parlance) methods perform exceptionally well on PINNs. A result that claims improved PINN training (even through a regularizer) must adhere to that literature. See: [ENGD, DeepMind, Karniadakis].
Literature:
[ENGD] https://proceedings.mlr.press/v202/muller23b/muller23b.pdf
[DeepMind] https://arxiv.org/html/2509.14185v1
[Karniadakis] https://arxiv.org/pdf/2604.05230
[PINN] https://www.sciencedirect.com/science/article/pii/S0021999118307125
Questions for authors
I have no questions.