- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposed Fuse-PINN, a scientific machine learning approach integrating the FEM and the conventional PINN. Instead of using only single MLP to formulate the solution, this work first divides the computational domain into multiple triangular areas (like the meshing process in the standard FEM) and represent the solution with multiple neural surrogates. In the proposed method, the authors developed a FEM-NN representation to express the global solution, which is formulated by assigning different MLPs to the corresponding nodes. To maintain the C1 continuity of the global solution, a special weight function is developed to keep the gradient continuous between two triangular element areas. And some FEM techniques and PINN techniques are also integrated, including Crank-Nicolson scheme and ENGD optimizer.
Critical strengths
- This manuscript proposed a valuable framework for the scientific machine learning. Several useful techniques are proposed and developed, including fem-nn representation, ENGD optimizer, Crand-Nicoson scheme.
2.This method shows per-epoch weak scalability. The proposed framework is implemented within a distributed GPU computing system. The corresponding node-communication mechanism seems effective. And the numerical results validate the parallel efficiency of such implementation.
3.The numerical experiments include several complicated nonlinear cases, including Hasegawa–Wakatani and Reduced-MHD equations, illustration the framework potential in addressing some nonlinear PDEs describing some complex systems.
Critical weaknesses
-
The scalability is one the key contribution stated in the paper. However, the results are not fully convincing. It is not sufficient to only report per-epoch runtime. When the system scales up, it might generally require more training iteration for model convergency. Therefore, an end-to-end scalability test is necessary.
-
The central part of the framework is the fem-nn representation. The authors claim the importance of maintaining c1/c2 continuity and thereby introduced a complicated weight function design. However, in the standard FEM, the weak form is designed for addressing this issue. For instance, the Sobolev space H¹(Ω) does not maintain such continuity but still be extensively used. Thus, to fully illustrate the importance of c1/c2 continuity and the proposed fem-nn, it is necessary to include more concrete numerical results, such as some ablation study.
-
One potential concern about the fem-nn representation is its generalization on some PDEs with discontinuous coefficient fields. For example, considering a darcy flow problem within piecewise constant permeability, the solution gradient will jump across different interface.
-
Existing studies already explore the combination of conventional numerical techniques, such as domain decomposition, with PINN. And utilizing multiple MLPs to represent one PINN solution is also not new (which is also mentioned in the manuscript). However, the comparison with these existing study, such xPINN, is missed.
Questions for authors
Please refer to the concerns in the weaknesses section.