- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Conflict-Aware Physics-Informed Neural Networks (CA-PINN), a multi-objective optimization algorithm for training PINNs. The method extends existing MTL method, CAGrad, by adjusting the hyperparameter (adaptive conflict modulation) during training based on both direction disagreement and gradient norm imbalance. The experiments show that the proposed method achieves superior performacne across benchmark equations.
Critical strengths
Strengths
-
The paper is well written and easy to follow.
-
CA-PINN shows superior performance over existing methods across PDE benchmarks. The experiments are also extensive and carefully controlled, including a comparison with a tuned fixed coefficient, a sensitivity analysis, and computational cost analysis.
Critical weaknesses
Weaknesses
In my opinion, the main contribution of this work is somewhat incremental. The issues of gradient conflict and gradient magnitude imbalance are well-known problems. Gradient conflict and gradient magnitude imbalance are widely recognized problems in PINN training, and the proposed method is essentially another variant of existing MTL methods. As a result, the contribution relies mainly on the empirical results. However, the benchmarks in the paper are already solved well by existing methods. The paper does not show cases where existing methods fail and CA-PINN overcomes their limitations.
Questions for authors
- Can the authors provide an example where the existing methods fail but the proposed method succeeds?