- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes CSF-PINN to address loss imbalance (P1) and poor feature propagation (P2). It combines LIRB, a damped initial-skip residual architecture, with ICW, a loss-weighting rule based on gradient statistics and accumulated square-root losses. The authors connect both through a common leaky-integral recurrence. They provide recurrence and local-response analyses and evaluate five PDE benchmarks with component ablations and auxiliary studies.
Critical strengths
None.
Critical weaknesses
1. Limited novelty and no demonstrated joint-design principle
The related-work positioning is inadequate. Wang et al. [1] already combine a new PINN architecture with gradient-statistics-based learning rate annealing (LRA), including a four-way ablation. Francis et al. [2] combine adaptive residual connections, scheduled loss weighting, and SOAP. LIRB reduces exactly to . Initial-representation skips and learnable residual scaling have clear precedents [2, 3], although the complete architectures differ. ICW reuses the gradient-statistics ratio of [1] and combines it with loss-history averaging, an established direction exemplified by ReLoBRaLo [4]. Its specific hybrid rule remains heuristic. Under a consistently rescaled condition loss , its two branches scale as and , respectively, without a clear justification.
Crucially, the proposed "unification" amounts to applying similar exponential recurrences along depth and training time. The paper identifies no substantive coupling between LIRB and ICW. Its theoretical results do not establish improved high-frequency learning or stability of their joint optimization. Thus, the claimed unified contribution is not supported beyond combining familiar mechanisms.
2. Inadequate comparisons and no evidence of a distinctive combination benefit
The main evaluation compares weighting methods on an MLP against LIRB+ICW, changing both factors simultaneously. Tables 2 and 10 examine only selected PINNsFormer/PirateNet combinations with SA-PINN or DBPINN. Missing controls include LIRB with LRA, ReLoBRaLo, or ConFIG, and alternative architectures with ICW. Published configurations such as PirateNet+LRA+SOAP [5] and PINNsFormer+DCGD [6] are also omitted. A matched-budget architecture-by-training-method comparison is necessary to establish competitive superiority.
The component ablations show improvement over either component alone, but do not establish a distinctive interaction. Let , , , and denote the errors of the baseline, LIRB only, ICW only, and LIRB+ICW, respectively. Under a multiplicative reference for independent improvements, define
Here, indicates a greater improvement than this reference, while indicates a smaller improvement. Four of five benchmarks have . Although this is only a descriptive diagnostic, the results do not substantiate the claimed synergy.
The numerical ICW hyperparameters, repetition details, and main training schedules are also insufficiently documented. Given the limited methodological novelty, these experimental shortcomings substantially weaken the paper's contribution.
Questions for authors
-
Clarification: What distinguishes the claimed joint-design principle from prior architecture-plus-weighting approaches [1, 2]? What links LIRB and ICW beyond their similar recurrences?
-
Evidence needed: Why omit established configurations [5, 6]? Does the improvement persist with matched-budget crossed comparisons, including LIRB+LRA/ReLoBRaLo/ConFIG and PirateNet+ICW?
-
Clarification: What exact ICW hyperparameters, seeds, run counts, and optimizer schedules were used? Is there paired statistical evidence for an interaction between the components?
References
[1] Wang et al., "Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks". SIAM Journal on Scientific Computing, 2021.
[2] Francis et al., "An Adaptive Residual-Structured and Scheduled Loss Weighting Framework for Enhancing Physics-Informed Neural Networks in Solving Partial Differential Equations". Communications in Nonlinear Science and Numerical Simulation, 2026.
[3] Chen et al., "Simple and Deep Graph Convolutional Networks". ICML, 2020.
[4] Bischof et al., "Multi-Objective Loss Balancing for Physics-Informed Deep Learning". Computer Methods in Applied Mechanics and Engineering, 2025.
[5] Wang et al., "Gradient Alignment in Physics-Informed Neural Networks: A Second-Order Optimization Perspective". NeurIPS, 2025.
[6] Hwang et al., "Dual Cone Gradient Descent for Training Physics-Informed Neural Networks". NeurIPS, 2024.