- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a method to address a limitation in Physics-Embedded PINNs (PE-PINNs). The new method handles source configurations built from repeated subunits, such as dipole arrays, crosses, and stars. The introduced PE-EK-PINN is a recursive 3 step process, First, train a PE-PINN on a small subsystem, second, freeze its learned field and promote it into an evolved kernel. Third, reuse translated or rotated copies of that kernel to train the next-level configuration. The method is evaluated on dipole arrays, composite line-source geometries, and hierarchical cross arrays.
Critical strengths
- The idea paper is solving is of good practical relevance, extending a converged subsystem solution to a reusable basis element is a natural way to use repeated structure in the source configuration.
- Authors are open about some limitations like, error accumulation through frozen levels, MLP extrapolation under rotation, the need for homogeneous media, and the need for a known hierarchy.
Critical weaknesses
- Limited methodological Novelty: This paper is just extension of PE-PINN framework, proposed novelty is primarily a hierarchical reuse/training strategy, rather than a fundamentally new PINN formulation. While this reuse strategy may offer practical computational benefits, the paper does not sufficiently establish its methodological novelty beyond straightforward compositional reuse of pretrained neural representations.
- Insufficient Baseline comparison with no ablations: On non-manufactured problems, the paper compares against a single external method (CoPINN, one dipole, Table 1), and all main experiments (Tables 3–5) compare only against direct PE-PINN. Other methods in Table 1 are evaluated only on the manufactured benchmark, so the claim that PE-PINN “already outperforms” them on wave benchmarks is not sufficient. It is highly possible that some of the methods in Table 1 might work better than PE-EK-PINN for other settings.
Questions for authors
- Since the reference solutions are constructed by linear superposition, how does directly summing frozen subsystem kernels without further training compare with PE-EK-PINN ?
- Beyond freezing and reusing pretrained PE-PINN predictions, what is the key methodological novelty of PE-EK-PINN ?
- Why is PE-PINN the only baseline evaluated on the main radiation problems? Can the authors compare against other scalable PINN methods ?
- Why are the reported large-scale speedups based on extrapolated rather than measured PE-PINN runtimes ?
- What evidence shows spectral bias as a major cause of conventional PINNs poor performance on radiation problems, rather than domain size, source singularities, or absorbing boundary conditions? Can the authors provide controlled experiments to disentangle these factors?
2 comments
Response to Authors rebuttal
I thank the authors for the detailed rebuttal, while some of my concerns still remain open:
- I agree that simplicity can be a strength. However, the rebuttal restates the contribution without addressing my concern that the architecture and training objective are unchanged from PE-PINN.
- The authors agree direct summation is valid but do not report results for it.
Considering rebuttal, I maintain my score.
We agree that the proposed recursive strategy is conceptually simple, and we view this simplicity as a strength rather than a limitation. The key contribution lies in the physical insight that a converged, physics-embedded solution can be reused as a computational kernel. This preserves learned wave physics as systems grow more complex. Unlike existing approaches that repeatedly optimize growing numbers of primitive kernels, our framework reuses and evolves learned solution representations while enforcing the governing physics at every level. We believe this mechanism for hierarchical physics-based knowledge reuse is the primary contribution of the work and the source of its improved scalability.
Regarding the baseline concern, we have now implemented all comparable PINN baselines for the same dipole case. Preliminary results support our original hypothesis that these methods struggle in practical wavefield scenarios. PE-PINN achieves an L2 error of ~0.021 within 20 minutes, whereas other PINNs, including CoPINN, remain near 0.99 after more than 40 minutes. See below for detailed results.
Although experiments are ongoing, competing methods have not approached PE-PINN's performance. We attribute this mainly to spectral bias, non-separable wave fields, singular sources, absorbing boundaries, and propagation over tens of wavelengths. Extending these baselines, other than PE-PINN, to the two complex dipole-array scenarios would be costly with limited additional insight, given their failure to converge in the simplest case. Nevertheless, we plan to include these new baseline results in the revised manuscript as an expanded comparison on practical wavefield problems, which are the primary focus of this work.
Please see below our responses to the specific questions.
AQ1: For exact isolated fields in homogeneous free space, direct summation is physically valid. However, learned frozen kernels contain approximation errors that can propagate through the hierarchy. PE-EK-PINN addresses this by optimizing new envelopes under the complete source, PDE, and boundary constraints.
AQ2: The novelty lies in uncovering the physics and the capability of embedding physics as kernel in PINN, which ultimately leads to our elegant and simple freeze and reuse methodology. The evolved kernel replaces multiple primitive carriers in the field representation, while newly trained envelopes enforce the physics of the larger configuration. This enables recursive compression of the representation and bounded active-kernel complexity.
AQ3: The additional single-dipole comparisons demonstrate that conventional PINN variants struggle substantially on the radiation benchmark.Our main experiments therefore focus on the scalability improvement over the strongest physics-embedded baseline established for this setting.
AQ4: Direct PE-PINN becomes computationally expensive as the number of primitive kernels increases, making direct training of large-scale configurations impractical under our available computational resources. For example, the measured training time already increases from ~67 mins for the 2×2 array to ~4.5 hrs for the 4×4 array. Based on this observed near-linear scaling, training a 16×16 array with 512 primitive kernels is estimated to require approximately 71.4 hours for a single run, making direct evaluation and repeated experiments prohibitively time-consuming. Therefore, we extrapolate the large-scale PE-PINN runtimes from the experimentally observed scaling trend, rather than performing computationally prohibitive baseline runs. We believe that the measured results already demonstrate substantial speedups, and the extrapolated values are explicitly distinguished from measured runtimes.
AQ5: We do not attribute the poor performance of conventional PINNs solely to spectral bias. As explicitly discussed in the Introduction, practical radiation problems involve multiple challenges, including non-separable wave fields, singular sources, absorbing boundaries, and propagation over tens of wavelengths. Spectral bias is one important challenge motivating architectural physics embedding, rather than the exclusive explanation for poor convergence. In fact, the original PE-PINN framework focuses on addressing these challenges jointly through physics-guided oscillatory kernels, source treatment, and appropriate boundary conditions. Meanwhile, the major contribution of our work is to address the scalability bottleneck of physics-embedded representations through hierarchical kernel evolution and reuse.