- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a 340M-parameter neural surrogate for time-harmonic electromagnetic behavior in PCB and package structures. The model combines a sparse volumetric geometry encoder with query-based decoding to predict complex electric and magnetic fields at specified positions, frequencies, and excitations, as well as S-parameters through a separately supervised output head. The authors generate approximately 250,000 simulated designs from 25 template families and introduce EMVal to evaluate field and port-response prediction. Validation includes two held-out geometry families, component ablations, and smaller-scale comparisons with GINO and Transolver. The main empirical finding is that joint field supervision substantially improves S-parameter prediction on the held-out families while leaving in-distribution performance approximately unchanged. The ablations also reveal a tradeoff between global field accuracy and typical-probe relative error.
Critical strengths
-
Evidence that dense field supervision improves generalization of global responses. The comparison in Table 1 shows that jointly supervising complex E/H fields improves held-out-family S-parameter riRMSE from 0.153 to 0.102 and magnitude weighted MAE from 0.940 to 0.489 dB, while in-distribution performance remains approximately unchanged. This is the paper’s strongest contribution: it suggests that retaining the richer spatial information produced by full-wave simulations can improve prediction of aggregate responses on unseen geometry families. The comparison uses the same nominal architecture and training corpus, making the observed benefit informative for surrogate-model training.
-
A substantial effort to model local and global EM responses within a common framework. The reported corpus pairs geometry, materials, ports, complex vector fields, and S-parameters across multiple PCB/package families. The common query interface and complementary global and local field metrics provide a useful framework for studying these responses together. In particular, the ablations expose a meaningful tradeoff: the robust objective improves typical-probe relative error, whereas impedance-scaled MSE performs better on global field error. The paired corpus could also become a valuable community resource if released with sufficiently complete generation and evaluation specifications.
Critical weaknesses
-
The central generalization and benchmark contributions are insufficiently characterized. The OOD evaluation uses only two held-out geometry families within a common board-size, material, frequency, and port regime. However, the manuscript does not identify these families, provide a complete inventory and parameter ranges for the training families, or report results separately for each held-out family. Consequently, it is difficult to assess the difficulty of the distribution shift or whether the joint-supervision benefit holds across both families. The board-level bootstrap intervals do not resolve this uncertainty about generalization across families. In addition, although EMVal is described as public, the supplied manuscript does not provide access information or sufficiently complete generation and split specifications. These gaps matter because cross-family reuse and the evaluation resource are central to the paper’s claimed contribution.
-
The evaluation does not sufficiently establish the advertised design-relevant accuracy and utility of the predicted fields. Both S-parameter metrics de-emphasize low-magnitude responses: complex RMSE measures absolute amplitude error, while Eq. (7) assigns a weight of approximately 4.5 × 10⁻⁵ to a true response of −40 dB. Errors in deep stopbands or isolation can therefore contribute very little to the reported scores, although these regions may determine whether a design meets its specifications. Figure 4 illustrates visible stopband discrepancies despite a favorable aggregate error. Furthermore, the S-parameters are predicted by a separately supervised head, so their accuracy does not validate quantities derived from the predicted fields. The qualitative Poynting visualization is encouraging, but no quantitative evaluation of a field-derived quantity establishes the claimed downstream utility. This limits how strongly the reported benchmark improvements support the broader application claims.
Questions for authors
-
Clarification of the OOD protocol. What are the 25 training families and the two held-out families, including their parameter ranges and sample counts? Please report the joint-versus-S-only results separately for each held-out family and clarify whether these families were used for model or hyperparameter selection. This would help establish whether the reported gain is consistent across distinct geometry families.
-
Clarification of resource availability. Where can reviewers access EMVal, its split definitions, and the metric implementation? Please specify which artifacts are available or planned for release, particularly the template generators, simulation configurations, training data, and pretrained weights.
-
Clarification of the learned Student-t objective. Equation (3) omits the normalization term although is learned. Is this term included in the implementation, or is the displayed unnormalized robust objective intentional? Please explain the rationale for learning under the implemented objective and report its initialization and learned value. Omitting this term is inconsequential for fixed , but changes its gradient when is optimized.
-
Targeted analysis of existing predictions. Could you report S-parameter magnitude errors stratified by the true magnitude, particularly below −30 dB, on the existing test set? Does the joint-supervision benefit persist in these regimes, and what do the errors imply for stopband attenuation or isolation in the relevant device families? This analysis would help determine whether the reported improvements extend to design-relevant behavior that the weighted metric largely excludes.
-
Clarification on the title: Why do you believe the task of design on PCB is a "Foundation Model for Time-Harmonic Electromagnetic Behavior"? Is it bit overclaiming?
2 comments
Thank you again for your detailed review. As the discussion period closes tomorrow, we wanted to check whether our response addressed your questions. In brief, the revision identifies the two held-out families and reports results for each, with both benefiting from field supervision (Appendix B, Table 4); lists all design families by device type (Appendix C); tests including , fixing , and a Gaussian objective (Appendix E); reports S-parameter error by true magnitude, where the gain from joint supervision persists below −40 dB (Table 5); and adds a fine-tuning experiment on a new target (Sec. 4.2). If these address your concerns, we would be grateful if you would consider updating your score, and we are happy to answer any remaining questions.
Thank you for the specific questions. We appreciate that you called the held-out S-parameter gain from field supervision the paper's strongest contribution, and that you found the common framework for local and global responses useful. Your question on the Student-t objective led to new runs that we believe strengthen the paper.
Q1 / W1. Held-out families
The held-out OOD families are two planar copper-strip geometries: crossed strips (two perpendicular strips that overlap in a plus, T, or L shape; 1k designs) and fishbones (one spine crossed by several parallel bars; 1k designs), each with either 1 or 2 ports. No hyperparameters or checkpoints were selected on these families. Both families benefit from field supervision:
Joint supervision reduces riRMSE by 44% on crossed strips and 30% on fishbones, and mag-wMAE by about half on both.
The revision reports these per-family results in Appendix B (Table 4) and lists every design family in Appendix C (Table 6).
Q2. Resource availability
A 500-board 43.6 GB subset of EMVal, with the metric code and evaluation protocol, is publicly available. To preserve anonymity, the camera-ready version will give the link and the full split definitions. The full training corpus, model weights, template generators, and simulation configurations are proprietary and are not released.
Q3. Student-t objective clarification
You are right that Eq. (3) omits the normalizing term of the Student-t log-density, C(ν)=logΓ(2ν)−logΓ(2ν+d)+2dlog(νπ). Eq. (3) is therefore a heteroscedastic loss of Student-t form rather than an exact likelihood, and it learns the tail parameter ν. We ran a new experiment (Appendix E of the revision) to test what including C(ν) does, and whether the gain over MSE in Table 2 comes from the Student-t tail shape or from the learned per-probe scale. Starting from the 52M default configuration of Table 2, we include C(ν), fix ν at 12, or replace the Student-t with a Gaussian negative log-likelihood that keeps the learned per-probe scale.
Selected metrics (means; see Table 8 of the revision for the full results):
With C(ν), ν falls to its floor of 2 and every metric is far worse; a likely cause is that heavier tails let the model discount the residuals it fits worst. With ν fixed at 12, results are close to the default except for higher out-of-distribution S-parameter error. The Gaussian is comparable in distribution and better or tied out of distribution on every metric. The gain over MSE therefore comes from the learned per-probe scale, not from heavy tails. Every model in the paper is trained with Eq. (3). The Gaussian form is a promising choice for future research (we have not yet tested it at 340M parameters).
Q4 / W2. Low-magnitude S-parameters
Here, we report the out-of-distribution mean absolute error of ∣S∣ in dB, binned by the true magnitude. Error grows as the magnitude falls, but the gain from joint supervision (compared to S-only supervision) persists in every bin, including below −40 dB:
With errors of several dB below −30 dB, the model can screen designs on stopband attenuation and isolation, but checking a design's margin against such a specification still needs full-wave simulation. The revision adds this breakdown as Table 5 in Appendix B.
Q5. "Foundation model" title
We use "foundation model" in its usual sense: one model trained on a broad set of data that serves as a base for downstream tasks. We view our joint model's superior OOD S-parameter prediction performance compared to S-only pretraining as a clear demonstration of this capability, and do not believe it is overclaiming. However, to further demonstrate our model's ability to transfer to downstream tasks, we formulated and ran a new transfer learning experiment, which we detail in our reply to
GeG2and in Sec. 4.2 and Appendix G of the revision.