- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SAFPOT, a unified pretraining framework for PDE solution prediction that conditions frequency-band modulation on both physical states and symbolic PDE representations. It combines spectral feature modulation with mixture-of-experts (MoE) layers to capture equation-specific dynamics. Experiments on pretraining, transfer learning, ablations, and model scaling show promising improvements, with reported reductions of up to 71.75% in L2RE and 59.4% in average fRMSE.
Critical strengths
Different PDEs exhibit distinct spectral distributions. Jointly conditioning frequency-band modulation on PDE symbols and the current physical state provides a targeted architectural design for multi-PDE operator learning.
Critical weaknesses
- The sources and comparability of baseline results are unclear, raising concerns about the reported performance gains. Several errors in Table 1 differ substantially from those in the original papers, including MoE-POT on SWE, CNS, and DR, as well as NESTOR under the same fine-tuning epochs. These discrepancies are difficult to assess due to insufficient details on data splits, implementations, and evaluation protocols. Notably, the claimed maximum error reduction of 71.75% depends on the elevated SWE baseline error. The authors should clarify the sources of baseline results and verify the gains under a consistent experimental protocol.
- The lack of model checkpoints and incomplete evaluation details hinder independent verification and reproducibility. The public repository does not provide checkpoints for the main results, while key details regarding dataset splits, prediction horizons, error aggregation, FFT normalization, and frequency-band boundaries remain unclear. These omissions, combined with the baseline discrepancies, weaken confidence in the empirical conclusions. The authors should provide the relevant checkpoints, evaluation commands, and complete configurations.
Questions for authors
- Why is MoE-POT-T’s SWE error substantially higher than that reported in the original paper?
Both papers use six pretraining datasets and 200 fine-tuning epochs, yet the reported SWE errors are 0.00945 and 0.00305, respectively. What differences in training or evaluation explain this discrepancy? It directly affects the claimed maximum error reduction of 71.75%.
- Why do some baselines degrade after fine-tuning, and why do their results differ from those in the original papers?
In Table 1, NESTOR’s average error increases from 0.0205 before fine-tuning to 0.0225 afterward, while MoE-POT-T’s SWE error increases from 0.00405 to 0.00945.
Furthermore, after 200 fine-tuning epochs, the reported errors differ from the original results for NESTOR on FNO-ν ((10^{-5})), DR, and SWE (0.0761, 0.0266, and 0.00366 vs. 0.0581, 0.0198, and 0.0032), as well as for DPOT-T, DPOT-S, and DPOT-M on SWE (0.00394, 0.00560, and 0.00264 vs. 0.00280, 0.00224, and 0.00218). How do the authors explain these discrepancies? Which are attributable to differences in pretraining data versus training or evaluation settings? Please clarify the fine-tuning procedures and checkpoint-selection criteria used for each baseline.
- Does the symbolic branch capture governing-equation information or primarily identify the dataset?
The current ablation compares SAFPOT with and without the symbolic branch but does not distinguish these explanations. Would replacing the equation symbols with learnable dataset identifiers, while keeping the frequency-modulation structure unchanged, preserve SAFPOT’s performance advantage? This distinction is central to evaluating the contribution of symbolic conditioning.