- The weather forecasting comparisons do not adequately control for differences in spherical geometry handling.
Section 3.2.2 introduces HEALPix-aware convolutional padding, enabling spatial information to propagate across neighboring HEALPix faces. However, Appendix A.4.4 indicates that the baseline models process the twelve HEALPix faces independently.
Consequently, Tadpole-2D benefits from spatial communication across face boundaries, whereas the baselines do not have an equivalent mechanism. This is a potentially important advantage unrelated to the effectiveness of the pretrained PDE representations.
Furthermore, Table 7 shows that the compared models use different loss functions and optimization schedules. While using the original fine-tuning recipes is reasonable, these differences make it difficult to isolate the effects of the architectures and pretraining strategies.
A more controlled comparison, in which the baselines receive comparable geometric information and are evaluated under a common training objective, would substantially strengthen the empirical conclusions.
- The experiments do not fully establish that the improvements originate from learning transferable PDE representations.
The pretrained model uses a reconstruction-capable encoder–decoder, and the latent dynamics network is initialized with a residual structure approximating the identity transformation (Appendix A.3, Equation 5).
For short-range weather forecasting, where consecutive atmospheric states are strongly correlated, this initialization may provide a substantial advantage independently of whether the model has learned transferable PDE-specific features.
The comparison with training from scratch is informative, but the two settings also differ in their optimization strategies: the pretrained backbone is frozen and adapted using LoRA, whereas the from-scratch model is trained end-to-end.
Additional controls, such as a persistence baseline, matched full fine-tuning experiments, or reconstruction pretraining on non-PDE spatial fields, would help clarify the source of the improvements.
- Important architectural and pretraining ablations are missing.
The proposed method combines several existing techniques with adaptations for the downstream problem, including reconstruction pretraining, 3D simulation slicing, HEALPix-aware padding, and global positional embeddings.
However, the experiments do not isolate their individual contributions. In particular, the claimed advantages of the HEALPix interface would be more convincing with ablations of the geometry-aware padding and positional embeddings, as well as a comparison against an otherwise identical model operating on a latitude–longitude grid.
Similarly, the benefit of pretraining on slices from 3D PDE systems, as opposed to directly generated 2D fields, has not been established experimentally.
These ablations are especially important because the methodological novelty primarily concerns the combination and adaptation of existing approaches.
- Limited statistical evaluation and incomplete computational cost comparison.
The reported experiments use a single random seed, and no variability estimates across independent training runs are provided. In the transonic cylinder-flow experiment, the reported 1,150 evaluation rollouts are derived from only five test trajectories and contain overlapping temporal windows. Consequently, they should not be interpreted as independent test realizations.
The paper also emphasizes parameter-efficient fine-tuning and inexpensive pretraining. However, the number of trainable parameters does not fully characterize computational efficiency. The pretrained backbone still contributes to inference cost, and the substantial computational expenditure of pretraining should also be considered.
Reporting total model parameters, training and inference costs, and performance variation across seeds would make the efficiency and robustness claims more convincing.
Dear reviewer,
Thank you for your valuable feedback and for recognizing the link between PDE foundation models and weather forecasting. Below, we address the weaknesses (W) and the questions (Q). The new results are in our anonymous repository in rebuttal_results.md and will be added in the revised manuscript.
We use LoRA because Tadpole is pretrained as an autoencoder and never sees temporal dynamics. Liu et al. (2026, Sec. 5.3 and Appendix A.4) found that LoRA on the frozen backbone keeps the pretrained representation and lets the latent subnetwork learn the dynamics. To separate LoRA from the improvements, we added three controls. In all of them, both models use all HEALPix adaptations.
We fine-tune three more variants of our model - each HEALPix adaptation is removed one at a time to evaluate its contribution (Additional Results 2).
We trained Poseidon-T, MORPH-S and PDEformer-2-S again with the same HEALPix adaptations as Tadpole-2D: HEALPix padding in every convolution, the loss weighting and the HEALPix coordinate embedding (for PDEformer-2-S, the latitude and the distance from the face corner as extra input fields). Additional Results 4.1 shows the 24-hour forecast of Fig. 5 for all five variables, and a close-up of q700 at the poles, where four HEALPix faces meet.
The artifacts of MORPH-S and PDEformer-2-S therefore remain even when all models use the same cross-face padding.