- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper investigates AI for physical questions, including embedding physical fields, representation learning, and task generalization. Specifically, it proposes a new physical-field modality for embedding physical fields as an individual modality. The multimodal framework improves the learning and alignment of the physical-field encoder. Finally, the paper proposes sufficient theoretical demonstrations.
Critical strengths
The question of AI4Physics is significant, and the proposed methods are interesting.
Critical weaknesses
There is a lack of demonstrations of the differences from related works. The improvements compared with related works and the intuition behind the method design are unclear.
The formulation or methods are introduced directly, without enough evidence or support from theoretical phenomena. For instance, how can the following statement be supported: “The key observation is that a broad class of physical laws can be formulated in terms of partial differential equations”?
Questions for authors
There is a lack of supporting results or visualizations for the relevant descriptions. For instance: “As a result, the model may learn statistical correlations from the observed data while failing to adequately exploit the governing physical constraints (Nie et al. (2023)).”
Related works deserve to be split into individual scientific questions.
The paper lacks basic mathematical formatting, such as punctuation in equations.
The font in the figure is too small compared with that in the main paper, and the figure contains too much content, making it hard to understand.
The overall improvement is too weak, averaging less than 1% across datasets.
Why does the “without field” ablation in Table 2 perform much worse than 8/10 of the related works?
Does the limited number of figures hamper understanding of the proposed question and its comparison with related works?
It would be interesting to conduct the following experimental analyses: 1) Use the same input and network while only reducing the PDE loss to verify the extent of the physical constraints. 2) Use the current framework with inaccurate equations and parameters to verify whether the model makes incorrect inferences when the physical prior fails.
How much data is used in the multimodal framework? Is it essential to use three stages to learn representations?
3 comments
Rebuttal by Authors (2/2)
Q6: Why does the “without field” ablation in Table 2 perform much worse than 8/10 of the related works?
Answer: Thank you for raising this question. The ‘w/o field’ ablation in Table 2 only perform worse than 6/10 of the baselines (i.e., RF, LSTM, TabM, TSMixer, xLSTM and BiMamba). As discussed in Section 4.3, this ablation removes the entire physical-field modality, leaving an image-only predictor. Images capture observable appearance but cannot fully recover the complementary physical states and dynamics supplied by the field modality. Its lower performance than baselines exploiting numerical or temporal observations is therefore consistent with this information loss. Restoring the physical-field modality improves performance from 82.90 to 84.80, surpassing all baselines on SKIPP’D and supporting the benefit of integrating complementary visual and physical information.
Q7: Does the limited number of figures hamper understanding of the proposed question and its comparison with related works?
Answer: Thank you for raising this question. Section 2 has already provided a textual comparison that clarifies the key differences between PhyMo and related work, which we believe is suffcient for the goal of illustrating the related work in Section 2.
Q8: It would be interesting to conduct the following experimental analyses: 1) Use the same input and network while only reducing the PDE loss to verify the extent of the physical constraints. 2) Use the current framework with inaccurate equations and parameters to verify whether the model makes incorrect inferences when the physical prior fails.
Answer: Thank you for raising this question. We follow your advice and implement the additional ablation experiments on SKIPP’D.
For 1), we replace the PDE-residual loss with a single MSE loss, with the rest of components unchanged. The detailed results are listed as the table below, which illustrates the effectiveness of the proposed PDE loss and the underlying physical constraints:
| Configuration | |
|---|---|
| Original | 84.80 ± 0.14 |
| w/o PDE-residual loss | 83.29 ± 0.29 |
For 2), we replace the residual loss of the the diffusion–reaction:
with
$ r_{\mathrm{incorrect}}=\partial_t\hat R-p\hat R$,
and the results are shown as the table below, which also illustrates the importance of the correct PDE constraints applied to the model:
| Configuration | |
|---|---|
| Original | 84.80 ± 0.14 |
| Incorrect PDE residual loss | 84.31 ± 0.84 |
Q9: How much data is used in the multimodal framework? Is it essential to use three stages to learn representations?
Answer: Thank you for raising this question. As stated in Appendix B.1, we follow the official training/test partition for each evaluated dataset. For example, we use 2014–2015 for training and 2016 for testing on Folsom.
Moreover, we believe it’s necessary to employ the three-stage training paradigm illustrated in the paper. We have to obtain the PDE encoder for physical field modality following the procedure in Stage 1. Then, we need to address the alignment issue between visual and physical representation in Stage 2. Finally, we train task-specific prediction heads for various downstream AI4Physics problems in Stage 3. This ordering establishes physical structure before cross-modal alignment and downstream adaptation, giving each training objective a distinct role. To better support our claim, we have also implemented additional ablation experiments in Section 4.3, which removes stage 1 by using a pretrained encoder. Please kindly review the blue-highlighted content.
References
[1] Fourier J, Freeman A. The analytical theory of heat[M]. New York: Dover, 1955.
[2] Landau L D, Lifshitz E M. Course of theoretical physics[M]. Elsevier, 2013.
[3] Maxwell J C. VIII. A dynamical theory of the electromagnetic field[J]. Philosophical transactions of the Royal Society of London, 1865 (155): 459-512.
[4] Nie Y, Li X, Scott A, et al. A SKy Images and Photovoltaic Power Generation Dataset for Short-term Solar Forecasting. arXiv 2022[J]. arXiv preprint arXiv:2207.00913.
Dear reviewer,
Thank you again for your thoughtful comments. We have provided our responses and clarifications in the rebuttal, and we would greatly appreciate it if you could take a moment to review them, since there is only 3 days left. Your feedback is very valuable to us, and we hope our responses can help address your concerns. Thank you for your time and consideration.
Best regards,
Authors of Submission 11324
Rebuttal by Authors (1/2)
We sincerely thank the reviewer for the careful reading and the constructive comments. We have revised the paper according to your advice, and answered each of your question in turn below.
Answer: Thank you very much for raising this question. As illustrated in Section 2, the difference between related works and ours are twofolds: (1) early physical-system models predominantly use a single structured physical-data representation, while PhyMo integrates complementary visual and physical-field modalities, providing richer information for prediction. (2) recent multimodal approaches primarily learn statistical correspondences among numerical observations, while PhyMo explicitly constrains a dedicated physical-field representation through PDE-structured inputs and PDE-supervised reconstruction. As a result, the improvement arises from both greater observational coverage through multimodal integration and stronger physical grounding through governing-equation supervision, allowing predictions to exploit observable patterns together with the dynamics underlying them. Following your advice, we have blue-highlighted the revised content in Section 2. Please kindly review it.
Answer: Thank you for raising this question. According to the textbooks and well-established researches, lots of physical laws can be formulated in terms of PDEs. For example, heat conduction is described by the heat equation [1], fluid motion by the continuity and Navier–Stokes equations [2] and electromagnetic fields by Maxwell’s equations [3]. These examples span distinct branches of physics and share a well-established PDE-based framework, which justifies our claim above.
Answer: Thank you for raising this question. We have already provided the supporting work in the citaion. Take the cited Nie et al. [4] for example. They report that SUNSET’s forecasts exhibit temporal lags, following past observations rather than anticipating future events, and underestimate fluctuations under cloudy conditions, which exactly illustrates how fitting observed trends can coexist with inadequate modeling of cloud dynamics. Mechanistically, prediction losses penalize errors in observed values but do not explicitly penalize violations of the differential relationships governing their evolution. Thus, learning statistical correlations does not necessarily ensure physical consistency.
Answer: Thank you for raising this question. Our related work focuses on three aspects: (1) the development of existing approaches, (2) their limitations, and (3) how our work differs from them. Unfortunately, we cannot include the discussion of scientific questions which may be out of the scope of our paper in Section 2, due to the space limit.
Answer: Thank you for raising this question. We have improved the mathematical formatting throughout the paper (e.g., equation (1)). Please kindly review them.
Answer: Thank you for raising this question. Unfortunately, we have to use a compact figure to summarize the framework, minimize repetition with the main text, and use the available space efficiently, due to the space limit.
Answer: Thank you for raising this question. The average gain of our model against other baselines across datasets is actually 6.932%, with detailed information listed in the table below:
Although the gains vary across datasets, the proposed PhyMo generally achieves a significant improvement across datasets, especially the 25.229% gain on Boreas.