- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PhyTM, a physics-informed tri-modal framework for time-series forecasting. It integrates DMD-derived dynamical priors into Transformer attention for textual representations and structured Mamba state transitions for visual representations, alongside a numerical forecasting pathway. The three representations are fused for prediction. Experiments on eight long-term forecasting datasets and the M4 benchmark demonstrate competitive performance, supported by ablation studies, sensitivity analyses, and dynamical interpretability evaluations.
Critical strengths
-
Dynamically structured modeling: Incorporating DMD-derived spectral priors into both attention and state-space transitions provides a coherent approach to introducing dynamical inductive biases, potentially improving the interpretability of temporal representations.
-
Broad empirical evaluation: Experiments across eight long-term forecasting datasets and M4 demonstrate competitive results on several benchmarks, with ablation studies providing some evidence for the contributions of individual components.
Critical weaknesses
-
Limited methodological novelty and theoretical justification: The framework primarily combines established techniques (DMD, Transformer, Mamba, and multimodal representations). The claimed physical consistency is insufficiently justified, as contraction of individual state transitions does not guarantee stability or physical fidelity of the overall forecasting model.
-
Insufficient empirical validation: The ablations do not adequately isolate the benefits of physical priors from increased architectural complexity. Moreover, substantial underperformance on Electricity and Traffic raises concerns about generalizability, while computational efficiency and statistical significance remain insufficiently evaluated.
Questions for authors
-
Theoretical validity : What justifies applying DMD-derived temporal dynamics to spatially serialized GAF patches? Can the authors establish that contractive state transitions meaningfully improve physical consistency or forecasting stability?
-
Attribution of improvements: How can the authors distinguish the benefits of physical priors from increased model capacity? Would parameter-matched baselines and randomized spectral priors yield comparable improvements?
-
Generalizability and efficiency: Why does PhyTM substantially underperform on Electricity and Traffic? Can the authors provide computational cost comparisons and multi-seed results to substantiate its practical advantages and performance reliability?
9 comments
Q1.
(1) GAF temporal correspondence. The GAF matrix encodes pairwise temporal relationships. Each 16 × 16 patch represents a local block of these relationships rather than a consecutive segment of raw observations. The raster-scan order preserves the structured ordering of temporal-block pairs, providing an ordered sequence for state propagation. Here, Δ_p=16 denotes the latent patch-transition scale, not the original sampling interval.
(2) Patch-order validation. We trained Phys-Mamba with original and randomized patch orders using rebuttal/exp_q1q2.py --group order. Randomizing patch order increases MSE from 0.368 to 0.392 on ETTh1, from 0.171 to 0.185 on ETTm2, from 0.163 to 0.176 on Weather, and from 0.082 to 0.090 on Exchange. These results are reported in Appendix A.
(3) State stability and forecasting. We evaluated state-transition stability using rebuttal/exp_q1q2.py --group stability. Negative Decay achieves a spectral radius of 0.982 and an N-step state norm of 0.614. At H=720, Full PhyTM achieves a spectral distance of 4.181, compared with 4.588 for Standard Mamba and 4.731 without DMD priors. The corresponding results are provided in the supplementary experimental results.
Q2.
(1) Parameter control. The parameter-matched comparison shows that Full PhyTM achieves lower MSE under identical total and trainable parameter counts. The experiment is implemented in rebuttal/exp_q1q2.py --group capacity.
(2) Spectral-source comparison. Original DMD achieves the lowest MSE (0.368953), MAE (0.390558), and spectral distance (4.014608) among the six evaluated spectral configurations. The experiment is implemented in rebuttal/exp_q2_spectrum.py.
(3) Dynamical identification. Fixed DMD achieves the highest Macro-F1 in three of four trend/fluctuation identification tasks. The frozen-encoder probes are implemented in rebuttal/probe_q2.py.
These comparisons show that Full PhyTM improves forecasting under matched parameter counts and that Original DMD outperforms alternative spectral configurations.
Q3.
(1) Dynamical representation capacity. We trained PhyTM with different DMD mode numbers using rebuttal/exp_q3_modes.py. Increasing K from 8 to 32 reduces Electricity MSE from 0.215 to 0.181 and Traffic MSE from 0.601 to 0.502. These results show improved forecasting with increased modal capacity.
(2) Forecasting performance. The additional baseline comparisons show that PhyTM achieves the lowest MSE and MAE on ETTm2 and Exchange, the lowest MAE on Weather and ETTm1, and the best overall MASE and OWA on M4. The complete comparisons are provided in Appendices D and I.
(3) Computational efficiency. We measured PhyTM using rebuttal/profile_q3.py. Compared with Aurora, PhyTM reduces total parameters from 210.8M to 38.854M, training time from 45 s to 12.50 s per epoch, and inference latency from 82.56 ms to 35.47 ms per batch. Peak inference memory decreases from 1241 MB to 209.88 MB, while peak training memory decreases from 3072 MB to 243.23 MB. PhyTM also achieves lower MSE/MAE of 0.369314/0.393099, compared with 0.376/0.397. The complete comparison is presented in Appendix C.
Theoretical Analysis and Empirical Validation of PhyTM
We sincerely thank the reviewer for the thoughtful review and constructive suggestions regarding the theoretical justification and empirical effectiveness of PhyTM. In response, additional theoretical analyses and controlled experiments have been conducted. The main improvements are summarized as follows.
First, validation of the contribution of DMD-derived dynamics. To determine whether forecasting improvements originate from DMD-derived information rather than generic spectral parameterization or increased model capacity, six spectral configurations and parameter-matched experiments were conducted. Original DMD achieves the lowest MSE of 0.368953. Under matched model capacity, Full PhyTM reduces MSE from 0.405 to 0.368 on ETTh1. These results demonstrate the independent contribution of DMD-derived dynamical priors. These experiments address the concern raised in Q2.
Second, validation of the theoretical basis of the proposed mechanisms. To examine the stability of DMD-guided state propagation, a bounded-input state-propagation analysis was added under the stated assumptions. Negative Decay achieves a spectral radius of 0.982. Additional patch-order experiments show that randomizing GAF patch ordering increases ETTh1 MSE from 0.368 to 0.392. These results support the stability of the proposed state transitions and the importance of structured patch ordering. These additions address the concern raised in Q1.
Third, evaluation of forecasting performance and generalization. To examine the effectiveness of PhyTM on datasets with different dynamical complexity, modal-capacity experiments were conducted. Increasing K from 8 to 32 reduces MSE from 0.215 to 0.181 on Electricity. Additional comparisons with SimpleTM and TQNet were also provided. Computational profiling shows that PhyTM reduces inference latency from 82.56 ms to 35.47 ms per batch compared with Aurora. These results demonstrate the forecasting effectiveness and computational efficiency of the proposed framework. These results address the concern raised in Q3.
Finally, the manuscript and anonymous repository were updated with additional implementation details, experimental scripts, results, datasets, and execution instructions.
Overall, these additional analyses and experiments provide further evidence for the theoretical motivation, methodological contribution, and practical effectiveness of PhyTM. We hope these results address your concerns and would greatly appreciate your further feedback and reconsideration of the updated evidence.
Thank you for your time and consideration.
Thank you for the thoughtful review. The response establishes the theoretical basis of DMD-guided state propagation and provides controlled experiments to evaluate its effectiveness and computational efficiency.
We thank the reviewer for the constructive comments. We have conducted additional theoretical analyses and controlled experiments to examine the methodological contribution and forecasting performance of PhyTM. We have also updated
README.mdin the anonymous repository to describe the additional experiments, implementation scripts, execution instructions, and result locations. The repository contains the original model implementation (PhyTM.zip), additional experimental code (rebuttal.zip), experimental results (results.zip), and datasets (data_long/anddata_short/). The implementation details and complete experimental results are available in the repository.W1.
PhyTM uses shared DMD-derived dynamical parameters to guide two temporal operators. The same decay rates and oscillation frequencies are incorporated into the relative-time attention bias of Phys-Transformer and the rotation-decay state transitions of Phys-Mamba.
1. Theoretical analysis. Each continuous-time mode is represented by a rotation-decay block. Under bounded input forcing, if ∥Aˉt∥2≤q<1 and ∥Btut∥2≤M, the latent state satisfies ∥ht∥2≤qt∥h0∥2+1−qM(1−qt). This bound characterizes latent-state propagation under the stated assumptions.
2. Spectral-source replacement. We trained different spectral configurations under the same architecture using
rebuttal/exp_q2_spectrum.py. Original DMD achieves the lowest MSE (0.368953), MAE (0.390558), and spectral distance (4.014608), outperforming Random Spectrum, FFT-derived Spectrum, Decay-only, Learnable Stable Oscillator, and Mismatched DMD.3. Dynamical-pattern identification. We evaluated frozen encoders with linear probes using
rebuttal/probe_q2.py. Fixed DMD achieves the highest Macro-F1 in three of four trend/fluctuation identification tasks. On ETTh1 Trend, it achieves 40.38%, compared with 33.19% for Random Spectrum.4. Long-horizon validation. At H=720, Full PhyTM achieves a spectral distance of 4.181, compared with 4.588 for Standard Mamba and 4.731 without DMD priors. The results are reported in the supplementary experimental results.
W2.
1. Dynamical representation capacity. The effective ranks explaining 90% of variance are 4–10 for ETT, 27 for Electricity, and 51 for Traffic (Appendix L.1). DMD reconstruction error is positively correlated with relative forecasting error (r = 0.86, p = 0.006, Appendix L.2). We further trained PhyTM with different modal capacities using
rebuttal/exp_q3_modes.py. Increasing K from 8 to 32 reduces Electricity MSE from 0.215 to 0.181 and Traffic MSE from 0.601 to 0.502. Complete results are presented in Appendix B.2. Additional baseline comparisons. We extended the baseline evaluation with SimpleTM and TQNet across eight datasets and four forecasting horizons. PhyTM achieves MSE/MAE of 0.264/0.308 on ETTm2 and 0.269/0.372 on Exchange. It also achieves the lowest MAE on Weather (0.242) and ETTm1. On M4, PhyTM achieves the best overall MASE (1.462) and OWA (0.863). The complete comparisons are provided in Appendices D and I.
3. Computational efficiency. We profiled PhyTM using
rebuttal/profile_q3.pyon a trained ETTh1 checkpoint, with batch size 16, 5 warm-up iterations, and 30 timed repetitions.PhyTM uses fewer parameters and requires less training time, inference time, and memory than Aurora, while achieving lower MSE and MAE. The complete comparison is presented in Appendix C.