- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CTIA-ODE for long-term multivariate time series forecasting. Variable-level historical representations are evolved by a latent neural ODE whose vector field combines learned state dynamics with attention to static exogenous keys and values. The model additionally uses shared-weight refinement, a linear residual path, future calendar features, and an outlier-robust hybrid loss. Experiments on eight benchmarks report competitive forecasting accuracy, with component ablations and perturbation studies intended to explain the improvements.
Critical strengths
1.The combination of a linear forecasting path and a context-conditioned nonlinear branch is a useful design, and the reported ablations provide evidence that the components are complementary. For example, on ETTm1 at T=720, Table 2 reports MSE 0.472 for the full model, compared with 0.488 without the ODE branch and 0.548 without the linear path. Table 1 also reports strong MAE results, including the best MAE among the listed methods at all four Traffic horizons.
2.The release provides an inspectable implementation of the proposed architecture and a concrete record supporting part of the empirical evaluation. The available Weather log reports MSE/MAE 0.350809/0.342421 at T=720, consistent with the rounded values in Table 1. This is useful supporting evidence, although it is not an independent reproduction.
Critical weaknesses
1.Important results are inconsistent across tables, and the differences are not explained by the stated settings. For Weather at T=720, Table 1 and Table 6 report 0.351/0.342, whereas Table 7 reports 0.251/0.283 at the default ORHL parameters, δ=1 and λ=5. For ETTh1 with L=96 and T=720, Table 1 reports 0.526/0.504, while Table 8 reports 0.452/0.460. The available Weather log supports the main-table result but does not resolve the alternative result in Table 7; no corresponding ETTh1 log was found in the inspected release. These discrepancies affect the interpretation of the hyperparameter and look-back studies. They may be reporting errors or reflect undocumented protocol differences, but the current manuscript does not establish a consistent experimental account.
2.The evidence does not sufficiently isolate the benefit of continuous latent evolution from that of a nonlinear attention branch. Table 2 compares the full model with a “Pure Linear” variant; this supports adding a nonlinear branch, but does not establish an advantage over a comparable discrete residual or recurrent attention module. In Section 3.3 and the released implementation, integration occurs over a fixed latent interval [0,1] with static exogenous context, rather than following observation timestamps. The masking and shifting results in Appendix B are useful robustness tests, but do not by themselves attribute that robustness to ODE integration. Similarly, the released training loop applies global gradient clipping at norm 5.0, which needs to be accounted for when interpreting the claimed ORHL stability benefit. These gaps leave the central mechanistic explanation less well supported than the full-model accuracy results.
Questions for authors
1.Can you reconcile the Weather results in Tables 1, 6, and 7 and the ETTh1 results in Tables 1 and 8? Please identify whether the entries use the same data split, evaluation targets, preprocessing, input length, seed protocol, and model configuration, and provide the corresponding corrected entries or existing run records.
2.Is there a comparison that replaces the ODE integration with a discrete residual or recurrent attention module while retaining the same encoder, exogenous context, linear path, refinement, loss, and a comparable parameter/compute budget? If available, such a result would materially clarify the specific contribution of continuous integration beyond the current Pure Linear comparison.
3.Was the norm-5 gradient clipping in exp/exp_main.py applied identically to the full model and the MSE/MAE loss ablations? Please clarify which evidence distinguishes the effect of ORHL from that of gradient clipping in the stability analysis.
7 comments
W2/Q3: Gradient clipping norm5
Thank you for raising this concern. The full model and the MSE- and MAE-loss ablations all used the same global L2 gradient-clipping threshold of 5.0. We added a controlled experiment in Appendix G.2 (lines 1170-1213) comparing each loss with and without gradient clipping to distinguish the effect of ORHL from that of clipping.
Controlled comparison. The experiments use Weather, L=96, and seed 2026. We report MSE and MAE averaged across four forecast horizons: 96, 192, 336, and 720.
Table. Loss and gradient-clipping comparison on Weather. MSE and MAE are averaged across the four forecast horizons. Max gradient norm denotes the maximum global gradient norm before clipping. Clip rate is the percentage of training steps that trigger clipping.
| Loss | Clipped MSE ↓ | Clipped MAE ↓ | Unclipped MSE ↓ | Unclipped MAE ↓ | Max gradient norm | Clip rate |
|---|---|---|---|---|---|---|
| MSE | 0.250 | 0.277 | 0.250 | 0.277 | 0.781 | 0% |
| MAE | 0.248 | 0.270 | 0.248 | 0.270 | 0.375 | 0% |
| ORHL | 0.245 | 0.267 | 0.245 | 0.267 | 2.060 | 0% |
Results. The maximum gradient norm stays below 5.0 for every loss, so clipping is never activated. Forecasting errors are identical at the reported precision before and after removing clipping. ORHL achieves the lowest average MSE and MAE in both cases. These results show that ORHL's accuracy advantage in this setting is not attributable to norm-5 gradient clipping. We have added this analysis and the supporting results to Appendix G.2 (lines 1170-1213).
Follow-up on Experimental Consistency and Released Materials
Thank you for the additional experiments. The discrete-attention comparison is useful, and the clipping logs substantially address that concern. However, inspection of the released materials leaves three issues requiring clarification:
-
Internal inconsistency in the ODE comparison log. For seed 2026, the reported MSEs are 0.153207680 (RK4) and 0.155905229 (recurrent), giving a difference of 0.002697549, whereas the
PAIREDline reports 0.001697548. Similar discrepancies occur for the other seeds and MAE. Although the reported means and standard deviations match the individualRESULTentries, the paired differences do not. Please reconcile these records with the supplied script and provide the corresponding original logs. -
Changed dataset and configuration. The original look-back experiment concerned ETTh1 at T=720, whereas revised Table 13 reports ETTm1 averaged across horizons. Please explain this change and resolve the original ETTh1 discrepancy. Moreover,
table8.pyuses hidden dimension 16 and learning rate 2e-5, versus 128 and 5e-4 stated in the manuscript. Which configuration produced the main-table ETTm1 results? -
Missing source dependencies. The supplementary scripts load
weather.pyandettm1.py, but neither is included in the archive. Please provide the exact versions used.
I retain my current rating pending clarification of these consistency and traceability issues.
Thank you for taking the time to provide this constructive feedback! We respond below to the identified weaknesses (W) and questions (Q).
Thank you for identifying these inconsistencies. We sincerely apologize for these discrepancies between Table 1 and the appendix tables. The appendix reported results from an earlier version of the code. We did not update those results when we revised Table 1. We reran the relevant experiments and corrected the affected tables in the revised manuscript.
The specific corrections and reporting settings are as follows:
Table 7. The revised result for the default setting δ = 1 and λ = 5 is 0.245 MSE and 0.267 MAE. These values are averaged across T ∈ {96, 192, 336, 720} and match the Weather Avg row in Table 1. We have clarified this averaging protocol in the text.
Table 8 (now Table 13). The revised table reports MSE and MAE averaged across forecast horizons T ∈ {96, 192, 336, 720}. At L=96, the CTIA-ODE results are 0.245/0.267 on Weather and 0.396/0.390 on ETTm1, matching the corresponding Avg rows in Table 1. The other entries in Table 13 have also been updated based on the corresponding experiment results.
The corresponding entries use the same data split, evaluation targets, preprocessing, input length, seed protocol, and model configuration. All results and conclusions are now consistent. Additionally, the source code and experiment logs for these appendix experiments are uploaded to the anonymous repository at https://anonymous.4open.science/r/CTIA-ODE-15A6/Appendix/readme.pdf.
Thank you for this constructive suggestion. We agree that the Pure Linear comparison alone does not isolate the benefit of ODE integration. We therefore added a controlled comparison in Appendix E.4 (lines 964-1004) against a shared-weight gated recurrent cross-attention module.
Experimental design. Both models use the same encoder, auxiliary-context construction, linear branch, refinement network, loss, and training protocol. Both use ORHL. Only the ODE module is replaced. The discrete model performs 16 recurrent updates per forward pass. This matches the 16 vector-field evaluations in the RK4 model. The parameter counts differ by 129, or about 0.025%. Equal update and evaluation counts do not imply equal computational cost. We therefore also measure inference latency.
Results. Both models are evaluated on Weather. The input length is L=96, and the forecast horizon is T=96. Both use seeds 2026, 2027, and 2028.
Table. ODE integration versus discrete recurrent attention on Weather (L=96, T=96). Forecasting errors are reported as mean ± sample standard deviation across three paired seeds. Latency is measured per batch of 256 samples and reported as mean ± sample standard deviation across the three seed-specific average latencies.
CTIA-ODE reduces mean MSE by 1.01% and mean MAE by 0.53% relative to the recurrent-attention model. Its inference latency is 19.0% higher. These results support the benefit of ODE integration over the tested discrete replacement under a nearly identical parameter budget. The full protocol and results are provided in Appendix E.4 (lines 964-1004) and summarized in the main-text ablation section (lines 414-418).