- Rating
- 3(+1)
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the phenomenon of context saturation in timeseries foundation models, examining how the predictive performance of 11 pre-trained models varies with input history length. Through controlled synthetic experiments and GiftEval-based evaluation, the study analyzes task- and model-specific context requirements and proposes a lightweight selector trained solely on synthetic data, aiming to minimize theoretical computational costs while maximizing predictive accuracy.
Critical strengths
- The problem setting has clear practical value, as context length selection helps balance forecasting accuracy and computational cost when deploying time series foundation models.
- The paper provides a comprehensive experimental evaluation across 11 models, covering both controlled synthetic settings and real-world forecasting tasks.
Critical weaknesses
- The paper provides a theoretical efficiency analysis but lacks actual runtime measurements.
- The method is calibrated on synthetic data, but the real-world evaluation mainly reports aggregate MASE, potentially masking threshold violations and severe error degradation in individual cases.
Questions for authors
None
3 comments
Response to Authors
Thank you for the detailed response and additional analyses, which address most of my concerns. I have therefore decided to raise my rating from 2 to 3. Best wishes.
We thank the reviewer for acknowledging our response and raising the score. We are happy that it addressed their concerns.
We thank the reviewer for their review and comments. We address the reviewer's concerns in the following.
We agree that actual runtime measurements can provide a more direct perspective about the computational speedup achievable under a particular policy. We favored the theoretical efficiency as runtime improvements depend on many hardware and implementation dependent factors. Nonetheless, in the revised manuscript we added Table 16, reporting a case study for the Max Efficiency policy, showing how MAC savings translate to actual computation speedup on both GPU and CPU. Indeed, the results show that throughput can be significantly improved, even when explicitly accounting for the cost of the full context selection pipeline (i.e., feature extraction and candidate lengths risk scoring). This highlights how dynamic context length selection can provide concrete practical advantages, beyond the theoretical MAC quantification.
Let us clarify that it is common practice to evaluate TSFMs performance in terms of aggregate metrics [1,2,3,4]. Indeed these can mask severe degradations in individual cases, as much as they can mask outstanding improvements. To assess whether variations around the reported aggregate metrics are substantial, in the revised manuscript we added Appendix D.7, where we show the standard deviation, as well as 5-th and 95-th percentile, of the relative MASE change for dynamic and fixed length context selection policies. In particular, Table 13 reports values across the Gift-Eval benchmark, while Table 14 shows per-model measurements. Overall, these results suggest that dynamic context length selection does not present excessive variability, in particular, compared to fixed length policies, relative error variability is lower when targeting higher computational savings. Intuitively, this might be due to the additional flexibility in selecting an appropriate context length on an input-dependent basis.
Regarding threshold violations, indeed those could occur and we do not claim otherwise. The calibration targets compliance in aggregation over the target data distribution, hence individual samples may surpass the thresholds. To provide information about this, we added Section D.8 in the revised manuscript's appendix. It reports the fraction of GIFT-Eval samples on which the threshold is violated by each individual dynamic policy for the two thresholds considered by the methodology: (i) the mean relative error degradation and (ii) the percentage of samples that exceed a 5% error degradation. The results (Table 15) show how the first threshold is occasionally violated, mainly for more aggressive policies, while the second threshold is almost never violated. Let us remark that we do not expect the thresholds to hold strictly, as the context length selector is calibrated on synthetic data, whose input-dependent error distribution differs from that of the real-world data we evaluate the methodology on.
We thank the reviewer again for their comments. Please let us know if there are any outstanding concerns preventing a higher score. We remain open to further discussion during the rebuttal period.
[1] Petralia, Adrien, et al. "Timestral." arXiv, 27 Oct. 2026, doi:10.48550/arXiv.2610.37585.
[2] Ansari, Abdul Fatir, et al. "Chronos-2: From Univariate to Universal Forecasting." arXiv, 17 Oct. 2025, doi:10.48550/arXiv.2510.15821.
[3] Shchur, Oleksandr, et al. "fev-bench: A Realistic Benchmark for Time Series Forecasting." arXiv, 30 Sept. 2025, doi:10.48550/arXiv.2509.26468.
[4] Aksu, Taha, et al. "GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluation." arXiv, 14 Oct. 2024, doi:10.48550/arXiv.2410.10393.