- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ReTS, an adaptive modular foundation model for time series forecasting. It addresses the problem that existing foundation models process every input through all modules, even when a module’s property assumption (e.g., periodicity, non-stationarity, missingness, or variable dependency) does not match the input, which may reduce forecasting accuracy. To solve this, the authors decompose existing forecasting models into modules and rearrange them into a unified recurrent structure. A property learner then activates only the modules whose assumptions match each input and decides the number of recurrent steps.
Critical strengths
- The paper provides an interesting view that explains the structures of many existing forecasting models through their property assumptions, and builds a modular foundation model that selects modules for each input.
- ReTS achieves competitive results on both regular and irregular datasets, with far fewer parameters and much lower computational cost than existing foundation models.
Critical weaknesses
- The authors admit that the reproduced zero-shot results of several baselines are much worse than those reported in the original papers. In addition, only small or older variants and short lookback windows (e.g., 24 steps for ETTm1) are used, which may underestimate the baselines.
- ReTS is pre-trained on the training sets of the other seventeen benchmark datasets, which include closely related datasets (e.g., ETTm1 when testing ETTh1, MIMIC-III when testing MIMIC-IV). Meanwhile, baselines are excluded on datasets that overlap their pre-training data, so the zero-shot comparison is not fair.
- According to Appendix C.2, the activated structures are mostly close to Leddam for regular data and HyperIMTS for irregular data. Moreover, w/ NAS performs almost the same as ReTS (0.69 vs. 0.67 MSE), so the benefit of the proposed module activation is not clear.
- In Figure 1 and Appendix A, removing mismatched modules changes MSE by only about 1–5% on a few datasets, and no variance is reported. This is not strong enough to support the main motivation.
Questions for authors
Please refer to Critical Weaknesses.
We thank the reviewer for finding the property view interesting and the efficiency results strong.
W1. Reproduction of baseline results and lookback windows
A1: We replicate the baselines using their own upstream repositories. Sundial reproduces to within 0.16% on ETT against our Table 1:
On ECL, MOIRAI agrees to within 0.5% at {96, 192}. The remaining gap at {336, 720} is MOIRAI's unstable performance exposed by the differences between the two standards: the two pipelines zero-pad the lookback window to a different length before encoder, and MOIRAI's any-variate attention is sensitive to that padding.
As already mentioned in paper, we have double-checked these entries, including code differences and checkpoint integrity.
Small: Only one model, MOIRAI-small, is intentionally chosen as the small variant, since our work compares both accuracy and efficiency, where it is the closest baseline to ReTS's scale;
Old: We follow the latest baseline Zeus (ICML 2026) to select Chronos-Bolt, and TimesFM 2.5 is already the latest variant by the time we submit this manuscript in Sept 2026. Other baselines do not have newer variants in their original papers.
This is one of the few mistakes in the manuscript, thanks for pointing out. ETTm1 also uses a 96-step lookback window, like other regular time series datasets, and it is now corrected in Appendix H.
W2. Zero-shot comparison fairness
A2: Three-fold
Gift-Eval: We re-pre-train the ReTS family on GiftEvalPretrain covering 88 datasets (no overlap with GiftEval zero-shot), benchmarking variants from Luna to Astra (new variant based on Luna with hidden dimension 1280 and 20 layers, matching TimesFM), against the official scores reported by GiftEval:
ReTS Astra ranks the second, with 13G MACs of FLOPs, still smaller than any baseline. It should be noted that GiftEval primarily contains TS with seasonality and no missingness, where the TS property combinations are not diverse enough to fully demonstrate the power of dynamic module activation in ReTS.
Pre-training MOIRAI on the same set of datasets as ReTS in manuscript, its averaged MSE improved to 1.10 over the 18 datasets, but ReTS still has 39.2% lower MSE.
ReTS is never pre-trained on the dataset it is evaluated on: Excluding the five datasets, ReTS is also the best performing in zero-shot on 9/13 (MSE) and 7/13 (MAE) datasets.
W3. Activated structures and the NAS comparison
A3: Expected results. Cited from Section 5.5: ... achieve similar performance against NAS, without searching through numerous candidate structures.
We measured a 3h stage 2 training of ReTS, while the NAS search on the same set of modules and GPU cost 12h. Theoretically, a new module only adds one binary decision in ReTS and the cost grows as O(∣M∣), while the search space of NAS grows as O(2∣M∣), where M is the set of modules.
W4. Effect size and variance of the motivation ablations
A4:
In time series forecasting research, such improvement is actually well within expectation among existing papers, not to mention we significantly improve efficiency at the same time.
We measured this on the baselines' own published tables. The winner's margin over the 2nd is a mean of 2.28%, and 72 of the 82 entries fall below 5%. Restricted to the 4 foundation models, the margin over the runner-up is mean 1.82%, range 0.30%~7.83% over 25 entries, with 23 of the 25 below 5%:
Thanks again for your careful review! We hope that the answers meet your expectations :).