1. Limited methodological novelty and insufficient isolation of the proposed inductive bias
The approach closely follows proxy-based mixture optimization (Liu et al., 2025), while dataset representations and temporal attributes have previously been explored for data selection (Zhang et al., 2025; Saurav et al., 2026).
Moreover, several existing TSFMs explicitly design and evaluate their pretraining mixtures (Ansari et al., 2024; Woo et al., 2024; Das et al., 2024). Most notably, Toto 2.0 (Khwaja et al., 2026) already optimizes pretraining-source proportions using a small forecasting proxy and transfers the selected mixture to substantially larger TSFMs. This closely anticipates the broader proxy-guided selection contribution, yet is not discussed.
The main remaining novelty is therefore the temporal-statistics representation. However, these features are deterministic linear functions of the source proportions already supplied to TabPFN. They introduce no additional information about candidate mixtures for a fixed source pool, but instead modify the predictor's inductive bias. While potentially useful, the paper does not establish that the gains arise from meaningful temporal information rather than generic feature augmentation. Dimension-matched random-feature or permuted-statistic controls are needed to substantiate this central contribution.
2. The incremental value of second moments is not convincingly demonstrated
Relative to Mean-only, DATS-Mix achieves just 1.10% lower native forecasting loss (p=0.277, favorable in 2/3 seeds) and a similarly inconclusive WQL improvement (p=0.220). Surrogate prediction accuracy is nearly identical, and all representations achieve the same finite-set selection regret. Furthermore, the three full-model seeds evaluate fixed mixtures rather than independently repeated selection procedures. Thus, the results suggest that temporal feature augmentation may be useful, but do not establish a reliable incremental benefit from second moments, which constitute a central part of the proposed method.
3. Limited generalization evidence and missing experimental controls
Given the modest methodological novelty, stronger experimental validation is needed to establish the contribution's significance.
The baseline comparisons are incomplete: simple uniform-source and uniform-domain sampling, stronger proxy-based mixture optimizers (e.g., Toto-style TPE), and compute-matched comparisons are missing. The RegMix comparison also changes multiple components beyond the feature representation.
Furthermore, the main evaluation uses later windows from the training sources, the GIFT-Eval evaluation covers only a development-inspected short-horizon subset, and experiments are restricted to one source pool and architecture family. These limitations leave the generality of the findings uncertain.
References
Ansari, A. F., et al. (2024). Chronos: Learning the Language of Time Series. Transactions on Machine Learning Research (TMLR).
Das, A., Kong, W., Sen, R., and Zhou, Y. (2024). A Decoder-Only Foundation Model for Time-Series Forecasting. ICML.
Khwaja, E., Lettieri, C., Woo, G., et al. (2026). Toto 2.0: Time Series Forecasting Enters the Scaling Era. arXiv:2605.20119.
Liu, Q., Zheng, X., Muennighoff, N., et al. (2025). RegMix: Data Mixture as Regression for Language Model Pre-training. ICLR.
Saurav, K., Baghel, V., Jain, A., and Guruprasad, R. B. (2026). Time Series Attributes Guided Pretraining Data Selection for Time Series Foundation Models. ICASSP.
Woo, G., Liu, C., Kumar, A., Xiong, C., Savarese, S., and Sahoo, D. (2024). Unified Training of Universal Time Series Forecasting Transformers. ICML.
Zhang, M., Tissue, H., Wang, L., and Qiu, X. (2025). Domain2Vec: Vectorizing Datasets to Find the Optimal Data Mixture Without Training. ICML.
Dear Reviewer nG2S,
We apologize for the delay in our reply. We thank you for the time and effort devoted to reviewing our work and for recognizing (S1) the temporal-aware mixture representation, (S2) proxy-guided mixture optimization for TSFMs, and (S3) the 10.85% gain over size-proportional sampling together with the ablations.
The replies below cover (W1) transfer to entirely unseen domains and (W2) the cost of 128 proxy runs. Revisions are marked in blue in the updated PDF, and each reply concludes with their location.
W1. Transfer to unseen domains
The external evaluation now covers the full GIFT-Eval benchmark instead of the short-horizon subset, and DaTS-Mix has the lowest mean WQL there.
Thank you for raising this point. GIFT-Eval covers short to long horizons (371,330 windows per model), and the original subset is retained in Appendix C.5. For TSFMs pretrained on each mixture, the table reports the validation loss (a domain-balanced mean log loss on held-out future windows of the training sources) and the domain-balanced GIFT-Eval weighted quantile loss (WQL), averaged over three training seeds.
DaTS-Mix remains the lowest after excluding the 11 configurations known to overlap our training sources (2.9% lower than size-proportional sampling, p=0.04, paired t-test).
Revision: Sections 4 and 5.2, Appendix C.5 (Tables 1 and 2).
W2. Cost of 128 proxy runs
The 128 small proxies are a one-time cost comparable to prior work, and with temporal statistics 64 proxies already give about the prediction accuracy that 128 give without them.
Thank you for this observation. The proxy budget is compared with prior work below:
The 128 proxies cost about 0.76 full-size runs (parameters × training windows) once, regardless of the target model size. Toto 2.0 likewise reused one search for models from 4M to 2.5B parameters. In return, DaTS-Mix reaches the final loss of size-proportional sampling with 62% fewer updates (about 7.6k of 20k), so the saving grows with the target budget, whereas the proxy cost remains fixed.
As RegMix showed, the number of proxies matters. When our regressor is refitted on random subsets of the proxy runs, its prediction error on 48 held-out mixtures decreases with diminishing gains up to 128:
With 64 runs, DaTS-Mix already predicts about as accurately as the selector without temporal statistics does with all 128 (0.0257 versus 0.0255), so temporal statistics also reduce the proxy budget needed for a given accuracy.
Revision: Section 5.6, Appendix D.6 (Table 25).
To improve the clarity of the paper, the revision also explains why second moments are added (Sections 1 and 3.1), contrasts DaTS-Mix with recent TSFM data-selection work (Sections 1 and 2.2), and summarizes the robustness analyses in Section 5.6.
We thank you again for your encouraging assessment and hope that these additions further strengthen your confidence in the work.