- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes StatTS-FM, a supervised adaptation framework for time-series foundation models that explicitly incorporates statistical structure. It uses trend/seasonal/remainder decomposition and ACF/PACF-based tokens, together with statistical losses on the predictive mean and history-conditioned location/scale adjustment. Using TimesFM-3 as the backbone, the method improves both point forecasting accuracy and statistical fidelity over a supervised raw-patch baseline. The paper also provides theoretical analysis of the statistical regularization and generalization under dependent time-series windows.
Critical strengths
-
The same-backbone comparison is well designed and provides convincing evidence that point accuracy and statistical fidelity can diverge. In particular, the no-statistical-loss variant improves MSE over raw-patch adaptation while worsening all three fidelity metrics.
-
The empirical evaluation is extensive. The paper includes broad benchmark comparisons, component ablations, individual statistical-loss ablations, robustness to missing inputs and reduced training windows, and probabilistic forecasting evaluation.
Critical weaknesses
-
The central notion of statistical fidelity of the predictive mean requires stronger justification. Under conditional uncertainty, the conditional mean is naturally smoother and may have different spectral and lag structure from an individual realized future trajectory. It is therefore not obvious that forcing the predictive mean to match the statistics of the realized target is always desirable.
-
The statistical-fidelity experiments are narrower than the overall point-forecasting evaluation and are based on point estimates without cross-seed uncertainty. Since the proposed method introduces several additional modules and loss terms, training stability is important for assessing the robustness of the reported gains.
Questions for authors
-
Why should the statistical properties of a realized future trajectory be imposed specifically on the predictive mean rather than on samples from the predictive distribution? Under conditional uncertainty, the conditional mean is expected to be smoother than individual realizations. Could the authors further justify why predictive-mean fidelity is the appropriate target?
-
How stable are the main Full versus Raw-patch and Full versus no-stat results across random seeds? Reporting cross-seed variability for the main controlled experiments would substantially increase confidence in the conclusions.
We thank the reviewer for the assessment of the controlled comparison and for the questions about mean-trajectory fidelity and training variability.
Q1. Why impose realized-target statistics on the predictive mean rather than predictive samples?
We supervise the single trajectory returned for point forecasting. The question is whether making its value distribution, spectrum, and lag structure explicit objectives can improve these properties alongside point accuracy in finite-data adaptation. This is an additional forecasting objective, whose usefulness is assessed empirically. The “predictive mean” is the mean of our fitted Gaussian model and need not equal the true conditional expectation under the regularized objective.
We agree that the true conditional mean can be smoother than realized futures. Let y=vec(Y), m=E[y∣I], and Σ=Cov(y∣I), where I denotes the available history and observation mask. With finite second moments and the first-difference operator D, Equation (20) in Appendix H establishes
=\|D\mathbf m\|^2+\operatorname{tr}(D\Sigma D^\top).$$ Thus, the conditional mean has no greater difference energy than realized futures have in conditional expectation. It also minimizes population squared error. Matching realized-target statistics can move the fitted mean away from that optimum; statistical penalties cannot lower the population Bayes MSE minimum. Section 3.4 now states this accuracy–structure trade-off. The reported joint improvements concern finite-data adaptation relative to trained baselines, and do not imply that a conditional mean should universally reproduce realized-path statistics. The linear difference-energy identity also does not directly establish the behavior of the nonlinear spectral and selected-lag losses. Supervising predictive samples is a natural direction for studying distributional forecasts and joint future trajectories. Our Gaussian model has conditionally independent innovations across forecast times and variables. Mean-trajectory penalties therefore do not model residual temporal dependence in sampled paths. Gaussian CRPS and interval coverage assess predictive marginals, while joint sample-path fidelity remains untested. The current evidence supports the evaluated properties of a point forecast; scenario generation requires separate modeling and evaluation. **Q2. How stable are Full versus Raw-patch and Full versus no-stat?** We added three paired training repetitions on ETTh1, Electricity, and Weather at $L=H=96$. The complete study includes six variants, totaling 54 training runs. Appendix F, “Repeated Adaptation and Loss Comparisons,” reports per-dataset summaries in Tables 17–19 and every run's five metrics in Tables 20–22. For the main-text summary in Table 2, we first average the three datasets equally within each repetition, then calculate the mean and sample SD across those three macro values. | Variant | Macro MSE, mean ± sample SD | | --- | --- | | Raw-patch | 0.2318 ± 0.0011 | | Structured, no-stat | 0.2206 ± 0.0007 | | Full | 0.2138 ± 0.0023 | Across all nine dataset–repetition pairs, Full has lower errors than Raw-patch and no-stat on all five metrics. In every pair, no-stat improves MSE and MAE over Raw-patch while worsening Marg-W1, Spec-Err, and Corr-Err. The central accuracy–fidelity divergence therefore recurs throughout these repetitions. Full's MSE SD is larger than those of both controls. The results support consistency of the observed advantage's direction within the reported repetitions, rather than reduced training variance or a significance claim. We report them as three training repetitions; the numerical seed identifiers have not yet been verified against the run records. This added variability evidence covers three datasets at $H=96$. It does not extend to all twelve benchmarks or longer horizons, and the original six-setting $H=96/336$ study remains separately reported.