- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies multivariate long-term forecasting. It splits each series into a few components (periodic, smooth, short-memory) with a sparse Gaussian process, applies the same nonlinear block to each component separately, and sums only the resulting forecasts ("late fusion"). The output is then mixed with a linear bank and with a "frozen reference" predictor , and validation MSE selects between the mixture and alone (Eq. 13). Under a reduced protocol (2,048 training windows per task, all baselines rerun by the authors on 7 datasets and 4 horizons), the paper reports the lowest mean MSE, a 1.38% gain over TimePro across five seeds, and a 5.12% degradation when the components are summed before the nonlinear block instead of after (Table 2). A deterministic replacement of the GP front end gives the same accuracy (Table 14). The theory (Lemma 1, Proposition 1) only states that the two fusion orders are different computations and does not say which is better (Section 3.4).
Critical strengths
S1. The authors report results that go against their own method and do not hide them: Table 14 (a deterministic front end is as good as the GP front end), Table 16 (a single resolution is as good as multi-resolution), and Table 21 (channel-order sensitivity). They also use five seeds, a factorial design (Tables 17--18), and report two kinds of confidence intervals in Section 5.
S2. The question itself, whether decomposed components should be summed before or after a shared nonlinear forecaster, is a reasonable question for a controlled comparison.
Critical weaknesses
W1. The main result cannot be attributed to the described method because of an undefined component, . The paper never specifies what model is; only its training schedule is given (Appendix A.4). It is a candidate of the final validation selection (Eq. 13), and alone reaches MSE 0.35138 (Section 5.2), which equals the strongest baseline TimePro (0.35136, Table 10). Everything described in Section 3 adds only 1.22% on top of it.
W2. The baseline comparison is asymmetric. Appendix D says that recommended, dataset-specific configurations were used, but then gives one reduced setting for iTransformer, TimeMixer and VPNet across all datasets (width 128 and two layers; one downsampling level; a fixed 3x3 kernel), each trained for 10 epochs (Table 9). LatentFlow is trained in three stages (10 + 2 + 10 epochs) with per-dataset settings selected by validation (Table 5). A unified reduced setting can be reasonable, but then it should also apply to the proposed model, or the paper should show that the official per-dataset settings do not perform better under the 2,048-window protocol; neither is done. No code or supplementary material is provided.
W3. Several terms are never defined ("prototype-memory operator", "scale head", ), and the symbols in Eqs. 9-13 are not defined where they appear. Table 2, the only mechanism table in the main text, is never cited, and Tables 4, 6, 7, 8, 9, 11, 21 and 23 are not cited anywhere either, so the reader is not told what these tables are meant to show. The layout is unpolished: Table 3 appears right after the references, before the Appendix A heading. The reproducibility statement promises per-horizon results in the appendix, but none are given. ETSformer is cited as ICLR 2023 but was rejected there and exists only as arXiv:2202.01381.
Questions for authors
Q1. What is ? Please state which model it is (its layers, inputs, and training data) and how it relates to the baselines in Table 1. Please also report Tables 1 and 2 with removed from the candidate set in Eq. 13, so that the contribution of the method described in Section 3 can be seen on its own.
Q2. Why were the baselines run with a single reduced setting rather than their official per-dataset settings? If official settings were tried under the 2,048-window protocol, please report them, at least for Electricity and Traffic where the margins are largest.
Q3. The reproducibility statement says the appendices give per-horizon results, but all appendix tables are 4-horizon averages or the 720 horizon only. Where are the per-horizon results? Also, what do "prototype-memory operator" and "scale head" refer to?