- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper addresses the limitations of existing MoE routing methods for time-series foundation models, which assign experts based on observed patterns or learned representations without considering whether different time series share similar predictive mechanisms.
To address this challenge, the authors propose MER, which characterizes predictive relationships through normalized multi-horizon response fingerprints generated by perturbing relevant historical inputs. These fingerprints are clustered into shared prototypes to guide expert selection, which enables time series with equivalent predictive responses to reuse model parameters. Extensive experiments demonstrate improved forecasting accuracy and zero-shot generalization compared with existing MoE methods.
Critical strengths
- The major novelty lies in the definition of predictive response equivalence as the criterion for expert reuse, rather than the fingerprint encoding or clustering techniques themselves as indicated by the authors. Pertubrbation, representation learning, clustering, and Top-K routing techniques are all commonly used. Therefore, the novelty of the paper is moderate, though not minimal.
- The paper reports strong numerical results, consistently achieving lower forecasting MSE than the strong baseline Moirai-MoE across multiple datasets and forecasting horizons.
- The authors also conduct controlled synthetic experiments, ablation studies, and cross-dataset transfer evaluations, providing further evidence of the proposed method's effectiveness and generalization capability.
Critical weaknesses
- Even though the performance is clearly improved, MER includes additional response-model training, fignerprint calibration, and prototype construction. The extra training effort incurred should be quatified.
- The paper argues that similar observable patterns can correspond to different predictive mechanisms. However, if those mechanisms cannot be distinguished using the proposed method, no routing function can reliably identify the mechanism. To further improve the soundness of the work, it will be helpful to analyze which observable information enables MER to distinguish these mechanisms. I understand this can be a tough task especially for an academic paper. Therefore, this weakness does not impact my decision about this paper.
- MER relies on a pretrained model to estimate predictive relationships, but errors in these estimates may lead to incorrect expert selection, especially under domain shifts. Although the paper includes an oracle routing baseline, the authors could further compare routing based on true and predicted responses in synthetic experiments to better understand how estimation errors affect performance.
Questions for authors
Refer the the weaknesses
Learned versus generator responses, observable information, and source cost
Thank you for suggesting the direct comparison with generator responses. It lets us measure how often the selected experts change when we improve the responses supplied to a frozen router. We report this comparison in §6.4 and Table 22, alongside a separate test of fingerprint sensitivity. We address the three weaknesses in the order listed in your review.
W1 · Added training cost. On a named source, support–response fitting took 1.50 h, fingerprint calibration 1.00 h, offline clustering of 100,000 128-dimensional fingerprints 0.12 h, and forecast co-adaptation 2.73 h. The total was 5.35 elapsed hours including clustering. The respective update ceilings for the three trained stages were 62,100, 38,100 and 89,300; validation-based stopping may finish earlier (Appendix H.1, p. 27).
Raising the Stage-4 ceiling to 189,500 improves frozen ETT macro MSE from .33876 to .33210 for Pattern and .31641 to .31284 for Graph. MER stays at .30775, a .00509 (1.63%) advantage over extended Graph, which took 5.79 elapsed hours (§6.4, p. 10; Table 25). This is a wall-clock comparison; training FLOPs were not matched. At inference, the full procedure raises per-window latency from 17.5 to 20.4 ms and compute from 3.3 to 3.5 GFLOPs, with 2.1M auxiliary parameters (Table 1).
W2 · Observable information about the regime. In Proposition 3 (§5, p. 7), the two regimes share marginals and second-order summaries. With G(x)=x3−3x/5, the covariance term vanishes because E[XsG(Xs)]=0. But at forecast origin t, a completed historical pair with s+1≤t carries the nonlinear signal
E[G(Xs)Ys+1∣Z]=ZaE[G(Xs)2].
Its sign follows the persistent regime Z. MER can condition its response estimator on already observed multichannel history and query it at canonical input values. This example identifies information available in principle. If the balanced regimes have identical laws over everything the router observes, a classifier using those observations cannot exceed 50% population accuracy (Corollary 1).
W3 · Learned versus generator responses. On 4,000 held-out CausalTime windows, we fix one checkpoint (training seed 17) and replace only its learned canonical-query responses. We estimate the generator's conditional means from 4,096 trajectories per query. Both branches share the six selected parent–lag roles, queries, fingerprint encoder, prototypes, experts, and forecast head. Each applies the original single-parent normalization to its own responses.
The substitution lowers MSE by 11.77% without retraining. The unordered Top-2 sets agree on 3,427 windows (85.675%) and change on 573. MRC and MSS use the same 120 same-class and 160 different-class pairs in both branches (§6.4, p. 9; Table 22, p. 26). For comparison, Table 19 reports a five-run MER mean of .097 and an oracle MSE of .076. That oracle receives the true reuse class directly. The generator-response branch above still selects experts through the learned fingerprint and prototypes.
We also perturb the normalized 128-dimensional generator-response fingerprints. At displacements .05/.10/.20/.40 measured after renormalization, Top-2 agreement is 96.2/85.7/71.4/52.8% and MSE is .08912/.09804/.11263/.13820 (Table 23). The .10 setting resembles the learned branch in its aggregate agreement and MSE; it does not estimate that branch's per-window errors. Proposition 5 (p. 15) gives a sufficient condition for each window: displacement below half the second-to-third cosine-score margin preserves the set. Mixture weights can still change.
Separately, all eight ETT/PEMS directions excluding the target from MER source training favor MER over Graph. ILI/Weather establish frozen target evaluation with unknown inclusion in the source mixture (Tables 16–17). These transfers measure forecast utility under shift; response-estimation error itself was measured in the controlled study.