- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies context degradation in zero-shot probabilistic forecasting with multivariate time-series foundation models: supplying related time series can worsen a target series' forecast. The authors propose FOMO, a training-free method that retrieves other market histories and masks cross-series attention in the first half of a frozen forecaster, allowing interaction only in later layers. The evaluation covers four foundation models and five datasets from prediction markets, equities, and cryptocurrencies. Results suggest that delaying cross-series interaction can help in some settings, but the gains are uneven and FOMO does not consistently outperform native mixing. Depth ablations, representation analyses, and activation-patching experiments investigate why interaction depth affects forecasting performance.
Critical strengths
- Interesting finding. The paper shows that the depth at which cross-series information is introduced can materially affect pretrained time-series foundation models' forecasts. This suggests context degradation depends not only on which related series are supplied, but also on when the model combines them.
- Useful empirical analysis. The authors evaluate four foundation models across five datasets and provide depth ablations, representation analyses, and activation-patching experiments. These results offer empirical support for the importance of interaction depth.
Critical weaknesses
- The empirical gains are uneven and do not establish FOMO as a consistently better and generalized default. Although delayed interaction improves over target-only forecasting in many evaluated settings, the gains are sometimes small, and FOMO does not outperform other methods in every setting. The results therefore leave open when delayed interaction is beneficial and how reliably the observed gains transfer to other models, datasets, and forecasting tasks. The paper would be stronger with clearer characterization of the settings in which FOMO helps or underperforms.
- The contribution is not sufficiently positioned against alternative baselines and prior interaction strategies. The experiments compare target-only forecasting, native mixing, and different interaction-depth schedules, but do not provide a clear comparison with other relevant forecasting baselines or alternative methods for incorporating cross-series information. This makes it difficult to determine how much practical benefit comes specifically from FOMO, beyond the observation that interaction depth matters. The distinction from channel-independent forecasting and staged or adaptive cross-series interaction should be clarified.
Questions for authors
Q1 (Generalization and choice of interaction depth). FOMO uses a fixed half-depth rule, but its gains vary across models and datasets. What evidence supports using the same interaction boundary for unseen architectures or domains? Could a model- or dataset-adaptive choice of interaction depth improve consistency, and how could it be selected without tuning on the test set? Q2 (Comparison with other baselines and prior methods). Could the authors more clearly articulate FOMO's methodological novelty relative to existing multivariate forecasting baselines and alternative approaches to cross-series information integration, such as channel-independent and staged interaction methods? A clearer explanation of these distinctions, together with empirical comparisons against relevant baselines under comparable settings would help establish the practical benefit and novelty of FOMO. Q3 (Sensitivity to neighborhood size). The context-size ablation tests K=1, 3, and 7, with K=7 performing best among the tested choices. Could the authors test additional values, including values above 7 where feasible, to determine whether performance saturates or declines as more neighbors are added? It would also be useful to investigate whether different models benefit from different values of K, rather than using the same fixed neighborhood size across all models.
Retrieval pipeline is NOT what our paper focuses on and same-domain context (market prediction) is EXACTLY what our paper is about
Thank you for taking the time, we'd likely to emphasize 2 key points on the focus/main contribution of this paper:
The retrieval pipeline was never the focus of the paper, the idea of the paper was to mask certain parts of where context is mixed in the model to minimize context degradation. The idea of the paper was also exactly what they say "it rests on", it is about the late-layer / altered layer interaction as well as using related market which is same-domain context to help with forecasting. The entire field of market forecasting rests on this premise, and so we would respectfully challenge this comment as we believe both points do not apply to our main contribution in this paper!