- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MM-Time, a framework that enables pretrained time series foundation models to use event descriptions, such as promotions and holidays, when forecasting. Its Event-Effect Prototype Router maps event descriptions and temporal attributes to shared learnable prototypes. Event Interval Rotary-Bias Attention uses event start and end times to guide when this information should influence the forecasts. The framework adapts existing models by training event-conditioning modules, DoRA adapters, and the forecasting head while freezing the remaining backbone parameters. Experiments on e-commerce and retail datasets show improved forecasting with Chronos-2, Falcon-2, and TiRex-2.
Critical strengths
-
S1. MM-Time incorporates event information into pretrained TSFMs by translating event descriptions into useful forecasting information and aligning that information with prediction times.
-
S2. The experiments support the framework’s effectiveness across three TSFM backbones.
Critical weaknesses
-
W1. The dataset descriptions are insufficient. Specifically, it is unclear where the data came from, how the event descriptions were collected or generated, and how the authors verified that this information was available at forecast time.
-
W2. Although the ablation studies show that the Prototype Router improves forecasting accuracy, they do not clearly demonstrate that it learns meaningful numerical effects shared across semantically different events, as claimed in the paper.
-
W3. Although the ablation studies show that Interval RoPE and Locality Bias improve forecasting accuracy, it remains unclear whether the attention mechanism actually learns meaningful temporal relationships between events and forecast steps.
-
W4. Forecasting results are provided without statistical significance tests. Since some improvements in the ablation studies are relatively small, it is unclear whether these differences are statistically reliable.
-
W5. The use of the term "zero-shot forecasting" may be potentially misleading. Unlike the original TSFMs, MM-Time undergoes additional multimodal continued pretraining on time series paired with event descriptions.
-
W6. The downstream evaluation is limited to e-commerce and retail datasets.
Questions for authors
-
Q1. Could the authors clarify the sources of the continued-pretraining and evaluation datasets, how event descriptions were collected or generated, and how their availability at forecast time was verified?
-
Q2. Could the authors provide further evidence that the learned prototypes capture shared numerical effects rather than simply grouping semantically similar events?
-
Q3. Could the authors analyze the learned attention weights to show whether the model actually attends to relevant events at appropriate forecast steps?
-
Q4. Could the authors report standard deviations or confidence intervals across multiple runs, particularly for the ablation studies?
-
Q5. Could the authors clarify why the evaluation is described as zero-shot forecasting, given that MM-Time undergoes additional multimodal continued pretraining?
-
Q6. Could the authors extend the evaluation to additional domains beyond e-commerce and retail to better demonstrate the generalizability of MM-Time?
5 comments
Response to Reviewer uUB1(Part II)
W4, Q4. Statistical Reliability of Forecasting and Ablation Results.
A4: Since each ablation setting requires continued pretraining, repeating all settings across multiple random seeds would incur substantial computational costs. We therefore conducted three independent continued-pretraining runs with different random seeds for both the full MM-Time-C2 model and its w/o Interval RoPE variant on the Chronos-2 backbone. This variant performed closest to the full model in the original ablation experiments.
The table below reports the mean ± sample standard deviation of MASE across the three runs. The full model achieves lower mean MASE on both E-Commerce and Retail, with approximate relative reductions of 3.758% and 1.648%, respectively. These repeated-run results provide further support for the benefit of Interval RoPE. The Overall comparison is included in Section 4.2 of the revised paper, and the domain-level results are provided in the table below.
| Evaluation scope | MM-Time-C2: MASE ↓ | w/o Interval RoPE: MASE ↓ |
|---|---|---|
| E-Commerce | 0.717 ± 0.006 | 0.745 ± 0.004 |
| Retail | 0.716 ± 0.003 | 0.728 ± 0.002 |
| Overall | 0.716 ± 0.004 | 0.736 ± 0.002 |
W5, Q5. Clarifying Zero-Shot Forecasting after Multimodal Continued Pretraining.
A5: Thank you for pointing out this potential ambiguity. In this paper, zero-shot forecasting refers to how MM-Time is evaluated on target downstream datasets after multimodal continued pretraining.
MM-Time does undergo an additional multimodal continued pretraining stage using paired time series and event descriptions that are kept separate from the target evaluation data. After this stage, we freeze the model parameters and directly forecast on target datasets that were not used during continued pretraining, without further training or fine-tuning on those datasets. Historical observations of the target series and event information available at forecast time are used solely as inference inputs.
To clarify the distinction between the training procedure and the evaluation setting, we have described this setting as “zero-shot downstream forecasting after multimodal continued pretraining” in .
W6, Q6. Generalization Beyond E-Commerce and Retail.
A6: To broaden the domain coverage of our evaluation, we have added experiments on three public datasets (Fidel-TS_Germany, CGTSF_LEU, and CiK_Transport), extending the evaluation beyond e-commerce and retail to energy and transportation.
For these additional experiments, we incorporated other datasets or tasks from Fidel-TS and CiK into the continued-pretraining corpus while holding out the three target evaluation datasets. The target evaluation data were not used during continued pretraining. After training, the models were evaluated directly on these datasets without additional target-specific training or fine-tuning.
The table below reports MASE for the three MM-Time variants, their corresponding backbones, and other foundation models. All three variants outperform their respective backbones on all three datasets, with relative MASE reductions of 2.637%–4.260% for MM-Time-C2, 2.057%–30.993% for MM-Time-F2, and 2.718%–7.054% for MM-Time-T2. These results provide further evidence of MM-Time’s effectiveness in domains beyond e-commerce and retail. We have included these experiments in .
| Dataset | MM-Time-C2 | MM-Time-F2 | MM-Time-T2 | Chronos-2 | Falcon-2 | TiRex-2 | TimesFM2.5 | Moirai-2 | Timer-S1 |
|---|---|---|---|---|---|---|---|---|---|
| Fidel-TS_Germany | 0.781 | 0.851 | 0.743 | 0.810 | 0.895 | 0.787 | 0.837 | 0.905 | 0.819 |
| CGTSF_LEU | 0.679 | 0.784 | 0.702 | 0.709 | 1.136 | 0.721 | 0.727 | 0.725 | 0.721 |
| CiK_Transport | 0.532 | 0.595 | 0.584 | 0.546 | 0.608 | 0.628 | 0.669 | 0.596 | 0.699 |
Thank you for the detailed rebuttal and additional analyses. However, I still feel that the proposed framework remains somewhat of a black box, and I find it difficult to understand what the model actually learns and how the proposed components contribute to forecasting.
-
W2. For the Prototype Router, the examples suggest that events with similar residual patterns may share prototypes, but it remains unclear whether the prototypes systematically capture shared numerical effects rather than semantic similarities.
-
W3. The attention visualizations show that attention weights change across forecast steps and events. However, since the attention mechanism explicitly incorporates temporal information through Interval RoPE and Locality Bias, it remains unclear to what extent the observed attention patterns reflect learned temporal relationships.
Response to Reviewer uUB1(Part I)
We thank the reviewer for the constructive comments on data transparency, the proposed mechanisms, and the clarity and scope of our evaluation.
W1, Q1. Data Sources, Event Construction, and Availability at Forecast Time.
A1: Data sources and event construction. In the original experiments, both the continued-pretraining and evaluation datasets consist of real-world business time series from our company’s internal datasets, covering e-commerce and retail scenarios. The accompanying event information is collected from published announcements and public calendars, including promotional campaign announcements and holidays in the countries or regions associated with the time series. Event descriptions are compiled from these sources and anonymized to remove sensitive information.
Information availability at forecast time. We define the availability time of event information as its publication timestamp on the source website, distinguishing it from the time when the event actually occurs. For each forecast origin, we include only event information published before that origin. Accordingly, promotions or holidays announced in advance can be used as known information even when they occur within the forecast horizon. Information published after the forecast origin is excluded from the model inputs. We have added these descriptions of data sources, event construction, and information availability to Appendix A of the revised paper.
W2, Q2. Shared Numerical Effects versus Semantic Similarity in Prototype Routing.
A2: Thank you for this suggestion. In addition to the forecasting ablations, Appendix E.2 and Figures 6–8 of the revised paper provide a qualitative analysis of event-to-prototype routing. With the trained MM-Time-C2 parameters held fixed, we compare event descriptions, standardized observed time series, standardized residuals relative to the original Chronos-2 forecasts, and the full 32-dimensional prototype routing weight vectors.
For example, the season-end sale and Valentine’s Day gift promotion in Figure 6 have different campaign themes, yet exhibit a residual cosine similarity of 0.885 and a routing cosine similarity of 0.811, sharing three of their four selected prototypes. In Figure 7, tiered discounts and free shipping combined with coupons involve different promotional mechanisms but exhibit similar residual patterns, with a residual cosine similarity of 0.971. They also share three selected prototypes while retaining distinct routing weights and a different fourth prototype. Figure 8 further illustrates prototype reuse across different entities.
These examples provide qualitative support for the learned prototypes capturing shared numerical response patterns relevant to forecasting across events with different themes or promotional mechanisms.
W3, Q3. Temporal Alignment Between Events and Forecast Steps in Learned Attention.
A3: Thank you for the suggestion. We have added attention analyses in Appendix E.3, Figures 9–10. Figure 9 shows attention shifting from E08 and E10 toward E11 across rolling forecast rounds, while Figure 10 shows different attention weights for events with overlapping intervals. These observations provide qualitative evidence that event weighting varies across forecast positions and distinguishes among overlapping events, complementing the ablation results for Interval RoPE and Locality Bias.