- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses time series forecasting with exogenous variables (TSF-X) when the exogenous information consists of sparse, abrupt events (weather, holidays, large-scale events) whose effects differ across temporal scales. MeraTSF decomposes the endogenous input with three moving-average kernels into trend and residual components, each patch-encoded separately. Historical and known-future exogenous variables are injected only into the residual tokens through a gated MLP correction, and scale-specific forecasts are fused with instance-dependent softmax weights. Experiments cover a large ride-hailing dataset with three event scenarios and 12 smaller TSF-X benchmarks, plus ablations, plug-in experiments with four backbones , zero-shot transfer, robustness studies and a setting without future exogenous variables.
Critical strengths
- The problem is practically important and the empirical study is broad. The paper uses a large real-world ride-hailing dataset (14M observations, 200 areas) with scenario-level breakdowns (Table 1) and covers deployment-relevant settings: zero-shot areas (Table 8), sparsified events (Table 9), missing endogenous values (Table 10) and inference cost (Fig. 5). It also honestly reports a negative result when future exogenous variables are unavailable (Table 11).
- The observation that exogenous conditioning helps more on the decomposition residual than on the trend is useful. In Table 4, the full model (WMAPE 0.1027) improves over both "w/o exo" (0.1102) and "on Trend" (0.1051).
Critical weaknesses
The mechanism is not specific to the stated problem, and the evidence that the gain comes from the key idea is limited. The method contains no sparsity-specific component, and the gated MLP (Eq. 7-8) is itself a learned endogenous-exogenous interaction; near-zero Pearson correlations for binary sparse indicators (Fig. 7-8) do not show that attention- or graph-based models fail. In Table 4, "on Trend" (0.1051) already recovers most of the gain, while "w/o future exo" (0.1122) is worse than no exogenous input at all, and MeraTSF loses to DAG on most datasets without future exogenous variables (Table 11).
Questions for authors
- Why does a method without any sparsity-specific component help specifically with sparse exogenous events? Please add a control that injects exogenous variables by simple concatenation into the undecomposed representation. 2.Report seed means ± std for results.
13 comments
Rebuttal Part 2
W2: near-zero Pearson correlations for binary sparse indicators (Fig. 7-8) do not show that attention- or graph-based models fail.
We thank the reviewer for this valuable observation and fully agree with the concern. We apologize for not sufficiently clarifying the relationship between sparse exogenous events and dependency modeling in the original manuscript. We would like to emphasize that weak Pearson correlations do not imply that dependency-based methods are incapable of learning linear or nonlinear relationships. Rather, sparse events may make it more challenging to learn stable dependency structures from the overall data distribution. We clarify this distinction using two representative methods, DAG and GCGNet.
Dependency Modeling under Sparse Events. DAG focuses on discovering and incorporating temporal and inter-channel dependencies, whereas GCGNet emphasizes maintaining graph structural consistency between predictions and ground-truth observations.
The relatively weaker performance of DAG and GCGNet under sparse-event scenarios does not necessarily indicate an inability to learn correlations. Instead, their dependency modeling objectives may be affected by the highly imbalanced distribution of sparse events, making it more challenging to capture stable dependency patterns or maintain graph structural consistency for rare event conditions.
Distinction from MeraTSF. In contrast, MeraTSF does not require explicitly establishing stable cross-variable dependency structures. Instead, it directly incorporates exogenous variables as conditioning signals to adaptively refine residual representations at different temporal scales.
Consequently, even when exogenous events occur infrequently, their information can still influence predictions through conditional feature interactions, without requiring strong global correlations between endogenous and exogenous variables.
In summary, our argument is not that dependency-based methods cannot model sparse events or nonlinear relationships, but that sparse event distributions may pose additional challenges for learning stable dependency structures. MeraTSF provides an alternative approach by directly conditioning multi-scale residual representations on exogenous information, rather than relying on explicitly constructed cross-variable dependencies.
Rebuttal Part 3
W3: In Table 4, "on Trend" (0.1051) already recovers most of the gain.
We thank the reviewer for the valuable comments on the choice of residual refinement over trend refinement. We would like to clarify that exogenous events may affect not only the overall level of a time series but also its fine-grained temporal dynamics, which motivates our choice of exogenous-conditioned residual refinement. Our detailed explanation is as follows.
Motivation for Residual Refinement. Incorporating exogenous information only into coarse-grained temporal patterns can capture global changes induced by external events, such as shifts in mean demand or overall demand levels. However, exogenous events may also alter fine-grained intraday patterns.
For example, a large-scale concert may cause a concentrated surge in ride-hailing demand around the venue after the event ends, changing the magnitude and distribution of intraday demand peaks rather than simply increasing the average demand throughout the day.
Such localized variations may be smoothed out in coarse-grained temporal components but can be better preserved in residual representations. Therefore, MeraTSF incorporates exogenous information into the residual branch to conditionally refine fine-grained temporal variations across multiple scales, enabling the model to better capture complex temporal dynamics associated with exogenous events.
In summary, our choice of residual refinement is motivated by the need to capture localized, event-related temporal variations that may not be adequately represented by coarse-grained trend modeling alone.
W4: while "w/o future exo" (0.1122) is worse than no exogenous input at all, and MeraTSF loses to DAG on most datasets without future exogenous variables (Table 11).
We thank the reviewer for the valuable comments on the performance differences between MeraTSF and DAG under different exogenous information settings. We would like to clarify that MeraTSF is designed to leverage future exogenous information for conditional forecasting, whereas DAG focuses more on modeling dependencies among variables. This distinction explains both the advantages and limitations of MeraTSF. Our detailed response is as follows.
Performance without Future Exogenous Variables. In non-sparse scenarios, MeraTSF does not explicitly establish stable dependency structures between endogenous and exogenous variables. Consequently, when future exogenous information is unavailable, its forecasting performance can be inferior to DAG, which emphasizes dependency modeling. We have already acknowledged this limitation in the revised manuscript.
Performance with Future Exogenous Variables. When future exogenous information is available, MeraTSF outperforms DAG by leveraging the additional contextual information to adaptively refine its predictions. This allows the model to better account for changes in external conditions that may not be fully captured by historical temporal dependencies alone.
The importance of future exogenous information is particularly evident in sparse-event scenarios. For example, if a large-scale event is scheduled to take place in a particular area, this information can help the model anticipate a potential surge in ride-hailing demand around the event. Without such information, the demand surge may be difficult to predict from historical observations alone.
In summary, MeraTSF is designed to exploit future exogenous information rather than relying primarily on explicitly learned dependency structures. While this may limit its performance when future exogenous variables are unavailable, it enables more accurate conditional forecasting when such information is provided, particularly under sparse exogenous events.
Rebuttal Part 1
We thank the reviewer for the valuable comments on the modeling of sparse exogenous events and the interaction between endogenous and exogenous variables. We apologize for not sufficiently clarifying these design choices in the original manuscript. We would like to clarify that MeraTSF employs learnable categorical embeddings to represent sparse discrete events, while its gated MLP performs exogenous-conditioned feature interactions without explicitly constructing correlation structures between endogenous and exogenous variables. Our detailed response is as follows.
Modeling of Sparse Discrete Exogenous Events. MeraTSF employs learnable embedding matrices based on discrete variable values, allowing the same event category to share a learnable feature representation across different temporal positions. This avoids treating discrete event categories as continuous numerical values and enables the model to learn reusable category representations from limited event observations.
Importantly, learnable embeddings are not the only way to encode sparse discrete events. We also consider One-hot encoding, which represents each event category using a distinct one-hot vector without introducing additional learnable encoding parameters.
To ensure fair comparisons, we evaluated exogenous-aware baselines, including DAG and CrossLinear, using both embedding and one-hot encoding strategies. For each encoding strategy, we further evaluated five different learning rates and selected the configuration with the best validation performance for reporting test results.
Endogenous–Exogenous Feature Interaction. We agree that the gated MLP in Eqs. (7)–(8) is inherently a learnable interaction mechanism between endogenous and exogenous features. However, we would like to clarify that MeraTSF does not aim to eliminate interactions between endogenous and exogenous variables, but rather to avoid explicitly constructing correlation structures between them.
Unlike methods that characterize endogenous–exogenous relationships through correlation matrices or dedicated dependency modeling modules, MeraTSF incorporates exogenous information as conditional signals to adaptively interact with multi-scale residual representations. Therefore, the key distinction is not whether feature interactions exist, but the representation space in which they occur and how they are modeled.
In summary, MeraTSF handles sparse discrete events through shared categorical representations and incorporates exogenous information through conditional interactions with multi-scale residual features. These design choices distinguish its modeling approach from methods that rely on explicitly constructed dependency structures, while maintaining fair comparisons through alternative encoding strategies and systematic hyperparameter selection.