- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the problem that existing spatio-temporal forecasting methods primarily focus on the internal dynamics of a single system while overlooking the influence of multi-system exogenous variables. The authors identify two main challenges in multi-system exogenous variable modeling: the inconsistent effects of different exogenous variables on the prediction target and the imbalance between historical and future exogenous information. To address these challenges, the paper proposes ExoST, a general spatio-temporal forecasting framework following the "Select-then-Balance" paradigm. It employs a gated expert selector to adaptively extract informative exogenous information and utilizes dual-branch spatio-temporal encoders and a context-aware balancer to dynamically fuse historical and future information. Experiments on four datasets from the air quality and traffic forecasting domains demonstrate the effectiveness and generality of the proposed method. Overall, this paper presents a relatively simple solution for multi-system exogenous variable modeling and validates the performance advantages of the proposed framework through relatively comprehensive experiments.
Critical strengths
S1: This paper addresses the long-overlooked problem of multi-system exogenous variable modeling in spatio-temporal forecasting, overcoming the limitations of traditional methods that primarily focus on the internal dynamics of a single system. Furthermore, the paper identifies two key challenges: the inconsistent effects of different exogenous variables and the imbalance between historical and future information, providing a research direction with practical value for spatio-temporal forecasting.
S2: The proposed framework demonstrates good generality and compatibility. ExoST can be integrated with different spatio-temporal forecasting models without modifying the internal architecture of existing backbones. The authors validate the framework on various backbones, including AGCRN, GWNet, STGCN, and DCRNN, demonstrating its potential as a general framework for exogenous variable modeling.
Critical weaknesses
W1: Although the paper uses four datasets, these datasets are primarily derived from air quality and traffic monitoring data collected in Madrid in 2019 and 2022, sharing similar data structures and types of exogenous variables. Therefore, the current experiments are insufficient to demonstrate whether the proposed method can generalize to other geographical regions, different types of dynamic systems, or forecasting tasks involving more complex exogenous relationships.
W2: According to the experimental setup, meteorological variables are primarily used as future covariates, while traffic variables are mainly treated as historical covariates. This setting couples the differences in exogenous system sources with the temporal differences between historical and future information. The paper lacks controlled experiments to disentangle these two factors, making it difficult to determine whether the performance improvements arise from multi-system interaction modeling or effective fusion of different types of temporal information.
W3: The paper claims that the Selector can adaptively identify important exogenous variables. However, its implementation mainly performs expert weighting in the fused latent feature space without explicitly modeling or providing the importance of individual exogenous variables. The existing visualizations primarily illustrate the distributions of expert gating weights, which are insufficient to demonstrate that the model can accurately distinguish informative variables from irrelevant ones. Therefore, sufficient experimental evidence is still lacking to establish a clear connection between the core design motivation and the actual mechanism of the proposed module.
Questions for authors
Q1: In general, endogenous and exogenous variables from different systems often have different sampling frequencies and collection times, meaning that their timestamps may not be strictly aligned. Furthermore, the timestamps of future exogenous variables may not exactly match those of the target prediction horizon. I have a question: How does ExoST handle such differences when endogenous and exogenous variables have misaligned timestamps or different sampling frequencies, or can these variables be used directly? For future exogenous variables, can they be considered valid prediction inputs as long as their timestamps fall within the target prediction horizon, or must they satisfy specific temporal alignment and availability constraints at the time of prediction?
3 comments
The authors' responses have addressed most of my concerns satisfactorily. I have also reviewed the responses to the other reviewers and found that the authors have made substantial efforts to improve and clarify the manuscript. Therefore, I am satisfied with the revisions and will maintain my positive rating.
Thank you for your attention; we greatly appreciate it.
Rebuttal by Authors
Dear Reviewer Epid,
We sincerely thank you for your time and effort in providing insightful feedback on our paper. We have carefully considered each of your comments to address your concerns (
We wrote this rebuttal entirely by ourselves, word by word, without using any AI assistance. We hope that this can reciprocate your effort in taking the time to review it. Thank you!). Specifically:W1: Generalization beyond the Madrid benchmarks.W2: Is the benefit from multiple systems or from temporal fusion?W3: Why can a latent expert module address variable relevance w/o outputting raw-variable importance scores?Q1: Sampling-frequency differencesThank you for your valuable feedback, which has helped us strengthen our manuscript! We hope the above responses address your concerns, reinforce your appreciation and confidence in our work, and we look forward to further discussion.
Best regards,
Authors