- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper propose STCFormer, an adaptive spatial-temporal Transformer for station-based weather forecasting. The Cluster-Guided Attention Block (CGAB) first performs hard-routed local attention within clusters, then aggregates the updated state features into regional content centers. Global station-to-region attention allows each station to access summaries from all regions, combining selective local interactions with global context. Experiments on three real-world weather datasets support the proposed design.
Critical strengths
- The paper is clearly written.
- The paper demonstrates the effectiveness of the proposed method through both theoretical analysis and empirical experiments.
Critical weaknesses
- The motivation and technical innovations of the proposed method are not inherently tied to the weather forecasting application. Clustering related stations is a general approach that can be applied to any multivariate forecasting task. However, clustering-based techniques for improving multivariate time series forecasting have already been extensively studied (e.g., Channel Clustering and DUET), and the paper does not present any application-specific innovations that distinguish its approach in the context of weather forecasting.
- Given the recent advances in weather forecasting models pretrained at scale on reanalysis data, I have a fundamental concern about the practical value of forecasting models that still require end-to-end training for specific weather stations. For example, in the GlobalTemp dataset, it is difficult for a model to effectively learn complex global spatial dependencies from 3,850 sparsely distributed stations.
Minor issues
- \citep should be used instead of \cite to ensure proper citation formatting.
- In Section 2.3.1, the paragraph of “M-Step” should be moved to a new line.
Questions for authors
Existing station-based weather forecasting models typically rely on end-to-end training for specific stations, which significantly limits their practical applicability. Can the proposed method support zero-shot inference on unseen stations that are similar to those within a cluster?
4 comments
Respond to W2/Q: What is the practical value of station-based forecasting, and can STCFormer perform zero-shot inference on unseen stations?
We thank the reviewer for the suggestion. We fully acknowledge the success of recent large-scale pretrained weather forecasting models. At present, these models primarily focus on gridded forecasting, while pretrained models available for station-based forecasting are often general-purpose time series foundation models. Many of these models adopt channel-independent modeling, making it difficult to fully use the spatial interactions that are essential for station-based forecasting and thereby limiting their applicability in this setting. The experiments in Appendix I also demonstrate the forecasting advantages of our method over the compared time series foundation models.
We also thank the reviewer for the insight regarding generalization to new stations. Our method is structurally well suited to zero-shot inference. On the one hand, learnable prototypes acquire spatial association patterns among stations from the training data, providing a reference for grouping and information exchange at new stations. This is absent from methods such as DUET. On the other hand, the model architecture and dynamic clustering mechanism do not depend on a fixed number of stations and can flexibly include new stations that were not involved in training in the clustering process. The table below presents zero-shot inference results for forecasting the next 72 hours on the France dataset. Specifically, we randomly select 210 stations for training and validation and evaluate on the remaining 24 stations. We compare our method with the time series foundation model Timer and DLinear trained specifically on these 24 stations. The results show that our method continues to achieve a consistent lead, supporting its zero-shot generalization ability on unseen stations. We will supplement the revised manuscript with the complete relevant experiments and discussion.
| Model | Temp. | U-Wind | V-Wind |
|---|---|---|---|
| Timer | 7.415 ± 0.012 | 4.932 ± 0.007 | 5.813 ± 0.020 |
| Dlinear | 6.928 ± 0.007 | 4.675 ± 0.012 | 4.727 ± 0.003 |
| STCFormer (Zero-Shot) | 6.315 ± 0.026 | 4.385 ± 0.036 | 4.659 ± 0.138 |
Respond to Minor issues
We thank the reviewer for the suggestions. We have addressed the citation and paragraph formatting issues raised by the reviewer in the paper.
Thanks you for your response. My main concerns remain unresolved:
- The paper does not present enough innovations that are strongly tailored to the meteorological domain.
- Second, the authors fail to address the practical significance of station-level forecasting comparing to reanalysis-based models. Moreover, even when comparing against time series foundation models, the evaluation does not include state-of-the-art models such as Chronos-2 and TimesFM-3.
Therefore, I decided to keep my original score.
Respond to W1: What weather-specific contributions and insights distinguish STCFormer from existing channel-clustering methods such as DUET?
We thank the reviewer for the suggestion. Channel clustering techniques, such as DUET, have been extensively studied in multivariate time series forecasting. We would like to clarify that we do not simply transfer these techniques to weather forecasting. Compared with these methods, we offer the following additional contributions and insights tailored to the characteristics of station-based weather forecasting.
1) Patch-level clustering for the dynamic evolution of weather systems. The propagation and evolution of weather systems cause station relationships to change within the observation window. Window-level shared clustering in methods such as DUET can easily obscure these local changes. We therefore propose a dynamic clustering mechanism that updates at each temporal patch, allowing the interaction scope to adapt to the local evolution features of stations.
2) Representation design incorporating station geography and evolution features. Considering the local correlations among geographically neighboring stations, we are the first to construct patches along the spatial dimension to preserve local spatial context. Meanwhile, the dual state-evolution views provide temporal context for prediction and the basis for dynamic grouping, respectively, allowing clustering to respond to local changes in weather processes.
3) Zero-shot inference on new stations. As discussed in the response to W2 below, newly established stations and stations with limited training data have practical forecasting needs. Our method supports zero-shot inference on new stations that were not involved in training, extending its applicability to changing station networks. This cannot be achieved by centroid-free methods such as DUET.
4) Theoretical justification for clustering-constrained attention. For selective interactions among stations, we prove for the first time that the derived Lipschitz upper bound of intra-cluster local attention under a given partition is no larger than the corresponding upper bound of fully connected attention, establishing its theoretical superiority.
Taken together, these contributions and insights distinguish our method from related channel-clustering work in the weather forecasting setting.