- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces VaryST, a compact spatio-temporal forecasting framework designed to generalize beyond the traditional closed-world assumption. Instead of relying on static node embeddings and predefined adjacency graphs, VaryST constructs predictive contexts dynamically from available long-term observations. It extracts dynamic node representations from historical patches and retrieves functional support nodes dynamically via RBF similarity. The framework then employs Target-Centric Hierarchical Contextual Decoding, which integrates global context, recent/long-term target states, and retrieved support tokens using hop-aware relative structural encoding. Additionally, the authors propose Importance-Guided Observation Perturbation (IGOP), an attention-guided masking strategy during training to improve robustness against missing data. Extensive experiments across six real-world datasets and 17 baselines demonstrate VaryST's strong performance in in-domain, cross-domain, and missing-observation scenarios.
Critical strengths
-
Tackling the open-world spatio-temporal forecasting problem, simultaneously addressing temporal shifts, spatial domain changes, and varying observation availability, is highly relevant and practically significant for real-world deployments.
-
Replacing static node embeddings and fixed graph adjacency matrices with long-term observation-derived representations and dynamic functional support retrieval is a very clever and effective design for spatial and temporal generalization.
-
The Importance-Guided Observation Perturbation (IGOP) is an intuitive and novel approach. By dynamically masking patches that the model relies on most, it forces the network to learn robust alternative evidence paths rather than overfitting to dominant signals.
-
The empirical evaluation is highly thorough, covering 6 datasets and comparing against 17 baselines across diverse settings. The zero-shot temporal shift evaluation (PEMSD3-Stream) and cross-network spatial transfer tasks provide highly convincing evidence of the model's capabilities.
Critical weaknesses
-
For missing data, the model explicitly applies linear interpolation before computing representations and temporal differences. This could introduce severe artifacts or noise if the missing gaps are large, contiguous blocks, potentially degrading the derived dynamic representations.
-
The model uses shortest-path hop distances for hop-aware relative structural encoding. However, the paper evaluates on PM2.5, which is explicitly described as having "no explicit graph". It is unclear how this structural encoding is handled when no topological graph is available, or when migrating to a graph with radically different topological characteristics.
-
While compared against 17 baselines, the paper omits recent strong generative ST models (e.g., diffusion models or advanced state-space models) which are naturally suited for handling missing data imputation and distribution shifts.
-
The IGOP module relies on selecting patches to mask. The paper lacks a deep sensitivity analysis on . Masking too much might collapse training, while masking too little would fail to improve robustness.
Questions for authors
-
Please explain explicitly how the shortest-path hop distance and Laplacian positional embeddings are handled for datasets without explicit graph topologies (such as PM2.5). Does the model rely on a fully connected assumption, distance heuristics, or are these features simply disabled?
-
Please provide an ablation or discussion on the choice of (the number of masked patches in IGOP). How does varying impact the standard forecasting performance versus the missing-data forecasting performance?
-
Given that VaryST employs linear interpolation on masked sequences before computing differences (X = Interp(X, M)), how does this perform under extensive contiguous block missing (CM) scenarios?
Thank you for recognizing the practical significance, methodological design, and thorough evaluation, and for your questions about experimental details, which helped us refine our experiments.
W1 / Q3. Contiguous missingness and interpolation.
Thank you for raising this concern. Table 10 in the appendix reports the complete CM results across missing rates of 10%–70%. CM is indeed more challenging than RM: at 70% missingness, VaryST’s MAE increases from 17.70 to 22.41 on PEMS04 and from 13.30 to 17.16 on PEMS08. Nevertheless, VaryST still achieves the lowest MAE, RMSE, and MAPE across all tested CM rates on both datasets. These results show that, although contiguous gaps degrade prediction accuracy, VaryST maintains its comparative advantage with the current interpolation-based preprocessing.
W2 / Q1. Structural encoding on PM2.5.
Thank you for pointing out this missing clarification. Our work primarily focuses on spatio-temporal graph forecasting, where a graph structure is available. To evaluate generalization beyond traffic, we also include the PM2.5 dataset, which provides no explicit graph. We therefore construct a 5-nearest-neighbor (5-NN) graph using Pearson correlations between station observations and compute the Laplacian positional embeddings and shortest-path hop distances on this graph. These preprocessing details have been added to Appendix B.1 (Dataset Statistics).
For cross-graph transfer, since VaryST operates inductively, we only need to recompute the Laplacian eigenvectors and shortest-path hop-distance matrix on the target graph while keeping all model parameters unchanged.
W3. Generative and state-space baselines.
Following your suggestion, we have included KITE (ICML 2026), a flow-matching-based generative forecaster, and DST-Mamba (AAAI 2025), a state-space forecaster as baselines. Compared to them, VaryST still achieves the lowest MAE, RMSE, and MAPE on all four PEMS datasets, as summarized below. The full results are reported in Table 2 of the revised manuscript (format: MAE / RMSE / MAPE).
W4 / Q2. Sensitivity to Km
Thank you for raising this question. We evaluate Km∈{1,2,3,4,6,8,16} on PEMS08, trained at RM 70% and tested without retraining. As shown below, performance under the same missing rate (RM 70%) is insensitive to (K_m), with MAE ranging from 13.24 to 13.32. Under a different missing rate (RM 10%), increasing (K_m) from 1 to 6 reduces MAE from 16.02 to 14.61, while (K_m) values from 3 to 16 yield relatively stable performance. These results suggest that a sufficiently large (K_m) helps IGOP reduce over-reliance on dominant historical patches and improves generalization across missing rates. We have added these results to Table 16 in Appendix C.5 of the revised manuscript.