- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an interaction-aware pre-training framework for spatiotemporal forecasting. AGPST first learns a data-adaptive graph from trainable node embeddings, applies graph aggregation to temporal patches, and then performs masked reconstruction with a Transformer encoder–decoder. The resulting representations are fused with downstream forecasting models through a lightweight integration module. Experiments on six traffic forecasting datasets, together with ablations and cross-architecture evaluations, suggest that AGPST can improve forecasting performance over several task-specific and pre-training baselines. The overall reasoning is sound. However, the paper tackles an overly ambitious problem and does not adequately address it. In fact, it is questionable whether the proposed approach meaningfully solves the stated problem.
Critical strengths
- The paper addresses a meaningful problem from a natural perspective. Explicitly incorporating cross-entity interactions into spatiotemporal pre-training is well motivated, and the combination of adaptive graph aggregation with masked temporal modeling is conceptually coherent.
- The method is relatively modular and easy to integrate with different downstream predictors. The paper provides extensive empirical comparisons, component ablations, sensitivity analyses, and cross-architecture experiments, which make the reported performance trends reasonably easy to examine.
Critical weaknesses
- The text and annotations in Fig 1 and 2 are quite small, which makes the architecture and masking procedure difficult to inspect. 2.The interaction matrix in Eq 3 is learned from global trainable node embeddings and is therefore essentially static for a given dataset. It does not depend on time, the current input, or the instantaneous system state. Thus, although the temporal features themselves vary over time, the interaction topology cannot represent cases in which the dependency between two entities is strong during one period and weak during another. This creates a mismatch between the paper’s motivation, which emphasizes time-varying spatial dependencies, and the proposed formulation, which mainly learns a global relational prior. 3.The claim that reconstructing graph-enhanced representations leads to reusable interaction-aware knowledge is not sufficiently justified. The pre-training loss reconstructs the latent representation Z, rather than the graph structure, interaction weights, or any explicitly defined relational quantity. Consequently, the model may learn a latent representation that is easy to reconstruct without necessarily learning transferable interaction knowledge. This concern is further complicated by the fact that Z itself is produced by the graph encoder, and the paper does not clearly specify whether the reconstruction target is detached. Finally, all experiments are conducted on traffic datasets, so the broader claims about general spatiotemporal forecasting are not fully supported.
Questions for authors
-
Since the adjacency matrix is determined by global node embeddings, how does AGPST model interactions that vary across time or depend on the current system state? Is the intended contribution a static relational prior rather than dynamic interaction modeling?
-
Why should masked reconstruction of Z be expected to learn reusable interaction knowledge rather than a representation that is simply convenient to reconstruct? Is the target representation detached, and how do the results change when reconstructing raw temporal patches or explicitly supervising the interaction structure?
-
To what extent do the reported results generalize beyond traffic forecasting? Since all datasets come from the traffic domain, what supports the broader claims about general spatiotemporal pre-training?