- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SDF-SP, a framework combining semantic-guided dual-order spatiotemporal modelling with retrieval-based forecast correction. The Dual-Order Spatiotemporal Encoder processes temporal-first and spatial-first branches in parallel, using contextual semantics to modulate temporal features and spatial propagation.A frozen pretrained GPT-2 backbone, followed by trainable prediction heads, produces the base forecast. The Retrieval-Augmented Simplicial Residual Projection module further corrects the forecast by combining retrieved historical responses through local simplicial projection at global and node levels. Experiments on six real-world datasets spanning tourism, transportation, and energy demonstrate strong forecasting performance, achieving the best results on 10 of 12 MAE/RMSE comparisons against 15 baselines.
Critical strengths
- The paper addresses meaningful spatiotemporal forecasting problems by incorporating contextual semantics into temporal and spatial modelling and using historical responses to refine predictions.
- The method achieves strong performance across six datasets and 15 baselines, with ablation studies evaluating its major components.
- The retrieval correction module can be applied to existing forecasters without retraining, and the paper provides relatively detailed mathematical formulations and implementation procedures.
Critical weaknesses
- The distinct contributions of dual-order modelling and semantic modulation could be better substantiated, given that related architectures and conditioning mechanisms have been explored in prior studies. The benefits of individual components are not sufficiently isolated. (Q1–Q2)
- The motivation for local simplicial projection could be strengthened. Although its mathematical formulation is provided, the specific advantage of simplicial constraints over simpler sparse interpolation remains insufficiently demonstrated. (Q3–Q4)
- The reliability of base-guided projection and adaptive fusion requires further validation, particularly when base forecasts are inaccurate. The sensitivity of retrieval correction and the performance degradation observed when applying it to some external forecasters also deserve further investigation. (Q5–Q6)
- The independent contribution of LLM-generated semantics could be more clearly demonstrated, and the consistency of contextual information available to different baselines requires clarification. (Q7)
Questions for authors
Q1. What distinguishes the proposed dual-order encoder from existing approaches? Previous studies have explored parallel TS/ST processing. Could the authors clarify the additional methodological contribution of the proposed semantic conditioning mechanism?
Q2. Can the contributions of different components be isolated? The two branches differ in computation order, semantic modulation, and graph normalisation. Why does ST-only underperform the variant without dual-order encoding in Table 2? Also, given node-specific contextual effects, why is sample-level rather than node-level gating used?
Q3. What is the advantage of simplicial projection over simpler sparse interpolation? Could the authors compare simplicial projection with cardinality-matched sparse convex projection without connectivity constraints, while keeping the global/node-wise projection and fusion settings unchanged?
Q4. How much does each simplicial component contribute? Could the authors compare vertex-only, vertex-plus-edge, and full simplicial projection, and report the frequency of each selected projection type?
Q5. What justifies the preference for smaller corrections to the base forecast? Could the authors clarify the motivation for this conservative fusion rule and compare it with simpler alternatives, such as uniform averaging, particularly when the base forecast is inaccurate?
Q6. How sensitive is retrieval correction to its heuristic parameters and historical-response coverage? Could the authors evaluate the sensitivity to retrieval size K = 6, neighbourhood size k = 3, and radius factor γ = 2, and explain why retrieval correction increases RMSE for 9 of the 15 baselines on SDWPF in Table 3?
Q7. What additional benefits do LLM-generated semantics provide? Could the authors compare LLM-generated embeddings with direct encoding of the same structured contextual variables and clarify whether the baselines receive equivalent external information?
8 comments
Response for W1 & Q2: Branch ablations and the choice of fusion gate
Thank you for asking about the performance of the ST-only variant and for suggesting a comparison between sample-level and node-level gating.
Historical updates in the ST-only variant
The w/o Dual-order variant passes the embedded history directly to the temporal and spatial compression layers. ST only adds an update to the history before compression. This update comes entirely from the ST path, which aggregates neighbours before extracting temporal features. The full encoder also has a TS path that extracts each node’s temporal features before spatial aggregation. Its gate assigns more weight to TS in every test window on Beijing Scenic and Beijing Metro. On SDWPF, the gate gives more weight to ST in a minority of windows.
On SDWPF, ST only raised base MAE in more windows than it lowered it relative to w/o Dual-order. The average increase also exceeded the average decrease, yielding a higher overall MAE. On Beijing Metro, ST only achieved lower base MAE, but w/o Dual-order benefited more from retrieval correction and achieved lower MAE after correction. A spatial-first update can therefore help in individual windows, yet relying on it alone to update every window can yield higher overall error than encoding the history directly. The full encoder achieves lower base MAE and RMSE than either single branch on all three datasets in Table 2. This supports using ST to provide neighbourhood information alongside the temporal features that TS extracts from each node’s own history.
Rationale for sharing fusion weights across nodes
SDF-SP receives one external context representation per forecasting window. Before fusion, TS uses the match between the context and each node to modulate that node’s temporal features at each historical time step. ST adjusts edge weights to control how much each neighbour contributes to the target node. Because both branches already capture node-specific responses to the same context, we use the window context to set one pair of TS/ST weights. Each node applies that pair to its own two branch representations. We have clarified the rationale for sharing these weights in the paragraph following Eq. (4) in Section 3.4 of the revised manuscript. To test whether the mixing weights should also vary across nodes, we trained a node-level variant that computes a separate pair of weights from the window context and each node’s semantic representation. We also added Table 15 in Appendix E.7 to report the eight-step forecast errors for both gates before retrieval correction. The sample-level gate yielded lower base MAE and RMSE on all three datasets.
Sample-level and node-level gates before retrieval correction (Appendix E.7, Table 15, MAE / RMSE)
| Dataset | Sample-level gate | Node-level gate |
|---|---|---|
| Beijing Scenic | 501.75 / 1065.58 | 522.78 / 1093.47 |
| Beijing Metro | 56.04 / 140.46 | 59.59 / 157.02 |
| SDWPF | 324.03 / 426.35 | 338.13 / 453.22 |
Response for W2 & Q3: Local connectivity at matched sparsity
We thank the reviewer for suggesting a test of whether local connectivity improves sparse interpolation. We added a sparse convex projection baseline without a connectivity constraint. Both methods use the same base forecasts, retrieved historical responses, global and node-level projection settings, and fusion rule. For each test window, we matched the number of active vertices separately for the global projection and for each node. Local simplicial projection requires the selected vertices to be pairwise connected. The sparse baseline can choose any subset of that size from the same retrieved responses.
With the vertex count matched, local simplicial projection achieved lower eight-step MAE and RMSE on all three datasets. These results suggest that restricting which historical responses can be interpolated together improves forecast accuracy beyond the benefit of sparsity alone. We describe the comparison in Section 4.3.3. Figure 5(a) shows the MAE reductions relative to the base forecast, and Appendix Table 13 reports the MAE and RMSE for each dataset.
Eight-step forecasts with the active vertex count matched (Appendix E.5, Table 13, MAE / RMSE)
| Dataset | Sparse convex projection | Local simplicial projection |
|---|---|---|
| Beijing Scenic | 378.88 / 918.98 | 370.03 / 901.63 |
| Beijing Metro | 43.19 / 138.08 | 40.97 / 128.79 |
| SDWPF | 310.40 / 429.73 | 297.67 / 407.59 |
Response for W1 & Q1: Order-specific semantic modulation in the dual-order encoder
Thank you for asking how SDF-SP differs from earlier dual-order encoders. SDF-SP extends the parallel dual-order structure by using the external context of each sample to modulate temporal features and spatial propagation within the two branches. In the temporal-first (TS) branch, the model scales each node’s temporal features according to how its description matches the context and where the observation falls in the historical window. It then propagates these features over the fixed graph. In the spatial-first (ST) branch, the model matches the same context to the nodes at both ends of each existing edge and adjusts its weight, changing how much each neighbour contributes during aggregation.
To examine how this modulation affects the base forecast, we added an eight-step comparison before retrieval correction in Section 4.3.2 and Appendix Table 10. All three variants retain the dual-order structure and the context-conditioned gate. On Beijing Scenic, Beijing Metro and SDWPF, concatenating the node and context embeddings at the input reduced both MAE and RMSE relative to the unmodulated variant. Using the same semantic information to modulate temporal features and edge weights within the branches reduced both errors further.
Semantic conditioning in eight-step base forecasts (Table 10, MAE / RMSE)