- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
This paper proposes CoReG, a retrieval-augmented framework for multivariate time-series forecasting. TimeGeo retrieves histories with similar multiscale temporal shapes, while RoleGeo uses representations informed by stable cross-variable relations. Each path retrieves target-owned training futures and combines them with a frozen forecasting backbone. The two views are then averaged. Experiments cover ten datasets and six backbones.
Critical strengths
CoReG frames retrieval augmentation around complementary predictive similarities, separating multiscale temporal-shape matches from relation-informed system-role matches, and implements them as two plug-in paths around a frozen forecaster. The evaluation spans ten datasets and six backbones, reports horizon-averaged MSE improvements in 58 of 60 dataset–backbone settings, and includes ablations, data-sparsity, multi-seed, and accuracy–latency analyses.
Critical weaknesses
- Innovation: The necessity of independent retrieval geometries is not established. The paper argues that a single space mixes evidence, but does not compare against a capacity-matched joint-space retriever. TimeGeo Only, RoleGeo Only, and Shared Readout do not provide this comparison, so the claim that separate spaces are necessary remains unsupported.
- Experiments: Table 2 lacks time-series forecasting backbones proposed in 2026.
- Presentation: The method and training procedure are difficult to follow. The architecture and training stages are scattered across sections, while key encoder details, including the contrastive objective and positive-pair selection, are deferred to Appendix B. A concise training flow in the main text would improve clarity and reproducibility.
Questions for authors
Could you compare CoReG with a capacity-matched single retriever that jointly embeds temporal shape and system-role information, and include a 2026 forecasting backbone in Table 2?
3 comments
Thank you for the detailed response and revisions. I will increase my Rating from 2 to 3.
-
Independent retrieval geometries. The added capacity-matched joint retrieval baselines (Joint-CM, Joint-CM-Large, Concat) address my concern. With parameters, memory, and Top-K aligned, FULL consistently performs better, supporting the effectiveness of independent retrieval geometries.
-
2026 backbone. Adding DTAF (Lu et al., AAAI 2026) as the seventh backbone, with the ten datasets and four horizons unchanged, meets my original request. Table 2 and the abstract have been updated accordingly.
-
Structure and readability. Section 3.6 and Algorithm 1 in the main text, together with the key encoder details moved from the appendix, make the paper easier to follow and reproduce.
-
Reference formatting. The reference citations would benefit from careful checking and unification: (1) URL consistency: some references with stable links lack URLs, e.g., Fei et al., Amplifier: Bringing attention to neglected low-energy components in time series forecasting (AAAI 2025) and Lai et al., Modeling long- and short-term temporal patterns with deep neural networks (SIGIR 2018). Please unify the citation format. (2) Mixed ordinal styles: "The Fourteenth International Conference on Learning Representations" and "The 41st International ACM SIGIR Conference…" coexist. Please adopt a single style. (3) Missing venues: some references omit the publication venue, e.g., Stationarity-aware retrieval-augmented time series forecasting was published at KDD 2026. Please add the missing venues.
Response to Reviewer Kyqs
Thank you very much for increasing your rating and for recognizing the effectiveness of the capacity-matched retrieval comparison, the addition of DTAF, and the clearer training presentation. We also especially appreciate your careful checking of the reference formatting.
1. URL consistency
We added stable publisher or proceedings URLs for published papers that previously listed only DOIs, including Amplifier: Bringing Attention to Neglected Low-Energy Components in Time Series Forecasting and Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks. We applied the same rule to the other published entries with available stable links.
2. Conference-name formatting
We unified ordinal conference names using numeric forms. For example, the revised bibliography consistently uses “The 11th,” “The 12th,” and “The 14th International Conference on Learning Representations,” together with “The 41st International ACM SIGIR Conference” and “The 42nd International Conference on Machine Learning.”
3. Missing venues and record types
We updated Stationarity-Aware Retrieval-Augmented Time Series Forecasting with its formal KDD 2026 publication entry, including the conference venue, page range, DOI, and publication link. We also removed the volume-number conflict in the RAST entry and updated the relevant proceedings links.
The revised bibliography now uses consistent record types, venue information, DOI and URL fields, and conference-name formatting. The manuscript compiles successfully with zero BibTeX warnings.
Revision location: References.
Response to Reviewer Kyqs
Thank you for identifying these gaps. We have added the requested capacity-matched joint retrieval comparison on seven datasets, DTAF (2026) on all ten datasets, and a concise main-text training algorithm with explicit encoder supervision and positive selection. All revisions are highlighted in blue in the revised manuscript. Revisions to figures and tables are indicated by blue captions.
1. Capacity-matched joint retrieval
Joint-CM uses one encoder to jointly learn temporal shape and system role through equally weighted shape-predictive and role-predictive contrastive losses. It selects neighbors once in a shared 64-dimensional space and forms one retrieval forecast for fusion with the frozen DLinear Anchor. Joint-CM-Large increases memory from 1,000 to 2,000 and Top-K from 50 to 200, matching FULL's total memory-entry budget and nominal Top-K selection count. Both variants match FULL's added-module parameter count within 0.04% at each horizon, excluding the shared Anchor. The comparison uses historical paired FULL results and the corresponding frozen Anchor checkpoints for the new variants. Table R2 reports four-horizon mean errors across all seven datasets.
Table R2. Capacity-matched joint retrieval comparison. Each cell gives four-horizon mean MSE / MAE. Values are displayed to four decimals.
FULL has lower mean MSE on six of seven datasets and lower MAE on all seven compared with Joint-CM. Compared with Joint-CM-Large, FULL has lower mean errors for both metrics on all seven datasets, as determined from unrounded results. Joint-CM achieves lower MSE on PEMS08. These results support the predictive benefit of independent retrieval under the tested capacity-matched conditions, including the enlarged single-retriever budget.
Revision locations: Section 4.3 and Table 3 (p. 8, lines 404-431). Appendix E.2 (p. 53, lines 2808-2827, Table E.4, and p. 54, lines 2863-2882, Table E.5).
2. DTAF (2026) in Table 2
We have added DTAF [1] to Table 2, extending the evaluation to seven forecasting backbones. The added experiments cover all ten datasets at horizons 96, 192, 336, and 720. Table R3 reports the relative reduction in each dataset's four-horizon mean error from the paired DTAF baseline.
Table R3. Relative error reductions after adding CoReG to DTAF (2026). Positive values indicate improvement.
CoReG improves both dataset-mean metrics on all ten datasets, with mean relative reductions of 8.79% in MSE and 7.75% in MAE.
Revision locations: Section 4.1 (p. 7, lines 360-362), Section 4.2 (p. 7, lines 375-377), and Table 2 (p. 8, lines 379-401). Appendix E.1, Table E.1 (p. 49, lines 2602-2639) and Table E.2 (p. 50, lines 2655-2691).
3. Training flow in the main text
Algorithm 1 now presents the complete training sequence in one place. It trains and freezes the Anchor, trains and freezes the predictive encoders, constructs the per-variable memories, and then optimizes the fusion modules using the final forecasting loss. The Anchor, encoders, and memories remain fixed during fusion training. The main text now specifies the supervision signature, positive selection, valid negatives, exact contrastive objective, shared encoder architecture, normalization, and retrieval protocol. Together, these additions make the training procedure and its required definitions directly accessible in the main text.
Revision locations: Section 3.6 (p. 7, lines 324-346, Algorithm 1 and Eq. 22), Section 3.4 (p. 6, lines 288-304, Eqs. 16-18), and Section 3.2 (pp. 4-5, lines 199-227, Eqs. 2-5).
References
[1] Junkai Lu, Peng Chen, Chenjuan Guo, Yang Shu, Meng Wang, and Bin Yang. Towards Non-Stationary Time Series Forecasting with Temporal Stabilization and Frequency Differencing. Proceedings of the AAAI Conference on Artificial Intelligence, 40(29), 24070-24078, 2026. Publisher