- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a retrieval-augmented framework for time-series foundation models, combining latent cross-attention and output-space Wasserstein barycenters for efficient retrieval integration. It further introduces supervised covariate alignment and multimodal text grounding, alongside a theoretical analysis of memory scaling. Experiments across multiple foundation model backbones demonstrate improvements in forecasting accuracy and computational efficiency.
Critical strengths
-
The paper addresses a practically important problem by investigating how external retrieval can improve frozen time-series foundation models without substantially increasing inference costs.
-
Exploring different retrieval injection strategies is an interesting direction. In particular, latent cross-attention and output-space Wasserstein barycenters provide alternatives to computationally expensive context concatenation, while covariate alignment and text grounding enable the incorporation of additional information.
-
The experimental results demonstrate promising forecasting performance across multiple benchmarks and foundation model backbones, with improvements over existing approaches.
Critical weaknesses
-
The limitations under unseen distribution shifts are not sufficiently discussed. While retrieval from external memory can improve forecasting, its effectiveness may be limited when relevant historical examples are unavailable or historical patterns no longer hold. A discussion of these limitations would better clarify the applicability of the proposed framework in real-world forecasting scenarios.
-
The theoretical assumptions underlying Proposition 2 are not fully consistent with the empirical dimension estimates. Proposition 2 assumes , whereas the reported PCA rank (r=43) exceeds the estimated intrinsic dimension (). This also reverses the stated relationship between their corresponding convergence exponents. The authors should clarify how the theoretical assumptions relate to the empirical estimates.
-
The choice of key hyperparameters is not sufficiently justified. The paper sets the alignment loss weight to 1.0 and the text retrieval weight to 0.5 without explaining the rationale behind these choices. A brief justification would improve the methodological clarity.
Questions for authors
-
The limitations under unseen distribution shifts are not sufficiently discussed. While retrieval from external memory can improve forecasting, its effectiveness may be limited when relevant historical examples are unavailable or historical patterns no longer hold. A discussion of these limitations would better clarify the applicability of the proposed framework in real-world forecasting scenarios.
-
The theoretical assumptions underlying Proposition 2 are not fully consistent with the empirical dimension estimates. Proposition 2 assumes , whereas the reported PCA rank (r=43) exceeds the estimated intrinsic dimension (). This also reverses the stated relationship between their corresponding convergence exponents. The authors should clarify how the theoretical assumptions relate to the empirical estimates.
-
The choice of key hyperparameters is not sufficiently justified. The paper sets the alignment loss weight to 1.0 and the text retrieval weight to 0.5 without explaining the rationale behind these choices. A brief justification would improve the methodological clarity.