- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper introduces SLIM, a scalable Transformer for multivariate time series forecasting based on Context-Modulated Prototype Attention. The proposed method replaces quadratic cross-variable attention with a prototype-based latent interaction mechanism, where prototypes are constructed from historical observations and known covariates modulate only the retrieval process. This enables linear scaling with respect to the number of variables while preserving input-dependent cross-variate interactions.
Critical strengths
s1: The paper has a strong motivation. It addresses a critical scalability issue in multivariate time series forecasting by identifying the trade-off between expressive cross-variate modeling and computational efficiency.
s2: Experiments on various forecasting benchmarks show that SLIM achieves strong predictive performance with significantly improved computational and memory efficiency, especially in high-dimensional settings.
Critical weaknesses
w1: The paper is relatively difficult to read and provides limited intuitive insights into the proposed mechanism. More explanations and qualitative analyses are needed to clarify why the proposed design works.
w2: The experiments mainly show that SLIM achieves better performance than existing methods, but provide insufficient understanding of the underlying factors contributing to its effectiveness.
w3: Despite the emphasis on scalability, the evaluation does not sufficiently cover truly large-scale datasets. More experiments with real-world datasets containing much larger numbers of variables are needed.
w4: The paper lacks a discussion of the limitations of SLIM, including potential failure cases, sensitivity to prototype selection, and trade-offs between scalability and representation capacity.
Questions for authors
Please refer to the weaknesses.