- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CoLaDe, a framework for multivariate time-series forecasting that builds on an existing encoder-decoder architecture and generalized formulation [1] to improve information compression and historical information retrieval. Specifically, CoLaDe improves the encoder via (i) Competitive Latent Compression, which regulates how latent tokens specialize in or share input information, and (ii) Lag-Aware Decoding, which incorporates variable-adaptive relative-lag priors. Experiments on 7 benchmark datasets demonstrate competitive or superior forecasting performance.
Critical strengths
-
The paper takes a meaningful direction toward improving an existing end-to-end forecasting framework [1], rather than focusing solely on architectural modifications.
-
The competitive latent compression mechanism is an interesting design that allows the model to adaptively balance specialization and information sharing across latent tokens.
Critical weaknesses
Overall, the experimental details are critically insufficient to support to paper's main claims.
-
First, the experiments use drop_last=True for the test dataloader. This is a critical evaluation issue that has repeatedly arisen in the time-series forecasting community [2], as it excludes the final incomplete batch from evaluation. All experimental results should be recomputed with drop_last=False to ensure evaluation on the complete test set.
-
Second, the effectiveness of the latent design is not sufficiently validated. As shown in Table 2, removing the latent pathway improves forecasting performance in three of the four prediction horizons, raising concerns about its necessity. Furthermore, competitive latent compression shares similarities with existing mechanisms such as Slot Attention [3]. Comparisons with alternative latent and attention designs are needed to establish the effectiveness of the proposed mechanism.
Questions for authors
-
Given that CoLaDe builds on TimePerceiver [1], why is TimePerceiver not included as a baseline in the experiments?
-
How does the proposed competitive latent compression differ from existing mechanisms such as Slot Attention [3]? Could the authors provide comparisons to clarify the benefits of the learnable signed coefficient?
-
Could the authors compare Lag-Aware Decoding with standard learnable relative position biases and evaluate the contribution of the variable-adaptive correction? I think this would clarify whether the improvements come from the proposed design rather than simply incorporating relative positional information.
[1] Lee et al., "TimePerceiver: An Encoder-Decoder Framework for Generalized Time-Series Forecasting", NeurIPS 2025
[2] Qiu et al., "TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methods", PVLDB 2024
[3] Locatello, "Object-Centric Learning with Slot Attention", NeurIPS 2020