- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes CLCA, a framework for LLM-based time-series forecasting that combines window-level context conditioning, layer-wise context adapters, and multi-step autoregressive training. The model uses numerical window statistics and timestamp representations to provide contextual information to a frozen language-model backbone, with adapters placed in the final six layers. During training, predicted segments are fed back into the input window so that later predictions are supervised under conditions closer to autoregressive inference. The method is evaluated on long-term forecasting, M4 short-term forecasting, and M3/M4 zero-shot transfer, with additional studies on adapter placement, component ablations, lightweight backbone replacements, and alternative pretrained language models.
Critical strengths
The paper is generally well written, and the method and training procedure are described clearly.
The supplementary material is also detailed and provides useful implementation information. The experimental evaluation is fairly broad, covering eight long-term forecasting datasets, M4 forecasting, zero-shot transfer, adapter placement, component ablations, and different backbone choices. The method also achieves competitive results on several datasets.
Critical weaknesses
My main concern is the limited methodological novelty. CLCA is largely built on AutoTimes and Deep TPC, together with existing ideas such as adapter placement, window-level conditioning, and multi-step autoregressive training. The paper introduces a new combination and a patch-state update pathway, but it is not clear to me that these incremental changes are sufficiently novel. In particular, the paper directly builds on Deep TPC but does not include a direct comparison with it.
The role of the pretrained LLM is also not sufficiently demonstrated. On ETTh1, removing the LLM backbone leads to almost no performance drop, while on ECL a lightweight attention module reaches the same average MSE. These replacement models are not perfectly controlled, since they still use LLM-generated timestamp embeddings and modify the adapter structure, but the results still weaken the claim that a large pretrained language backbone is necessary.
The evidence for the critical-layer claim is also limited. The placement study is only conducted on ETTh1 and ETTm1, and the differences between the final six layers and alternative placements are very small. No statistical significance test is provided, and it is unclear whether the same pattern holds across different backbones.
The baseline comparison could also be stronger. Recent autoregressive forecasting methods such as Timer-XL and Time-MoE are discussed in the related work but are not included in the main experiments. There is also a potential inconsistency in the evaluation protocol, since CLCA and CALF use 720-step targets to construct test samples, while some reproduced baselines use targets corresponding to each forecast horizon.
Finally, some of the reported gains are quite small, and the contribution of multi-step supervision is not fully separated from the additional computation it requires. The paper also does not systematically report training cost, inference latency, or memory usage, even though long-horizon forecasting requires multiple forward passes through the full 774M backbone.
Questions for authors
What is the key methodological novelty beyond combining AutoTimes, Deep TPC, and standard adapter mechanisms?
Why are the final six layers considered critical when the improvements over other placements are relatively small? Does this finding generalize to other datasets and backbones?
Why does removing the pretrained LLM backbone produce almost identical performance on ETTh1? What is the actual contribution of LLM pretraining?
Can the authors compare against stronger recent forecasting methods under identical test origins and evaluation protocols?
Can the authors provide compute-matched training ablations and report training/inference costs?