- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates progressive capability formation in time-series large language models (TS-LLMs) through three stages: Perceive, Solve, and Reason. The authors compare different training strategies and alignment architectures, analyzing how training order, stage maturity, and representation transfer influence temporal reasoning. Experiments across multiple benchmarks demonstrate that progressive training generally improves performance, particularly under limited reasoning supervision.
Critical strengths
The paper systematically investigates the relationships among perception, task solving, and reasoning capabilities in TS-LLMs, with experiments conducted under both Pre-align and Post-align architectures. The results show that progressive training generally improves reasoning performance, with more pronounced gains when reasoning supervision is limited. These findings provide useful insights into training strategies for time-series LLMs.
Critical weaknesses
- Limited novelty and insufficient comparisons with alternative training strategies.
The proposed Perceive → Solve → Reason training framework is closely related to existing curriculum learning approaches. Although the authors compare direct training, mixed training, and progressive training, more targeted baselines are still missing, such as mixed training followed by a separate Reason fine-tuning stage. Therefore, the current experiments do not sufficiently demonstrate whether the improvements primarily come from the specific three-stage progression or from general stage-wise optimization. In addition, the authors should clarify whether different training strategies are comparable in terms of total training tokens, optimization steps, and computational budgets.
- Insufficient evaluation of reasoning capabilities.
The Reason stage is mainly evaluated using multiple-choice questions, QA accuracy, and metrics such as ROUGE-L and BLEU. However, these metrics may not adequately demonstrate whether the models genuinely understand time series data. I suggest including additional experiments involving masked, shuffled, or counterfactual time series inputs to verify whether the models truly rely on temporal information rather than textual cues or answer choices.
- Limited robustness and generalizability of experimental results.
The authors primarily use Qwen3-4B, with additional experiments on Qwen3-1.7B. However, evaluations across different model families and multiple random seeds are still lacking (given the potentially substantial variability in TS tasks, I believe more robust experimental validation is necessary)
Furthermore, progressive training does not consistently outperform Mixed Training across all settings. For example, in Table 17, under the Pre-align architecture with 75% reasoning data, Mixed Training achieves 0.673, while Progressive Training achieves 0.664. The authors should therefore provide a more balanced discussion of the conditions under which progressive training is beneficial.
- Insufficient evidence supporting the proposed capability formation mechanism.
The authors use gradient analysis and cross-layer representation analysis to argue that Perceive, Solve, and Reason capabilities are progressively transferred across different network depths. However, these analyses mainly reveal correlations and do not sufficiently establish the causal dependencies among the three capabilities. More direct controlled experiments would be valuable to substantiate the proposed Progressive Capability Formation mechanism.
Questions for authors
- Is the training budget fairly controlled?
Are Progressive Training, Mixed Training, and Stage 3 Only strictly controlled for total training tokens, optimization steps, and computational budgets? If the training budgets differ, the observed performance improvements may not be entirely attributable to the training order.
- How can the importance of the specific training order be demonstrated?
I suggest adding a Mixed Training → Reason Fine-tuning baseline, where the model is first trained on mixed data and then fine-tuned specifically on Reason tasks. This would help determine whether the improvements stem from the complete Perceive → Solve → Reason progression or simply from concentrating on Reason training in the final stage.
- Do the models genuinely utilize time series information?
Many Reason tasks are formulated as multiple-choice questions, and some may be answerable using textual cues or common knowledge embedded in the answer choices. I suggest conducting ablation experiments by removing or shuffling the time series inputs to verify whether the improvements genuinely arise from temporal understanding rather than the language model's existing knowledge.