- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes CLAIR, a teacher–student framework for adapting frozen LLM backbones to time-series forecasting. CLAIR combines two complementary consistency objectives, i.e. patch-level transport alignment (PTA) via entropic optimal transport between clean-view EMA teacher and perturbed student patch representations, and forecast-level consistency between their normalized predictions. Experiments demonstrate the effectiveness of the proposed methods.
Critical strengths
-
The motivation is clear. The authors analysis index-free correspondence through token-sensitivity diagnostics and the student–teacher transport visualization.
-
The training-time-only overhead with no inference-time cost increase is attractive for deployment.
-
The paper is well written and easy to follow.
Critical weaknesses
-
The OT alignment introduces O(N^2) per-sequence complexity in training, which may limit scalability to longer inputs.
-
Some reported gains over LLM baselines are modest and may fall within expected variance. It is suggested to give statistical significance testing or confidence intervals.
-
The backbone LLM choices could bias comparisons: e.g., SE-LLM’s backbone was replaced with GPT-2 small to reduce differences, but it is unclear whether similar harmonization was applied to Time-LLM and other methods that typically use larger LLMs.
-
The overall overhead such as parameter counts and FLOPs are not reported.
Questions for authors
NA
W1
We would like to clarify the computational cost of PTA. Here, N denotes the number of patches rather than the input length. With an input length of 512, patch length 16, stride 8, and end padding, N=64, resulting in a 64×64 cost matrix. Since the backbone's self-attention already scales quadratically with sequence length, PTA does not change the asymptotic training complexity. As reported in Appendix H, Sinkhorn computation takes approximately 8.7 ms per iteration (<1% of a full training step). The full teacher-guided training step requires 1.44× time and 1.24× peak memory relative to the student-only baseline, while inference latency remains unchanged.
W2
We agree that modest performance differences should be evaluated against run-to-run variability. We therefore analyzed three-run results for CLAIR and the strongest LLM baseline in terms of horizon-averaged MSE on Weather, ETTh2, ETTm1, and ETTm2. Table 7 reports mean ± SD and approximate 95% confidence intervals for the MSE differences using Welch's method.
Table 7. Run-to-run variability and 95% confidence intervals for MSE differences
CLAIR achieves lower horizon-averaged MSE across all four datasets and lower mean MSE in 12 of the 16 horizon-wise comparisons. Notably, five comparisons have 95% confidence intervals entirely above zero, providing statistical evidence of improvements beyond run-to-run variability in these settings. The remaining intervals include zero, indicating that the strength of evidence varies across settings. We will incorporate these uncertainty estimates into the revised paper.
W3
We apologize for the insufficient clarification of the experimental settings in Appendix A.1. To reduce backbone-related differences, all LLM-based methods, including Time-LLM, OFA, CALF, S²IP-LLM, FSCA, and SE-LLM, used the first six layers of pretrained GPT-2 small. For FSCA and SE-LLM, we additionally adjusted their input configurations to ensure consistency with the common evaluation protocol, as described in Appendix A.1. These adjustments were made to reduce differences in experimental conditions while preserving each method's adaptation mechanisms, allowing a more direct comparison of their methodological contributions. We will clarify these settings in Appendix A.1.
W4
We would like to clarify that the computational costs are reported in Appendix H. CLAIR uses 19.18–19.24M trainable parameters (Table 14), comparable to CALF (18.53M) and fewer than Time-LLM (55.41M), S²IP-LLM (57.04M), FSCA (31.75M), and SE-LLM (97.33M), although OFA uses fewer (17.33M). At inference, only the student is retained, with 88.55M stored parameters and approximately 42–43 GFLOPs per forward pass at H=96 on ETTm1 (Appendix H.2–H.3). Its inference latency is 4.39 ms/sample, matching the student-only baseline (Table 16). Full training requires 1.44× step time and 1.24× peak GPU memory compared with student-only training (Table 15). Most of this overhead comes from the teacher forward pass and additional backward computation, while Sinkhorn PTA takes approximately 8.7 ms per iteration, less than 1% of a full training step (Appendix H.4).