- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper provides an interesting geometric perspective on how language pretraining helps with cross-modal transfer to time-series forecasting. The paper suggests that language-pretrained models may contain reusable sequential structures, which provides an informative explanation beyond architecture design. The main conclusion is supported by comprehensive analysis of representation geometry, initialization, and cross-modal feature reuse. The presentation is easy to follow, and the paper provides useful insights into the mechanisms underlying cross-modal transfer from language to time series.
Critical strengths
- The paper studies an important question in cross-modal transfer for time-series forecasting from an interesting perspective. It suggests that language pretraining may provide a reusable representation geometry for time-series forecasting, offering a different perspective on why language-pretrained models can work for time series forecasting.
- The experimental design is comprehensive and supports the main claim of the paper well. The proposed transfer mechanism is examined from multiple perspectives, with convincing experimental results and visualizations.
- The presentation is very clear. The motivation, experimental design and conclusions are well connected across sections and form a clear story. The figures are also informative and help illustrate the main findings.
Critical weaknesses
There are a few minor reference and presentation issues. Some references could be updated form arXiv versions to their published versions. The Phi-4-mini technical report reference appears to contain a formatting error. In addition, Figures 4 and 5 would be clearer if the font size were larger.
Questions for authors
In Section 3.2, the retrieval experiment provides evidence of shared temporal patterns between the projected text trajectories and real time series. I am curious whether the forecasting performance comes from a meaningful temporal relationship between the first and second halves of the selected trajectory, or mainly from retrieving a similar prefix. For example, if another candidate with a similarly matched prefix were selected, would its second half provide comparable forecasting performance? Alternatively, if this temporal relationship were broken by randomly shuffling the second halves across candidates, would the performance drop significantly?
Reminder
Dear Reviewers CEMg and QFq3,
Thank you for your efforts so far. This is a friendly reminder to review the authors' rebuttal and respond to their comments as soon as possible, before the discussion deadline (November 18 AoE). Please also indicate whether your concerns have been addressed. Thank you for your time and cooperation!
Best regards, AC