- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates text collapse in fusion-based multimodal time-series forecasting: textual representations exhibit limited diversity, weak alignment with forecasting targets, and little influence on predictions. It introduces three complementary diagnostics—effective rank, centered kernel alignment (CKA), and prediction divergence—and proposes REST-TS to mitigate this behavior. REST-TS constructs residual targets using an EMA numerical-input predictor and supervises the text branch on their trend and event components. Stop-gradient prevents the numerical branch from absorbing the auxiliary supervision. Experiments cover Time-MMD, FNF, and FNSPID, eight forecasting backbones, and an adaptation to SpecTF.
Critical strengths
- Useful diagnostic contribution. The paper evaluates whether models actually use text through complementary measures of representation diversity, target alignment, and prediction sensitivity.
- Well-motivated method with broad evidence. Residual supervision encourages complementary textual learning, supported by multiple benchmarks, forecasting backbones, and optimization analyses.
Critical weaknesses
- The diagnosis may depend on limited text representations. Mean-pooled frozen token embeddings omit contextual interactions; experiments with contextualized representations are needed to establish the generality of text collapse.
- The mechanism and resolution claims remain incompletely supported. The decomposition’s advantage over simpler residual supervision is modest, and improved diagnostic values do not necessarily demonstrate beneficial textual influence or complete resolution of collapse.
Questions for authors
- Does text collapse persist with contextualized frozen text representations, and does REST-TS retain its advantage?
- Can you provide broader statistical summaries across domains and backbones to qualify the consistency of the forecasting gains?
- What additional benefit does trend-and-event supervision provide over supervising the full residual or alternative components?
- How is the CKA target projection constructed, and does replacing informative text worsen forecasting error as well as change predictions?
- A comparison with TiMi (ICML 2026) would strengthen the positioning of REST-TS. In particular, does text collapse also occur under selective mixture-of-experts integration, and does residual-exclusive supervision provide additional benefits?
Dear reviewers,
The authors have now submitted their responses. Please review them and share your thoughts on whether your concerns have been addressed. I encourage you to engage with one another’s assessments, discuss any remaining disagreements, and update your reviews and scores as appropriate.
Thank you.
AC