- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies time-series forecasting with multimodal covariates. The method largely follows the latent-space forecasting approach of LatentTSF: a shared encoder maps historical and ground-truth future sequences into latent states, the predictor learns to match the encoded future states, and a separately trained decoder maps the predicted states back to observations. WorldTS extends this framework by incorporating numerical, textual, and visual covariates. Historical numerical covariates are concatenated with historical states and fused through an MLP, while text and image features are incorporated through a residual CFA adapter. Known future numerical covariates are used to further refine the predicted states. The model is trained in two stages, first optimizing the encoders and predictor with L1, cosine similarity, and VICReg losses, and then freezing them to train the decoder. The authors evaluate WorldTS on 21 datasets covering numerical, text, and image covariates. They follow the evaluation settings of DAG, VoT, and UniCA for the respective tasks, with baseline results taken from these works and KITE. WorldTS performs best in most of the reported comparisons. The paper also includes ablation studies on the loss terms, model components, training strategy, and covariates, along with hyperparameter sensitivity analyses on Colbun, Climate, and MMSP.
Critical strengths
1.The experimental results are strong. WorldTS is evaluated on 21 datasets covering numerical, textual, and visual covariates, and achieves the best results in most comparisons. Its performance is fairly consistent across these settings, suggesting that the approach is not limited to a particular type of data.
2.The ablation studies provide some support for the design choices. In Table 4, removing covariates or switching to one-stage observation-space training leads to worse performance on all three representative datasets. While these experiments do not fully isolate the contribution of each component, they do show that covariate information and latent-space training are useful for forecasting. And paper writing is clear.
Critical weaknesses
1.The incremental contribution over LatentTSF remains unclear. WorldTS adopts a similar latent-state prediction framework, with changes to the training scheme and the addition of multimodal covariates. However, without a direct comparison to LatentTSF or a controlled comparison with simpler covariate-conditioning strategies, it is difficult to determine which changes drive the gains. The current ablations show that covariates help, but do not fully resolve this question.
2.The stability of the reported improvements is uncertain. Baseline results are taken from prior work, and the comparability of tuning budgets is unclear. Moreover, the results are reported for a single seed without standard deviations. Some gains are quite small, MSE 0.285 vs. 0.288 on Agriculture and 0.090 vs. 0.091 on Time-MMD Energy, making it difficult to assess their robustness.
Questions for authors
1.Were the hyperparameters selected using validation or test performance? Section 5.3 and Figure 4 discuss the best-performing configurations, but the data split used and its role in hyperparameter selection are unclear.
2.Could the authors clarify the key methodological differences from LatentTSF and explain its omission from the experiments? If feasible, a target-only comparison between LatentTSF and WorldTS without covariates on one or two representative datasets would help assess the changes to latent-state learning.
3.Could the authors report mean and standard deviation over multiple seeds for WorldTS on a few datasets with small performance margins, such as Agriculture, Time-MMD Energy, or Colbun?