- Rating
- 3
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
a JEPA-style latent predictor on top of a frozen Chronos-2 encoder, adds text, events and covariates as a residual correction in latent space, and then adapts the Chronos-2 decoder on the frozen representation. Pretraining is on public data plus internal company data. Evaluated on MUSE, where it beats the published leaderboard, with a lot of ablations on a small model.
Critical strengths
- many matched controls, and the negative group effects are clearly presented.
- comparison between frozen and jointly trained readout in Figure 3b is clear and well-presented.
- ablation studies successfully shows the reference loss.
- freeze and anchor grid will be helpful for anyone looking to adapt Chronos-2.
- Checkpoints were selected based on a pretraining holdout set, rather than on MUSE.
Critical weaknesses
- 'zero-shot,' but you pretrain on datasets like ACL18, TimeCAP, and Time-MMD up to the test cutoff (Apx B). The baselines in tab 1 did not have access to these series.
- Chronos-2 decoder adaptation control achieves less compared to the published results. This seems that about a lot of improvement comes from in-domain training.
- are the internal company data and the MUSE Industrial windows from the same source?
- this only used seed 42, and the effects range is small. The capacity grid is not monotonic, which looks like noise to me.
- the 6.26% is the best of four model sizes on the test set
- why do you call this a 'world model'? There are no actions or rollouts involved.
- JEPA for time series exists already (you cite LaT-PFN etc.), the delta is the residual context part
- GPU hours?
Questions for authors
see above