- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies an inference-time interface for applying frozen time-series foundation models (TSFMs) to irregularly sampled time series (or event series). Each event occupies a sequence position, with values and inter-event intervals represented as numeric channels, and the task is to predict the next event's value and timing. The authors compare this interface with regular-grid preprocessing using the same five frozen checkpoints on 85 Time-IMM series from nine families, alongside trained irregular-forecasting and temporal point-process baselines. Overall, the findings make a compelling case that changing the input representation can improve pre-trained TSFM forecasters without updating their parameters.
Critical strengths
-
A useful, controlled interface comparison. Identical checkpoints and held-out examples are compared with validation-selected grid configurations. Table 1 reports lower average values of MAE and MSE for every evaluated TSFM; Chronos-2 improves from 0.402/0.583 to 0.363/0.473. This supports a practical contribution independently of comparisons with separately trained models.
-
Broad evaluation with explicit scope and interface qualifications. The Time-IMM and EasyTPP results cover multiple different models and domains. Appendix B.2 distinguishes independent value/interval forecasting from multivariate conditioning; Appendix G acknowledges one-step point predictions and unaudited pre-training overlap. The paired design still supports within-checkpoint interface gains. Weaker categorical-event results are also disclosed.
Critical weaknesses
- The closest pretrained irregular forecasters are neither compared in the experiments nor excluded with a concrete justification. ISTS-PLM (KDD 2025) and VIMTS (ICML 2025) predate this work. Their adaptation procedures differ, but that alone does not establish that a fair forecasting comparison is impossible. The existing oracle-time value protocol offers a potential common task. Each should be compared under aligned information access, with adaptation costs disclosed, or its exclusion specifically justified.
- The added value over simple event-indexed predictors is not yet clear enough. Appendix E's normalized one-step "Value change" appears to provide persistence MAE if its targets, masks and aggregation match the main evaluation. This is useful partial evidence. An explicit persistence MAE/MSE baseline, simple autoregression, and basic interval predictors would show how much the TSFMs add on data where recent observations are already strongly predictive.
Questions for authors
-
Can you compare ISTS-PLM and VIMTS in the existing oracle-time value setting, using the same observed histories, splits, query times and metrics as the other oracle-time baselines? Please report adaptation costs and make clear that these baselines receive the true query time, whereas the event-sequence TSFMs predict the next event directly. If either method cannot be compared fairly, explain the specific obstacle and how it limits the comparison.
-
Does Table 14's "Value change" use the same targets, masks and averaging as the main value MAE? Averaging its rounded family entries gives about 0.474, compared with TSFM's MAEs of 0.353-0.370. On EPA-Air, however, the diagnostic is 0.109, below the TSFM MAEs of 0.113-0.121 in Table 18. If it is true, persistence is already competitive on that family. Please confirm it, add persistence MSE, and compare simple event-indexed autoregression and last-interval or training-median interval predictors.
-
How sensitive is the joint-timing comparison to the value/interval loss weight and checkpoint-selection criteria? Appendix C.4 fixes the interval-loss weight at 1.0 and selects checkpoints by validation loss. Raw and log interval targets can have different loss scales. Appendix D.3 studies the encodings, but a check of loss weighting or selection by value MAE would help establish robustness. The oracle-time results already provide useful evidence without the joint loss.
-
How uncertain are the smaller paired gains? Table 14 reports family MAE gaps of 0.001 on FNSPID and 0.009 on ILINet. Intervals that account for dependence within each series, together with seed variation for the trained baselines, would help distinguish stable gains from small fluctuations.
Minor issue: Line 324 "sections B.2 and D.4 gives", change "gives" to "give".