- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether external imputations reach a time series foundation model and whether the model has learned to use them. It characterizes fill access through surviving preprocessing statistics, audits eighteen checkpoints from eleven families, and separates interface access from training exposure using paired experiments. A retrofit retains fills with observation flags and adapts released models for 5,000 steps. Across three model families, it reduces degradation under zero and linear fills; on recorded GIFT-Eval gaps, improvements concentrate in high-missingness windows. The main contribution is the distinction between access to repaired values, robustness to gaps, and learned use of repairs.
Critical strengths
- The computational diagnosis is precise and experimentally supported. The analysis distinguishes position-specific content from surviving normalization statistics, with a rank-at-most-two restriction for the explicit-mask Chronos-Bolt path. Jacobian, permutation, and oracle-fill interventions test this mechanism directly. This provides an actionable explanation for why better imputation can fail to improve forecasting.
- The within-family controls make the access-versus-learning distinction convincing. The within-family experiments use paired training seeds and show that augmentation can improve robustness while fill response remains flat. The three-family retrofit and recorded-gap evaluation extend the finding beyond one model, while the reported negative results help delimit the practical benefit.
Critical weaknesses
- The practical comparison does not yet establish when the retrofit should replace native missing-value handling. The recorded-gap evaluation emphasizes linear-fill comparisons, while the input-convention audit reports NativeNaN winning 26 of 36 declaration cells. The recorded-gap evaluation also reports a 5% worse pooled median MASE for Chronos-Bolt. A paired recorded-gap comparison against validation-selected native conventions is needed to substantiate a deployment recommendation.
- The adapter transfer summary uses evaluation-dependent selection. The transfer summary reports the better normalization variant in each cell, and the closure plot takes a pointwise envelope across variants. This does not measure one frozen adapter configuration on unseen datasets. Report both variants separately and a selection rule fixed before held-out evaluation, including paired absolute errors alongside own-clean closure.
Questions for authors
- On the same recorded-gap windows used in the reported evaluation, how does each retrofit compare with its native NaN path or a convention selected using separate validation data? Please report per-dataset changes and paired uncertainty, especially for the two high-missingness strata.
- What are the held-out results for each normalization variant separately, and was either variant selected without examining held-out forecast errors? Please distinguish this fixed-choice result from the best-variant closure reported in the transfer summary.
Kind reminder before the end of the discussion period
Dear Reviewer vNvx,
We believe the native-handling comparisons, validation-based input selection, fixed-normalization results, and absolute-error analyses have addressed your concerns. We also revised our deployment recommendation to clarify when native handling is preferable.
If you agree that your concerns have been addressed, we would be grateful if you would consider updating your review and rating; if any issues remain unresolved, please let us know before the discussion period closes so that we can address them promptly.