- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a refinement module for time series imputation to improve downstream forecasting and reduce dependence on the choice of imputation method. The module adjusts imputed values using temporal structure without retraining the forecasting model. Experiments across multiple datasets and models show improvements in average forecasting performance.
Critical strengths
S1. It is interesting to improve downstream forecasting while reducing dependence on the choice of base imputation method. S2. The proposed module requires no additional training or modification of the forecasting model, and can be integrated into existing imputation pipelines.
Critical weaknesses
W1. The novelty is not sufficiently established. Prioritizing forecasting utility over reconstruction accuracy has already been explored in task-oriented imputation methods such as TOI-VSF [1]. W2. The experimental validation is insufficient, lacking component ablations and hyperparameter sensitivity analyses. The method relies on several hand-crafted rules and model-specific thresholds for TimesFM, but their selection is not sufficiently justified. [1] Hao et al., “Is Precise Recovery Necessary? A Task-Oriented Imputation Approach for Time Series Forecasting on Variable Subset,” IEEE Transactions on Knowledge and Data Engineering, 2025.
Questions for authors
See above
4 comments
Response to Reviewer k4JK (2 of 2): ablations and parameter evidence
To W2. We have taken your concern about hand-crafted rules seriously and added comparisons that separate component choice, correction strength and the original action rule. This evidence also led us to simplify the method. Below we summarize the central results and the parameter and sensitivity checks.
Each component contributes to the joint correction in the paired averages. The fixed common panel contains 18 datasets, five historical windows per dataset, all five missingness patterns at three ratios, four base imputers and four forecasters: 21,600 cases per configuration. All-three has the lowest mean sMAPE (5.32958) among eight subsets. Removing trend, seasonality or residual correction raises mean sMAPE by 0.07908, 0.04064 or 0.03839 points, respectively. Each individual 95% interval is above zero. Each active component keeps its original reference and dynamic strength.
Dynamic strengths improve over a simpler correction using the same references. Both arms in the first row below always correct all three components; only the strengths differ. The second row separately compares the original action rule (including keep-input and zero-target branches) with all-three correction under the same strength formulas.
Table K2. Action and strength controls on the same 21,600 cases.
| First / second | First sMAPE | Second sMAPE | Difference [95% CI] |
|---|---|---|---|
| Dynamic / fixed (1.5, 0.5, 0.1) | 5.32958 | 5.37177 | -0.04219 [-0.07145, -0.01434] |
| Original action / all three | 5.34293 | 5.32958 | +0.01335 [0.00085, 0.02233] |
Dynamic strengths lower overall mean error; the 345,600-case comparison also improves the mean for each forecaster. In the action-rule comparison, the dynamic formulas and shared thresholds are identical on both sides. Applying all three corrections gives lower mean error. We retain the references and dynamic strengths, remove the original action rule from the method, and report its comparison here to explain that decision.
The retained parameters have a traceable selection history. Early four-dataset, three-ratio weighted seasonal-reference searches over K={1,2,3,5}, then {3,4,5}, selected K=3; the residual reference inherited it. Trend trials compared 0.9/1.2/1.5/1.8/2.0 and favored 1.5. Case analysis then motivated boosting to 2.0 only with sufficient boundary, trend-reference and residual-reference discrepancies. The seasonal/residual formulas set response ranges and jointly improved over their predecessor on all five development forecasters across 27 datasets, supporting the formulas as a complete configuration. A later multiplier/radius search screened at window ranks 1/5 and evaluated at 9/12. Its tuned K=1 baseline was included in the subsequent 1,800-case comparison, where the adopted phase-median/K=3 configuration scored 6.82188 versus 6.83582. This selected a complete configuration. The stricter TimesFM exception came from a six-dataset, three-ratio pilot to limit aggressive trend extrapolation, followed by a 27-dataset expansion.
On all 86,400 TimesFM pairs, shared thresholds give 4.94106 versus 4.94338 for the original specific thresholds, a difference of -0.00232 [-0.00512, -0.00023]. We therefore use the shared thresholds for every forecaster in the revised method. On the 21,600 common cases, fixing only trend strength at 1.0/1.5 gives 5.35537/5.33894 versus 5.32958 for dynamic strengths, with seasonal/residual strengths unchanged; the two individual intervals include zero. Replacing only the residual target with zero gives 5.34654, an increase of 0.01696 [0.00329, 0.02992]. This reference-only control, reported here, supports using the same-phase residual reference.
Matched period and gap-length controls. Using the same five windows as the core ablations, half/double periods change sMAPE by +0.12605/+0.04040 on 2,160 pairs. The half-period adjusted interval is above zero. With 400 missing points, refinement-minus-base differences for 25/50/100-point gaps are -0.04570/-0.04792/-0.09875 on 680 pairs each. The interval at length 25 is below zero; the other two include zero. Appendix G/Table 22 reports all estimates.
In response to this concern, we made three sets of revisions:
1. Adding controlled experiments. Section 5.5/Tables 2-3 give common-panel controls and full-panel strength evidence; Appendices F and I specify matching and component protocols.
2. Explaining parameters and sensitivity. Section 4.3/Appendix B specifies the shared formulas, Appendix H explains their selection, and Appendix G reports period/gap sensitivity.
3. Synchronizing the simplified method. The abstract, Section 4, Figure 2, Algorithm 1 and conclusion describe the final method. These replies report the original-action, specific-threshold and zero-target controls.
Differences are sMAPE points; paired source-family intervals are 95% (period contrasts: adjusted 97.5%).
Thanks for the clarification. The results provide convincing evidence that the proposed refinement improves the final forecasting performance. However, I still have concerns about the methodological novelty.
Follow-up on the contribution of post-imputation refinement
Thank you for following up and for recognizing the forecasting improvements. We would like to clarify what our refinement contributes to forecasting-oriented imputation.
-
We use historical structure to guide how an existing imputation is refined for forecasting. TOI-VSF and our work share the goal of making imputation useful for forecasting. TOI-VSF pursues this goal by jointly training the imputer and forecaster. We start from an existing imputation and use the history around each gap to construct references for its trend, seasonal, and residual components. These references give the corrections a direction. An update can move partway toward its reference or extend beyond it. During development, downstream forecast error guided our choice of rules for how far to move each component. At inference, these rules determine the correction strengths from the current historical window. Only originally missing entries are updated (Section 4).
-
The refinement is simple to add to an existing forecasting pipeline. Users can keep both the base imputer and the pretrained forecaster they already use. The correction is computed from the completed history, the original missingness mask, and the seasonal period, without additional training or any call to the forecaster. The frozen forecaster then makes its usual single prediction from the refined history. The same procedure can follow interpolation, statistical imputation, or a learned imputer.
-
The refinement reduces sensitivity to the choice of base imputer. We applied the same correction rules to the outputs of different imputers. In our evaluation, this lowered overall mean forecast sMAPE and narrowed the spread in mean sMAPE across imputers (Sections 5.2–5.3). In practical terms, the initial choice of imputer had less influence on average forecast accuracy after refinement.
Thank you again for sharing your perspective. Could you say a little more about which aspect of the refinement prompted your concern about methodological novelty?
Response to Reviewer k4JK (1 of 2): contribution relative to TOI-VSF
To W1. Thank you for drawing our attention to TOI-VSF and asking us to make the contribution more explicit. We agree that improving forecasting utility is a shared research goal. We have revised the positioning to explain the specific correction mechanism developed here and the evidence supporting it.
Our contribution is a component-aware post-imputation correction mechanism for frozen forecasters. Starting from an existing completion, we use STL to represent its trend, seasonal and residual components. A trend bridge uses the levels at the gap boundaries; a seasonal phase median draws on recurring same-phase values at originally observed positions; a weighted residual reference uses the corresponding residual values. These references supply correction directions, and statistics of the completed history set their dynamic strengths. Only originally missing entries are updated. Our correction rules and parameter settings were developed through iterative experiments guided by downstream forecasting performance and case analysis (Appendix H). Once fixed, the refinement operator requires no forecaster calls at inference.
The design uses historical temporal structure to improve the forecasting input. The references are not ground-truth components that the method seeks to reconstruct exactly: the trend bridge may be extrapolated by its strength, and seasonal and residual components move partway toward their references. Their forecasting value is assessed through paired future forecast errors. This makes the component construction and its controlled use central to our contribution, rather than the general choice to evaluate forecasting utility.
This mechanism is distinct from TOI-VSF's jointly learned imputation and forecasting. TOI-VSF addresses variables entirely absent at inference. Our correction acts on partial gaps in a completed history, requires no training or forecaster calls to compute its updates, and can follow an existing imputer while the pretrained forecaster remains frozen. The decomposition, three reference constructions and dynamic updates provide a concrete way to exploit historical structure in this setting.
Table K1. Main results, 345,600 matched cases (Sections 5.2-5.3).
The mechanism improves forecast accuracy and reduces dependence on the base imputer. The standard deviation above is computed across imputers within each dataset-forecaster cell and then averaged. These complementary benefits are evaluated across 18 datasets, 16 imputers and four frozen forecasters. Refinement also improves a forecast-selected imputer: on 10,800 pairs, sMAPE falls from 5.70697 to 5.53291, a reduction of 0.17406 [0.02877, 0.45019]. Thus the benefit remains after selecting an imputer for downstream forecasting.
The ablations in our next reply connect these gains to the proposed design: the eight-subset comparison tests the component combination, and the same-reference dynamic/fixed comparison tests correction strength. They support the mechanism beyond an overall before/after comparison.
To make the contribution explicit, we made three sets of revisions:
1. Stating the specific contributions. Section 1 identifies training-free refinement, the three-reference mechanism with dynamic strengths, and its measured benefits.
2. Distinguishing the mechanism from related work. Section 2.2 briefly introduces TOI-VSF and contrasts joint learning with frozen-forecaster refinement; Sections 3-4 specify our objective and operator.
3. Connecting the contribution to evidence. Sections 5.2-5.3 report accuracy and between-imputer dispersion. Section 5.6/Table 4 adds forecast-guided imputer selection, with its protocol in Appendix J.
We appreciate the opportunity to clarify this distinction: the shared forecasting goal motivates the problem, while the concrete operator and its measured effects establish this work's contribution.