- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes EUD-RM, an error-centric framework for multivariate time-series forecasting. It progressively reduces systematic errors, applies gated parametric correction, retrieves similar historical residuals for non-parametric correction, and models the remaining predictive uncertainty. Experiments on seven long-horizon benchmarks show strong point-forecasting performance and generally support the proposed component roles.
Critical strengths
-
The error-centric formulation is well motivated, and the staged design provides a coherent way to treat different types of forecasting failures.
-
The empirical evaluation is extensive, with strong results on seven benchmarks, detailed ablations, mechanism analyses, computational measurements, and multi-seed stability tests.
Critical weaknesses
-
The uncertainty evaluation is relatively limited. The main interval comparison is performed in the controlled pre-RARM setting and mainly against a constant-scale baseline, although the complete model uses post-RARM LGEC-U.
-
The framework introduces substantial architectural and retrieval complexity. RARM can add considerable inference latency and memory cost, while its incremental point-forecasting improvement is relatively small in several ablations.
Questions for authors
-
Could the authors report prediction-interval results for the complete post-RARM EUD-RM and compare them with stronger probabilistic or conformal forecasting baselines?
-
Can the authors further quantify the accuracy-efficiency trade-off of RARM, for example by varying memory capacity or retrieval size and reporting forecasting gain versus latency and memory cost?
reply to authors' rebuttal
I thank the authors for the detailed rebuttal. As i have mentioned in my initial review, i find the paper very complicated with different components described repeatedly. I acknowledge the changes made in the revised revision, but to me, it is unclear. As i have experience working on time-series, it took me a lot of time to understand the descriptions in the paper, and i reckon that is not good writing. Good researcch should allow audience even from other fields to understand the main idea. I do not think the paper achieves it within this current state.
Other than the presentation problem, i find some contradicting facts in the rebuttal of the paper, which eventually leads to me taking a stand with my rejection for the paper. I list some of the main errors here. I do care about the details, and rest assured the reason I list the reasons below is i want the paper quality to get better. My recommendation for the paper at this stage is reject, but i think after other rounds of revision the paper could improve.
Other than the original W2, I still find some inconsistencies in terms of the reported results. For ETTh1 at H=96 on the full test set, Tables 10 and 14 report MSE 0.339 (seed std 0.00016). Table 19 evaluates the frozen complete pipeline on all 2,785 test windows (the H=96 test set) and reports 0.3493
There could be problems with your independent runs. The five-seed ablation you posted on 17 Nov means equal the single-seed Table 11 values with a fourth digit appended (0.344 and 0.3442, 0.381 and 0.3817). Independent runs do not do this.
In your own fixed-head test (Table 13), a constant gate keeps 58% of the LGEC gain and the whole correction changes MSE by 0.34%. The gate is therefore not shown to identify correctable errors.
With all the reasons above, I stand by my decision to reject the paper.