- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3(+1)
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
This paper proposes HORW, a model-agnostic framework that dynamically adjusts point-wise loss weights using historical prediction errors from overlapping forecasting windows. Experiments across seven datasets and three forecasting models demonstrate its effectiveness in improving forecasting accuracy, with further gains when combined with auxiliary training objectives.
Critical strengths
- Interesting idea
- HORW is a model-agnostic framework
- The experimental results have verified HORW's effectiveness.
- This paper focuses on an often-overlooked phenomenon in training: overlapping predictions of future timestamps across sliding windows.
Critical weaknesses
- The proposed method incurs relatively high training costs, undermining its claimed advantages of simplicity and lightweight design.
- The paper lacks direct comparisons with lightweight yet effective methods for optimizing the training process, such as selective learning [2], DropoutTS [3] and curriculum learning [1].
- The writing is poorly organized and lacks clarity, making several key aspects of the method difficult to understand intuitively. For example: 3.1. Why can the prediction errors from preceding windows serve as an indicator of the learning value of the current prediction? 3.2. Why does the method consider only preceding windows rather than all overlapping windows? 3.3. If predictions from preceding windows involve longer forecasting horizons and are inherently more difficult, what additional meaningful information do their historical prediction errors provide?
- The discussion of prior work precedes a sufficiently intuitive explanation of the central problem, making it difficult to appreciate the method's novelty.
- The introduction does not clearly establish why historical errors from preceding windows provide a reliable signal for optimizing the current prediction.
- The paper lacks a thorough analysis of the advantages of the proposed method over existing sample- or label-weighting and selection strategies[1,2,3].
[1]MTGNN, KDD2020
[2]Selective Learning, NeurIPS 2025
[3]DropoutTS, ICML 2026
Questions for authors
see weakness
4 comments
Response to Reviewer hAc4 (Part 2/2)
Q4. The discussion of prior work precedes a sufficiently intuitive explanation of the central problem, making it difficult to appreciate the method's novelty.
We have revised the introduction to explain the central problem intuitively before presenting HORW, and moved the discussion of prior work to the Related Work section.
Q5. The introduction does not clearly establish why historical errors from preceding windows provide a reliable signal for optimizing the current prediction.
Thank you for this helpful suggestion. We have revised the introduction to clarify why preceding-window errors provide a useful reference for the current prediction.
Q6. The paper lacks a thorough analysis of the advantages of the proposed method over existing sample- or label-weighting and selection strategies[1,2,3].
These studies are relevant to HORW’s goal of improving forecasting through training optimization, and we have added citations and discussion in the revised manuscript. The detailed experimental comparisons and analysis are provided in our response to Q2.
My concerns have been well addressed. Therefore, I decide to raise my score to 3 and recommend acceptance of this paper.
Dear Reviewer hAc4,
Thank you for taking the time to reconsider our paper and for your constructive feedback. Your questions helped us make the motivation for HORW clearer, improve the organization of the introduction, and add more direct comparisons. We appreciate your careful review and wish you all the best.
Best regards,
The Authors
Response to Reviewer hAc4 (Part 1/2)
We thank the reviewer for the detailed and constructive feedback. Your comments have helped us clarify the intuition behind historical error references, explain our choice of preceding windows, and present the method’s contribution more clearly. They have also prompted us to examine training costs more candidly and strengthen the comparison with related training strategies. We address each point below.
Q1. The proposed method incurs relatively high training costs, undermining its claimed advantages of simplicity and lightweight design.
We have clarified the additional training costs in the Conclusion section of the main text and revised the lightweight claim to refer specifically to the unchanged backbone architecture and absence of additional inference-time computation.
Q2. The paper lacks direct comparisons with lightweight yet effective methods for optimizing the training process, such as selective learning [2], DropoutTS [3] and curriculum learning [1].
Thank you for pointing us to these studies. We have added references to curriculum learning [1], Selective Learning [2], and DropoutTS [3], together with a discussion of their relationship to HORW. For direct comparisons, we prioritized the two more recent methods, Selective Learning [2] and DropoutTS [3], using DLinear as the common backbone. All methods use the same data splits, forecasting horizons, and evaluation protocol. We tuned the comparison methods using search ranges specified in their papers or confirmed by the authors, selecting configurations based on validation performance. The results on six datasets are reported in Appendix N and reproduced in the table below.
Compared with DropoutTS, HORW achieves lower MAE on all six datasets and lower MSE on five, with a tie on ETTm1 at the reported precision. Although Selective Learning achieves lower MSE and MAE on ILI by approximately 9.7% and 8.5% relative to HORW, HORW reduces MSE and MAE on Exchange by approximately 30.0% and 12.0% relative to Selective Learning. HORW also achieves lower MSE and MAE on four of the six datasets.
Results using DLinear as the common backbone. Lower values are better; the best results at the reported precision are bolded.
Q3.1. Why can the prediction errors from preceding windows serve as an indicator of the learning value of the current prediction?
As you noted in Q3.3, preceding windows predict the same target at longer horizons, where accurate forecasting is generally more difficult. Their errors provide a target-specific reference for how well the model predicts the same timestamp and variable using earlier observations. If the current prediction has a larger error than this reference despite having access to more recent observations and a shorter forecast horizon, it underperforms relative to the performance summarized by preceding forecasts. We use this relative underperformance as a signal that the current prediction may warrant an adjustment to its training weight.
Q3.2. Why does the method consider only preceding windows rather than all overlapping windows?
Later windows often yield smaller errors because they forecast the same target at shorter lead times with more recent observations. Including them may lower R and activate additional points that would otherwise meet the preceding-window reference. Through weight normalization, this also changes other points’ relative contributions to training, potentially affecting their optimization.
Q3.3. If predictions from preceding windows involve longer forecasting horizons and are inherently more difficult, what additional meaningful information do their historical prediction errors provide?
Your question certainly gives us much to reflect on. Indeed, predictions from preceding windows involve longer forecasting horizons and are inherently more difficult. However, these errors also reflect how well the model predicts the particular target, providing a target-specific benchmark beyond current error magnitude. When the current error exceeds this benchmark despite a shorter lead time, it indicates underperformance relative to earlier forecasts made with less recent information.