- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper tackles the problem of turning leaf-level forecasts of a time-series foundation model into aggregated and hierarchy-aware forecasts. In this work the leaves can be appliances, categories or households, and their forecasts are turned into system-level forecasts using a Hierarchy-Aware Residual Adapter (HAA). This is an MLP designed to predict corrections. The main contribution is a parameter-efficient, backbone-agnostic adapter that keeps the forecasts coherent across the levels of the hierarchy.
Critical strengths
None.
Critical weaknesses
- The data and model selection is questionable. First the dataset contains too few points for a meaningful evaluation in this context. In addition, the evaluation uses only one day for calibration and one day for testing. This is far too little data. Second, both models used rank low in current benchmarks (TimesFM-2.5 ranks 8th and Chronos 16th on fev-bench). Chronos is outdated and has a direct successor, Chronos-2 (published in 2025). TimesFM-2.5 is outdated and has a direct successor, TimesFM-3 (2026). State-of-the-art TSFMs such as Chronos-2 or TimesFM-3 could capture the underlying structure better without needing any adapter.
- Methodological this paper does not meet the requirements of ICLR. It is weak in his mathematically description, weak in the description of the experimental setup and weak in form (Figures formatting and overall structure). As it is this paper is not understandable in its current form. Further, major concern are for the results. Exemplarily, the seasonal naive clearly beats the method overall (see Table 1). The visualization of the forecasted days suggests that the model is not applied correctly, as it does not capture the daily pattern at all. At the very least, I would expect a midday valley and morning and evening load peaks.
The first point alone leads me to recommend rejection, as such a selection allows no conclusions about generalization and therefore shows no benefit of this work. But with the second it is a clear rejection from my side.
Questions for authors
- Is the HAA learned level by level, i.e., from appliance to category, then from category to household, and from household to total? Is the forecast form the applienc level (FM+ HAA) afterwards used for the category level.
- Experimental Setup: How the appliance level forecast propagate into the next level and is this next level again propagated?
- Is the context length sufficient? Current literature argues that more context is needed.
- Figure 3: The data shown here seem unrealistic. Seasonal naive with a lag of 96 (one day) at least reproduces the daily pattern. In a typical application, a time-series foundation model should easily beat it, or at least perform comparably. Why does the TimesFM forecast show no daily pattern, and why does the Chronos forecast show none either? This does not seem consistent.
- Do you think your findings generalize, given that the evaluation uses a single day, a special one at that (31 October, Halloween), and a single data setting? Evaluate it consecutively maybe in form of a time series cross-fold, trading of context but having a stronger evaluation.