- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies normalization in online forecasting. It proposes SCAN, a novel method to normalize non-stationary time series. The method is tested on time series of taxi rides at different horizon levels.
Critical strengths
None
Critical weaknesses
- writing: the paper is hard to read.
- it's very hard to understand what has been done from the abstract
- the rest of the paper is similarly ambiguous. Novel and ambiguous terms are used without defining them clearly. Empirical evidence is provided without defining what is being discussed.
- novelty and empirical results
- in general, the classic forecasting methods also deal with non-stationarity and seasonality. It would have been interesting to see how they compare against the proposal in this setting
- the paper lacks an extensive comparison with state-of-the-art methods
- the benchmarks are limited to mobility data
Questions for authors
See weaknesses above.
2 comments
Summary
| Change | Related weakness |
|---|---|
| Abstract, introduction and Section 3 restructured; problem setting before results | W1 |
| Table 1 notation and first-use definitions | W2 |
| Table 2 raw MAE; Table 3 names model, history and comparator | W2 |
| Classical baselines stated as first-class arms; ARIMA/ETS, nearest-neighbor, STL/MSTL and Prophet limits in Appendix M | W3 |
| Explicit comparison scope: RevIN, Dish-TS and FAN on four backbones and 100 cells | W4 |
| Second-city and mobility-only limitation in the Appendix | W5 |
To summarize, a zero-parameter hour-of-week climatology anchor, whose specification was fixed before any test result and never tuned per cell, occupies the normalization slot and beats the best of RevIN, Dish-TS and FAN in all 100 cells of a two-city, five-system, four-backbone, five-horizon demand grid. We have revised the paper for clarity, defined the notation at first use, and stated the untested classical baselines and mobility-only scope. We hope the reviewer will review the revised version and reconsider the score.
Response to Reviewer vb6a
We thank the reviewer for the report. The report raises no separate questions, so the answers below address the weaknesses in the reviewer's order, followed by the changes and a short summary.
Answers to weaknesses
W1. The paper is hard to read; it is very hard to understand what was done from the abstract, and the rest of the paper is similarly ambiguous.
The abstract now states the task, the mechanism, and the main evidence in that order. The paper defines the forecasting problem before any results: spatial units u = 1..U, hourly demand y_{u,t}, a 168-hour input window, five horizons, and a normalization slot that transforms the input and reverses the transform at the output. Section 3 gives the three-step interface, Section 4 opens with a roadmap, and per-cell detail is in the Appendix.
W2. Novel and ambiguous terms are used without clear definitions, and empirical evidence is provided without defining what is being discussed.
Table 1 defines the notation used in the method and experiments. Terms are defined at first use. "Climatology" is a per-unit hour-of-week mean estimated from the training split, not a meteorological quantity. "Matched-anchor residual gain", "static anchor" and "origin-frozen rolling anchor" are defined where they first appear; "cell group" in Section 4.3 means a system-by-backbone-by-horizon cell aggregated over seeds. Table 2 reports raw MAE for the recommended arm and the best learned normalizer, so each percentage can be checked against the values it summarizes. Table 3 names the model, the anchor history, and the comparator.
W3. Classic forecasting methods also handle non-stationarity and seasonality. It would have been interesting to see how they compare, and the paper lacks an extensive comparison with state-of-the-art methods.
Seasonal naive and the climatology floors are the classical seasonal baselines for hourly periodic demand. They are first-class arms in the floor contest, and the paper now foregrounds them as such. Per-unit ARIMA and ETS models were not run; the same applies to nearest-neighbor seasonal baselines, STL/MSTL residuals, and Prophet. Appendix M states these limits explicitly. The paper does not claim that the comparison covers every classical method. The learned state-of-the-art set is RevIN, Dish-TS, and FAN, the per-instance normalization methods this paper studies; that scope is now stated rather than implied.
W4. The paper lacks an extensive comparison with state-of-the-art methods.
The comparison covers RevIN, Dish-TS, and frequency-adaptive normalization on four backbones: GRU-64, DLinear, PatchTST, and iTransformer. It spans 100 system-by-backbone-by-horizon cells in two cities, with five seeds, a five-seed variance screen, week-block bootstrap intervals and Holm-corrected tests within each system-backbone block. The periodicity-aware comparator is the strongest available test of the claim, because it is a learned normalizer built for the periodic structure the anchor captures. The paper states this scope and does not imply a broader benchmark sweep.
W5. The benchmarks are limited to mobility data.
This is an explicit limitation in the Appendix. The evidence covers five hourly urban-demand panels in New York and Chicago; Chicago is the only second-city test. The paper makes no claim that the result transfers to electricity, traffic, weather, or exchange-rate panels. It bounds the family-level reading of the result accordingly.
What we have done to improve