- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes STGFM for multi-series electricity load forecasting. A cross-series Transformer constructs input-dependent weights that compress historical loads into time-indexed global factors. Mamba encodes their history, and known future calendar covariates help generate factor forecasts. A conditional decoder then combines these forecasts with historical series context, static statistics, and forecast-step information to recover individual load trajectories. Experiments cover two datasets and four horizons, with five runs per stochastic setting. The reported RMSE gains are promising, particularly at longer horizons on the selected UCL panel.
Critical strengths
-
The design addresses a useful tension between shared dynamics and differences among individual load series. Factor construction preserves the historical time axis, while reconstruction uses series context and forecast-step information to adapt the common representation (Sections 3.2–3.3). The paper also clearly distinguishes weights that adapt across forecasting windows from weights that remain fixed within each window. This makes the approach easy to understand and gives a concrete way to combine shared and individual information.
-
The forecasting results are encouraging and the comparison tables are reasonably transparent. STGFM has lower mean RMSE than the evaluated learned baselines at all eight dataset–horizon settings. On UCL, its RMSE reductions relative to the strongest reported baseline at 48 and 96 hours are 21.3% and 16.4% (Tables 4–5). The paper reports five-seed variation, includes seasonal forecasting, and acknowledges the settings where another method has lower MAE or Seasonal Naive performs better. The conditional decoder also improves mean RMSE and MAE over the shared MLP in all eight ablation settings.
Critical weaknesses
-
The closest comparisons and the baseline protocol are incomplete. Section 2 discusses Deep Factors, DeepGLO, and SOFTS, which also combine shared structure with series-specific prediction, but none is evaluated in Tables 4–5. The experiments therefore leave the benefit over a close factor or series-core alternative unresolved. Sections 4.2–4.4 also do not specify the method-specific input mappings or explain whether calendar covariates, observation masks, and static statistics are available to each baseline. The scope of context-length selection, the training objective, and architecture-specific tuning is unclear. Using the same datasets, horizons, and chronological test protocol does not establish comparability on these points. A complete configuration account and a comparison with a close alternative would help determine whether the gain follows from the proposed decomposition, additional information, or model selection. This is a central gap because the paper's contribution is the way it organizes shared and individual information.
-
The decoder ablation does not clearly isolate conditional modulation. The proposed decoder receives historical context, static statistics, calendar covariates, and step embeddings through Equations (11)–(14), whereas Section 4.5 only describes the replacement as a shared MLP. Its retained inputs and parameter count are unspecified. The consistent improvement over this variant supports the tested decoder configuration, but does not separate modulation from access to additional information or capacity. The dynamics results also support a narrower interpretation: the LSTM variant has lower mean RMSE in six of eight settings, including 981.4 ± 90.5 versus 1104.6 ± 69.2 at UCL 96 hours (Table 3). These are reported means and standard deviations, not evidence of statistical significance. The authors already acknowledge horizon-dependent component effects; the remaining issue is which controlled comparison supports each mechanism. A decoder comparison with the same conditioning inputs and comparable capacity would directly address the strongest attribution concern. These two evidence gaps keep my recommendation just below the acceptance threshold.
Questions for authors
-
What calendar covariates, observation masks, and static series information does each baseline receive? Are context lengths, training objectives, and tuning budgets shared or selected separately? Please provide the configurations used in Tables 4–5.
-
Which historical, static, calendar, and forecast-step inputs does the shared-MLP decoder retain, and what are its parameter count and that of the proposed decoder? Are the Mamba and LSTM ablations also matched in capacity and tuning?
-
Were Deep Factors, DeepGLO, or SOFTS tested under the same protocol? If results already exist, which comparison best separates the contribution of adaptive time-indexed factors from shared structure and series-specific prediction?
-
Are the raw mean and zero-value ratio in Section 4.2 computed from training data only? Does the selection of the 64 UCL series use training-only coverage and activity or the complete time span?