- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes GLNet, a lightweight dual-stream forecasting model combining EMA decomposition, hierarchical patching, linear global mixing, and convolutional local refinement. The model achieves competitive results on several long- and short-term forecasting benchmarks.
Critical strengths
The architecture is simple and computationally efficient. The experiments cover multiple datasets, and the results are generally competitive with recent baselines.
Critical weaknesses
The main concern is that the central “decomposition leakage” story is not empirically validated. Figure 1 only illustrates that imperfect decomposition may occur, but the paper does not quantify leakage or demonstrate that GLNet reduces it. In particular, removing activations and using a 1×1 convolution does not necessarily make GLB* a low-pass filter, as claimed.
The novelty over xPatch also appears limited. Both methods use EMA decomposition, channel independence, patching, and separate trend and seasonal flows. GLNet mainly replaces the branch operators with a linear-convolutional block. The current ablations show that the components improve performance, but do not establish that the gains arise from handling decomposition leakage. Direct comparisons with xPatch-style variants, frequency-response analyses, and linear-only/convolution-only ablations are needed.
Finally, GLNet uses dataset- and horizon-specific architecture and lookback-window tuning, while the equivalent tuning budget for the baselines is unclear. Several improvements over xPatch are small or statistically insignificant. The efficiency discussion should also acknowledge that the inter-patch operation remains quadratic in the number of patches.
Overall, GLNet appears to be an effective engineering design, but the evidence does not sufficiently support its central mechanism or establish enough novelty for ICLR.
Questions for authors
How is “decomposition leakage” quantitatively defined and measured? Can the authors provide direct evidence that GLNet reduces such leakage, for example through frequency-response analysis or an ablation that incrementally replaces the corresponding xPatch components with GLB and GLB*?
2 comments
Q4: Novelty, tuning, significance, and complexity
The architectural difference from xPatch is that xPatch assigns a patch-CNN to the seasonal stream and an MLP to the trend stream, while GLNet applies the same dimension-agnostic GLB first along the intra-patch axis and then along the inter-patch axis , and uses an activation-free variant in the trend flow. The parameters are smaller: 1.03–1.46M versus 1.65–2.13M for native xPatch. The component/activation ablations above show the gains are not due to capacity.
The per-horizon deltas show where the mean advantage comes from.
Table R2. Per-horizon difference (xPatch minus GLNet), MSE / MAE. Positive is better for GLNet.
| Dataset | H=96 | H=192 | H=336 | H=720 | Avg |
|---|---|---|---|---|---|
| Weather | +0.003 / +0.001 | +0.003 / 0.000 | +0.004 / −0.002 | +0.006 / +0.002 | +0.004 / 0.000 |
| Traffic | +0.004 / −0.019 | +0.008 / −0.012 | +0.003 / −0.022 | +0.011 / 0.000 | +0.007 / −0.013 |
| Electricity | +0.006 / +0.003 | +0.001 / 0.000 | 0.000 / +0.001 | −0.003 / −0.006 | +0.001 / −0.001 |
| ETTh1 | +0.007 / +0.002 | +0.008 / +0.002 | +0.008 / +0.003 | +0.017 / +0.007 | +0.010 / +0.004 |
| ETTh2 | +0.010 / +0.003 | +0.009 / +0.004 | +0.009 / +0.005 | +0.006 / +0.002 | +0.008 / +0.004 |
| ETTm1 | −0.002 / −0.004 | −0.001 / +0.001 | 0.000 / +0.001 | +0.011 / +0.008 | +0.002 / +0.001 |
| ETTm2 | +0.004 / +0.002 | +0.007 / +0.002 | +0.006 / +0.001 | +0.007 / +0.001 | +0.006 / +0.002 |
| Solar | +0.010 / +0.015 | +0.010 / +0.011 | +0.018 / +0.015 | +0.018 / −0.001 | +0.014 / +0.010 |
GLNet is lower on MSE in 27 of 32 dataset–horizon cells (two ties, three losses) and on MAE in 22 of 32 (three ties, seven losses). The misses are concentrated on Traffic MAE, Electricity H=720, and ETTm1 H=96/192.
The tuning protocol uses validation selection: all GLNet configurations, including the per-dataset/horizon depths and lookbacks in Table 4, were selected on the validation split; the test split was used once. Baselines were re-run over the same lookback grid; xPatch additionally uses its official batch/learning-rate search. GLNet's architecture search space is larger than the baselines' published defaults.
The significance picture is mixed. Table 8 shows that the MSE differences over xPatch are not significant on ETTm1 () or Electricity (); the MAE differences are not significant on Weather (), ETTh2 (), ETTm1 (), or Electricity (). On Traffic, xPatch has lower MAE (0.251 vs. 0.264), and SimpleTM has lower MSE (0.387 vs. 0.389). The manuscript's claim is "leading mean forecasting accuracy"; it does not claim GLNet is SOTA, and we will state these exceptions explicitly.
The inter-patch linear layer costs , with . It is quadratic in the number of patches. Patching shortens the constant and effective sequence length; the inter-patch term stays quadratic, so GLNet and patch-level attention have the same asymptotic order. We will state this explicitly in Section 4.3 and Appendix A. The measured model cost is below; latency is normalized by channel count because one forward pass processes all variates.
Table R3. Model-only cost at H=336, batch 32, H100.
| Dataset (H=336) | Params | FLOPs | Latency | ms / 1k channels |
|---|---|---|---|---|
| ETTh1 | 1.03M | 0.529 G | 1.53 ms | 218 |
| ETTh2 | 1.03M | 0.529 G | 1.53 ms | 218 |
| ETTm1 | 1.22M | 0.809 G | 1.39 ms | 199 |
| ETTm2 | 1.46M | 1.051 G | 1.86 ms | 266 |
| Weather | 1.18M | 1.905 G | 1.05 ms | 50 |
| Electricity | 1.20M | 30.64 G | 6.05 ms | 19 |
| Traffic | 2.35M | 252.07 G | 53.76 ms | 62 |
| Solar | 1.43M | 15.06 G | 3.22 ms | 24 |
Batch 32, H100, 20 warmup + 100 timed iterations, no data loading. Raw latency grows with channel count; per-channel cost is lowest on Electricity and Solar and highest on the ETT sets.
Q1: How is leakage defined and measured?
Leakage is not an identifiable natural rate; we measure the model's sensitivity to a controlled, information-preserving reassignment of the decomposed components. Table R1 gives the result.
Table R1. Seasonal-to-trend LSS (%, lower is better) at λ=0.5; G/X = native GLNet/native xPatch; seed 2021, full test set, native configuration.
GLNet's average LSS is lower at all three horizons and lower on 10 of 15 dataset–horizon comparisons; the relative reductions are 26%, 33%, and 19%. The result is not uniform: xPatch is better on ETTh1 at all three horizons and on ETTh2 at H=96/192.
We define leakage as the cross-band content left by EMA. For smoothing factor α,
H_S(e^{j\omega})=1-H_T(e^{j\omega}).$$ At the paper's $\alpha=0.3$, $|H_T|$ is $1.000,0.424,0.246,0.191,0.176$ at $\omega/\pi=0,1/4,1/2,3/4,1$. Nyquist-frequency content therefore still enters the trend branch with 17.6% amplitude. EMA creates this cross-band content; GLNet inherits it. Because the latent clean components are unknown, a natural leakage rate cannot be identified. We use a controlled, information-preserving reassignment instead: $$X_S^\lambda=(1-\lambda)X_S,\qquad X_T^\lambda=X_T+\lambda X_S,$$ which keeps $X_S^\lambda+X_T^\lambda=X_S+X_T=X$. Each model is trained on the clean decomposition ($\lambda=0$) and frozen; the same checkpoint is evaluated on clean and routed inputs. We report $$\operatorname{LSS}_m(\lambda)=100\cdot \frac{\operatorname{MSE}_m(X_S^\lambda,X_T^\lambda)-\operatorname{MSE}_m(X_S,X_T)} {\operatorname{MSE}_m(X_S,X_T)}.$$ Lower LSS means the forecast changes less when the same input content is reassigned. ## Q2: Direct evidence and the missing ablations The direct evidence is Table R1: under the same reassignment, xPatch's average LSS is 11.03/6.95/4.35 at H=96/192/336; GLNet's is 8.16/4.66/3.51. The missing component/activation ablations point the same way: full GLNet has the best five-dataset average, and adding GELU to GLB* hurts that average. | Variant | ETTh1 | ETTh2 | ETTm1 | ETTm2 | Weather | Avg | |---|---:|---:|---:|---:|---:|---:| | Full GLNet | 0.3901 / 0.4103 | 0.3157 / 0.3674 | 0.3550 / 0.3771 | 0.2580 / 0.3160 | 0.2181 / 0.2610 | **0.3074 / 0.3464** | | GLB linear-only | 0.3922 / 0.4129 | 0.3176 / 0.3703 | 0.3651 / 0.3827 | 0.2657 / 0.3204 | 0.2228 / 0.2648 | 0.3127 / 0.3502 | | GLB conv-only | 0.3917 / 0.4125 | 0.3145 / 0.3669 | 0.3544 / 0.3773 | 0.2607 / 0.3183 | 0.2245 / 0.2663 | 0.3092 / 0.3483 | | Trend GLB* + GELU | 0.3909 / 0.4107 | 0.3172 / 0.3680 | 0.3539 / 0.3770 | 0.2611 / 0.3196 | 0.2271 / 0.2692 | 0.3100 / 0.3489 | Across the five datasets the full configuration has the best average (0.3074 vs. 0.3092–0.3127). Linear-only is worse on every dataset; conv-only is worse on ETTh1, ETTm1, ETTm2 and Weather and 0.001 lower on ETTh2. Adding GELU to GLB* raises the average to 0.3100 and hurts Weather most (0.2271 vs. 0.2181 MSE). Cell-level differences are 0.001–0.002. Removing only the trend-flow singleton convolution is neutral or slightly better on ETTh1 (0.3866/0.4083 vs. 0.3901/0.4103), consistent with the seasonal convolution being the meaningful local operator. ## Q3: GLB* is not a low-pass filter We agree. In the trend flow the convolution operates on a singleton axis, so it is a per-channel scalar. With the activation removed, GLB* is a residual LayerNorm followed by two dense linear maps. A dense linear map can realize any frequency response, including high-pass; a 1×1 convolution and the removal of activations impose no cutoff. The only explicit low-pass stage is the EMA decomposition. We will replace "strict low-pass filter" and "complete defense against leakage" in Section 3.5 with "activation-free global trend operator," and remove the Section 4.2 sentence that attributes the attention variant's degradation to a lost low-pass property. We keep GLB* because the activation ablation supports it (Weather 0.2271 with GELU vs. 0.2181 without).