- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper presents Spectrum-DualNet, a dual-branch forecasting network that adaptively separates multivariate signals according to the distributions of their datasets into band-limited modes that belong to distinct frequency ranges as characteristic spectra using Multivariate Variational Mode Decomposition (MVMD). Experiments use seven long-term benchmarks and compare the performance of Spectrum-DualNet at look-back 512 against eight baselines.
Critical strengths
This paper aims to solve an important problem.
Critical weaknesses
This paper carries limited novelty. The proposed architecture combines MVMD (2019), a PatchTST encoder, APRNet's amplitude–phase attention, KAN layers and gates. The large body of VMD-based hybrid forecasting work is not discussed.
This paper claims that MVMD-derived modes are a better basis than predefined decompositions, and routing modes to domain-specific branches helps. The experiments presented in this paper cannot support such claims.
- There is no measurable gain over APRNet, whose mechanism is reused. Average MSE versus APRNet is 0.347 vs 0.348 (ETTm1), 0.253 vs 0.253 (ETTm2), 0.388 vs 0.388 (Traffic), 0.220 vs 0.223 (Weather) and 0.403 vs 0.411 (ETTh1); it is worse on ETTh2 (0.352 vs 0.336, and 0.331 for PatchTST) and Electricity (0.159 vs 0.155). All are produced through single runs without reporting variance.
- The model is trained with a weighted L1 + L2 loss whose weight is a tuned hyperparameter; most baselines are trained with MSE. On these benchmarks an L1 term alone typically lowers MAE, and the MAE margins are the larger ones in Table 1 (e.g., Weather 0.253 vs 0.262).
- Some numbers are taken from papers "with the same settings" and others reproduced, but the DLinear numbers are those of its original paper at look-back 336, not 512. Several baseline entries look erroneous: TimeKAN's Electricity MAE is 0.340 / 0.384 / 0.406 at MSE 0.137–0.165, iTransformer's Weather-96 MSE is 0.253, and DLinear's ETTh2-192 MSE of 0.283 is inconsistent with its reported average.
- The ablation contradicts the conclusion drawn from it. Table 2 (which matches the horizon-96 rows only) shows that removing the Trend branch improves Electricity (0.124 / 0.216 vs 0.127 / 0.217) and changes Weather by 0.001, yet the text states that "all the three components are essential". Removing the decomposition changes MSE by 0.003 on ETTm1, ETTm2 and Electricity. The Traffic entry for "w/o Fluctuation" (MSE 0.369, MAE 0.357) looks like an error.
- The ablations that would test the claims are absent. There is no comparison with a moving-average or fixed band-split decomposition in the same network, no swap of the two branches, no variant that gives all modes to both branches, and no ablation of the residual gate, the cross-attention, KAN versus MLP, K or α.
The proposed method does not match its description as adaptive, spectrum-guided and physically meaningful.
- The decomposition is a fixed linear filter bank. After Stage I, the model applies K fixed filters determined by K scalars per dataset and one global α. Nothing adapts to the input window and nothing in it is learned, so "differentiable" has no consequence. This is a preset band split, which is the kind of predefined structure the introduction criticizes, and it is not compared with simpler ways of choosing K bands (FFT peak picking, learnable band-pass filters).
- The lowest mode cannot be a monthly component inside the window. The reported Mode-1 periods are 10 to 35 days (and 1,000–2,500 samples on ETTm), while the window is 512 samples (about 21 days hourly, 5.3 days at 15 minutes). Within a window this mode is a low-pass of a mean-removed signal, at most one or two bins from DC, not a periodicity.
- The "physical meaning" claim is not supported by Table 3. ETTm1 and ETTm2 have the same sampling and domain but yield 21.0 h and 6.1 h versus a single mode at 3.4 h. Mode-1 periods range from 10.4 to 34.7 days and are described as "monthly". Only ETTh1, ETTh2 and Electricity show a daily mode. Weather and Traffic are not reported.
Questions for authors
Please report, per dataset: K, α, D, patch size and stride, whether the projection is enabled, the loss weight, the search space and whether selection used the validation set; and mean ± std over at least 3 seeds for Table 1 and Table 2.
What are the results with a pure MSE loss, or with APRNet, PatchTST and TimeKAN retrained with the same L1 + L2 loss and look-back 512?
Replace the MVMD filter bank with (a) a moving-average trend/seasonal split and (b) K fixed bands at the top FFT peaks of the training set, keeping everything else the same. Does MVMD matter?
6 comments
Responses to Critical Questions for Reviewer 3vvV - Weakness 2 Point 1
-
Weakness 2 Point 1.
Thank you for highlighting the close comparison with APRNet . These margins are comparable in scale to improvements reported by recent forecasting methods. For example, TimeKAN (ICLR 2025) improves average Weather MSE from 0.245 to 0.242 relative to TimeMixer, approximately 1.22%, while tying it on ETTm2. FilterNet (NeurIPS 2024) likewise reports some improvements below 1% over PatchTST.
Modest numerical margins on these established benchmarks are also reported by recent methods. For example, TimeKAN (ICLR 2025) reduces average Weather MSE from 0.245 to 0.242 relative to TimeMixer, while tying it on ETTm2; FilterNet (NeurIPS 2024) likewise reports improvements below 1% over PatchTST in some forecasting settings. These comparisons place the magnitude of our observed gains in context, although they do not establish their statistical significance. As emphasized by Hewamalage et al. (2023) in paper “Forecast evaluation for data scientists: common pitfalls and best practices”, reliable interpretation requires appropriate evaluation and statistical testing.
We also clarify that Spectrum-DualNet adapts APRNet’s bidirectional amplitude–phase cross-attention mechanism within its Fluctuation branch; it does not incorporate APRNet as a complete forecasting backbone (or use any code from APRNet in SepctrumDualNet). APRNet additionally includes temporal–channel dual-view Fourier modeling, a discrete–spline D-KAN calibration operator, and temporal–channel feature reconstruction and fusion. Spectrum-DualNet does not adopt those specific architectural mechanisms.
Dataset Horizon MSE MAE ETTh1 96 0.361 ± 0.0032 0.393 ± 0.0031 ETTh1 192 0.401 ± 0.0025 0.416 ± 0.0015 ETTh1 336 0.419 ± 0.0061 0.428 ± 0.0035 ETTh1 720 0.433 ± 0.0010 0.452 ± 0.0020 ETTh1 Avg. 0.403 ± 0.0007 0.422 ± 0.0006 ETTh2 96 0.276 ± 0.0061 0.336 ± 0.0052 ETTh2 192 0.367 ± 0.0117 0.391 ± 0.0080 ETTh2 336 0.382 ± 0.0045 0.408 ± 0.0035 ETTh2 720 0.405 ± 0.0015 0.436 ± 0.0006 ETTh2 Avg. 0.357 ± 0.0053 0.393 ± 0.0038 ETTm1 96 0.285 ± 0.0015 0.336 ± 0.0017 ETTm1 192 0.328 ± 0.0026 0.359 ± 0.0015 ETTm1 336 0.360 ± 0.0015 0.384 ± 0.0023 ETTm1 720 0.418 ± 0.0020 0.411 ± 0.0006 ETTm1 Avg. 0.348 ± 0.0018 0.373 ± 0.0002 ETTm2 96 0.163 ± 0.0015 0.251 ± 0.0021 ETTm2 192 0.221 ± 0.0021 0.291 ± 0.0021 ETTm2 336 0.273 ± 0.0021 0.326 ± 0.0012 ETTm2 720 0.358 ± 0.0006 0.381 ± 0.0010 ETTm2 Avg. 0.254 ± 0.0013 0.312 ± 0.0006 Weather 96 0.142 ± 0.0015 0.187 ± 0.0020 Weather 192 0.186 ± 0.0006 0.229 ± 0.0006 Weather 336 0.237 ± 0.0010 0.270 ± 0.0000 Weather 720 0.315 ± 0.0021 0.325 ± 0.0012 Weather Avg. 0.220 ± 0.0008 0.252 ± 0.0005 Electricity 96 0.126 ± 0.0006 0.217 ± 0.0006 Electricity 192 0.148 ± 0.0012 0.237 ± 0.0006 Electricity 336 0.162 ± 0.0006 0.253 ± 0.0006 Electricity 720 0.198 ± 0.0010 0.285 ± 0.0006 Electricity Avg. 0.158 ± 0.0004 0.248 ± 0.0001 Traffic 96 0.354 ± 0.0006 0.239 ± 0.0006 Traffic 192 0.376 ± 0.0015 0.251 ± 0.0029 Traffic 336 0.389 ± 0.0023 0.259 ± 0.0038 Traffic 720 0.427 ± 0.0012 0.281 ± 0.0023 Traffic Avg. 0.387 ± 0.0007 0.258 ± 0.0021 As the table indicated, the improvements remain statistically and practically reliable under multiple random seeds. The improvements in Table 1 are compared between best results of different models.
Responses to Critical Weaknesses for Reviewer 3vvV - Weakness 2 Point 2 - 4
-
Weakness 2 Point 2. | Dataset | Original (full model) MSE | Original (full model) MAE | Moving average MSE | Moving average MAE | Top-K MSE | Top-K MAE | Random learnable centers MSE | Random learnable centers MAE | Reversed branches MSE | Reversed branches MAE | w/o Residual MSE | w/o Residual MAE | w/o L1 loss MSE | w/o L1 loss MAE | | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | | ETTh1 | 0.360 | 0.391 | 0.367 | 0.397 | 0.380 | 0.415 | 0.416 | 0.434 | 0.371 | 0.398 | 0.374 | 0.405 | 0.365 | 0.395 | | ETTh2 | 0.269 | 0.330 | 0.278 | 0.338 | 0.298 | 0.357 | 0.296 | 0.354 | 0.305 | 0.369 | 0.285 | 0.347 | 0.277 | 0.342 | | ETTm1 | 0.284 | 0.338 | 0.287 | 0.340 | 0.293 | 0.340 | 0.297 | 0.344 | 0.292 | 0.337 | 0.295 | 0.341 | 0.289 | 0.345 | | ETTm2 | 0.162 | 0.251 | 0.164 | 0.253 | 0.166 | 0.257 | 0.169 | 0.254 | 0.167 | 0.254 | 0.167 | 0.254 | 0.165 | 0.255 | | Electricity | 0.127 | 0.217 | 0.129 | 0.220 | 0.128 | 0.219 | 0.130 | 0.223 | 0.130 | 0.220 | 0.137 | 0.234 | 0.128 | 0.221 | | Weather | 0.143 | 0.187 | 0.145 | 0.190 | 0.146 | 0.193 | 0.144 | 0.188 | 0.152 | 0.201 | 0.144 | 0.188 | 0.144 | 0.239 | | Traffic | 0.354 | 0.239 | 0.356 | 0.242 | 0.377 | 0.267 | 0.362 | 0.246 | 0.359 | 0.241 | 0.364 | 0.249 | 0.358 | 0.247 |
We agree that the mixed objective contributes to performance. However, the additional ablations indicate that the gains are not attributable to the loss choice alone. For example, on ETTh1, removing L1 increases MSE/MAE by 0.005/0.004, whereas replacing the MVMD centers with randomly initialized learnable centers increases them by 0.056/0.043, replacing decomposition with Top-K increases them by 0.020/0.024, and removing the residual increases them by 0.014/0.014. Under the same mixed objective, these architectural changes therefore cause larger degradations than removing L1 from the full model. This supports the contribution of the spectral design and residual pathway alongside the training objective.
-
Weakness 2 Point 3. As we mentioned in Experiments section Baseline paragraph “We reference the results of the models that have the same experimental settings from the papers. For models that have different experimental settings, we reproduce the model under our experimental settings”, here are the details:
APRNet – References the best results from the paper because the input and prediction configurations are the same with SpectrumDualNet.
TimeKAN – Retrained and tested using the official Github code and training scripts, with input sequence set to be 512.
Amplifier - Retrained and tested using the official Github code and training scripts, with input sequence set to be 512.
iTransformer – Referenced from the APRNet paper.
FilterNet - Referenced from the APRNet paper.
PatchTST - References the best results from the paper because the input and prediction configurations are the same with SpectrumDualNet.
DLinear - Referenced from the APRNet paper.
-
Weakness 2 Point 4. The electricity dataset (also known as ECL) includes hourly electricity consumption data from 370 clients, providing insights into consumer-level load patterns. Compared with other datasets, the electricity provides a microcosmic perspective as it records data from individual clients. Thus, the trend of the electricity dataset could be vulnerable but the fluctuations could be robust, and that makes the trend branch defect the predictions.
We double checked our logs and updated the Traffic entry in Table 2, thank you for pointing this error out. The table below provides the full ablation study results of the Fluctuation branch using the traffic dataset.
Horizon MSE MAE 96 0.357 0.242 192 0.378 0.252 336 0.397 0.268 720 0.436 0.284
Responses to Critical Weaknesses for Reviewer 3vvV - Weakness 1
Our contribution concerns how spectral decomposition organizes the forecasting architecture, rather than introducing these individual components. Specifically, Spectrum-DualNet couples dataset-level spectral estimation, consistent window-level extraction, and frequency-based branch assignment. Stage I estimates shared center frequencies from the training sequence. Stage II reuses these centers in a differentiable sequential filtering pass, providing a consistent spectral basis across input windows. The resulting frequency ordering determines the modeling mechanism: the lowest-frequency component enters a time-domain branch, while the higher-frequency components enter a frequency-domain branch. A separate residual gate makes content outside the extracted components available for prediction. This coupling is the intended methodological contribution.
The separation between dataset-level estimation and window-level processing also addresses a practical issue: some characteristic timescales exceed the input-window length, making their frequencies difficult to estimate independently within each window (As you observed, the reported lowest-frequency periods can exceed the 512-sample context, particularly on ETTm, where a window spans approximately 5.3 days). Estimating centers over the longer training sequence supplies a shared spectral prior, while the window-level outputs represent local slow and oscillatory variation. This design supports consistent branch specialization without repeatedly optimizing MVMD for every window.
We added extra discussion about VMD-based hybrid forecasting methods in the Related Work section, please check the revised paper for the corresponding content. However, to the extent of our knowledge, current VMD-based hybrid forecasting methods primarily focusing on a specific domain rather working as a general-purpures time series forecaster (like Spectrum-DualNet). For example, NA-MVMD-iTransformer-DDQN model proposed by paper "Power Load Forecasting Using Deep Learning and Reinforcement Learning" focusing on power load forecasting; CEDV-TCN-GTAF proposed by "A Frequency-domain Decomposition and TCN-GTAF Fusion Framework for GNSS Sequence Forecasting" is for Global Navigation Satellite System time series.