- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces NSTime for long-horizon time-series forecasting. The method applies a recursive moving-average decomposition to obtain a smoothed background and a hierarchy of detail residuals. The authors evaluate NSTime on 11 benchmark datasets and demonstrate its effectiveness.
Critical strengths
1.NSTime offers a new perspective on addressing non-stationarity through amplitude and phase modeling, an approach overlooked by previous work.
2.NSTime achieves strong or competitive forecasting performance across the 11 benchmark datasets.
Critical weaknesses
1.Although the paper aims to address non-stationarity through amplitude and phase modeling, the theoretical analysis and experimental evidence do not yet sufficiently establish why this formulation is more effective than existing approaches. The connection between the proposed mechanism and the observed improvements could be demonstrated more convincingly.
2.NSTime appears closely related to CycleNet, particularly in its use of cyclic structure and residual forecasting. Although NSTime introduces explicit amplitude–phase modeling and additional architectural components, its distinctive contribution relative to CycleNet could be explained more clearly. Moreover, Table 6 shows comparable performance between the two methods in several settings. While the controlled comparison with CycleNet is helpful, the authors should further clarify the methodological differences and identify the conditions under which NSTime provides meaningful advantages.
Questions for authors
1.Table 1 would be more appropriately placed in Section 4, alongside the experimental results, rather than in Section 3.
2.Table 1 contains two consecutive rows of MSE/MAE labels. Please remove the duplicated header.
3.The input length is fixed at in the main comparisons. However, some methods, such as DLinear, can benefit from longer input sequences. Although Appendix G includes an input-length study on Electricity, extending this study to other datasets and additional baselines, such as DLinear and PatchTST, would help establish whether NSTime’s advantages persist with longer inputs.
4.The experiments do not include the commonly used Traffic dataset. I suggest adding comparative results on this dataset to complement the existing PEMS experiments and facilitate comparison with previous studies.
5.The paper proposes NSTime to address non-stationarity. Could the authors clarify how non-stationarity is defined in this work and how NSTime’s ability to address it is evaluated? What evidence supports this claim beyond improvements in forecasting accuracy?
14 comments
Response to Reviewer KcTc
All runs use a 96-step input and a 720-step forecast horizon. The table reports the mean ± sample standard deviation across three runs per configuration.
| Dataset | Direct Template | NSTime | Mean | Direct Template | NSTime | Mean |
|---|---|---|---|---|---|---|
| MSE | MSE | Reduction | MAE | MAE | Reduction | |
| ETTm2 | 0.4007 ± 0.0085 | 0.3860 ± 0.0026 | 3.7% | 0.3967 ± 0.0065 | 0.3910 ± 0.0010 | 1.44% |
| Weather | 0.3457 ± 0.0021 | 0.3383 ± 0.0042 | 2.1% | 0.3460 ± 0.0026 | 0.3423 ± 0.0015 | 1.07% |
Full achieves lower MSE in all six paired runs. These results show that explicit amplitude–phase synthesis improves forecasting in the tested settings, and that the gains cannot be explained solely by increasing the number of generators or trainable parameters.
Forecast diagnostics further connect the amplitude–phase structure to the observed improvements. In the harmonic analysis in Appendix E (pp. 23–25, Fig. 6 on p. 25), we fit harmonics to the final forecast and the observed future at the same frequency selected from the input history and on the same time grid. This diagnostic uses Direct Waveform, a different control from Direct Template above, and reports results for random seed 2024. On ETTm2, Full reduces amplitude MAE from 0.0874 to 0.0774 and circular phase MAE from 28.4° to 22.0°.
The drift-stratified experiments further examine the forecasting contribution of each modulation field (Sec. 4.2, Table 3 and Figs. 3–4). For 720-step forecasting on ETTm2, Full reduces MSE by 5.50% relative to w/o Amp in the highest amplitude-drift group and by 4.36% relative to w/o Phase in the highest phase-drift group. The corresponding reductions on Electricity are 0.21% and 0.38%, indicating that the magnitude of the benefit varies across datasets.
Together, the module ablations, matched synthesis comparison, harmonic diagnostics, and drift-stratified experiments support the forecasting value of explicitly modeling amplitude–phase-induced, structured second-order variation within recurring components and specifying how amplitude and phase jointly generate the waveform.
Response to Reviewer KcTc
W2.
Thank you for pointing out that we should explain the distinction from CycleNet more clearly. Circular linear interpolation makes CCTG's lookup piecewise differentiable with respect to real-valued channel offsets. This allows the model to learn fractional shifts relative to the cyclic template through backpropagation. For example, at inference, if the current cycle index is 12 and the learned offset is sampling steps, CCTG queries and interpolates between entries 12 and 13 with weights of 0.65 and 0.35, respectively. RCF reads entry 12 directly. This sub-sample alignment helps track local fluctuations in the recurring waveform, particularly where it rises or falls sharply. Figure 9 visualizes the structured components produced by NSF and illustrates changes in amplitude envelope and timing within recurring patterns.
In the controlled comparison within CycleNet (Table 4), replacing integer RCF lookup with CCTG lowers MSE in 14 of 16 settings and ties in the other two. This comparison tests the combined effect of circular interpolation and learned channel offsets.
We also compare the two lookup rules within NSTime on Weather, Electricity, and Traffic. In the RCF variant below, integer lookup generates the amplitude and phase fields while the decomposition, AM–PM synthesis, and residual predictors are retained. The Full NSTime column is the matched reference for each row. Replacing CCTG with RCF raises MSE in all 12 settings.
| Dataset | Horizon | RCF | CCTG | MSE reduction | RCF | CCTG | MAE reduction |
|---|---|---|---|---|---|---|---|
| MSE | MSE | MAE | MAE | ||||
| Weather | 96 | 0.159 | 0.155 | 2.52% | 0.204 | 0.201 | 1.47% |
| Weather | 192 | 0.208 | 0.203 | 2.40% | 0.249 | 0.248 | 0.402% |
| Weather | 336 | 0.264 | 0.259 | 1.89% | 0.290 | 0.287 | 1.03% |
| Weather | 720 | 0.345 | 0.343 | 0.580% | 0.343 | 0.344 | -0.292% |
| Weather | Avg | 0.244 | 0.240 | 1.64% | 0.272 | 0.270 | 0.552% |
| Electricity | 96 | 0.137 | 0.135 | 1.46% | 0.233 | 0.230 | 1.29% |
| Electricity | 192 | 0.156 | 0.150 | 3.85% | 0.249 | 0.244 | 2.01% |
| Electricity | 336 | 0.173 | 0.168 | 2.89% | 0.266 | 0.266 | 0.00% |
| Electricity | 720 | 0.211 | 0.208 | 1.42% | 0.304 | 0.303 | 0.329% |
| Electricity | Avg | 0.169 | 0.165 | 2.36% | 0.263 | 0.261 | 0.856% |
| Traffic | 96 | 0.391 | 0.385 | 1.53% | 0.274 | 0.271 | 1.09% |
| Traffic | 192 | 0.404 | 0.397 | 1.73% | 0.275 | 0.273 | 0.727% |
| Traffic | 336 | 0.414 | 0.407 | 1.69% | 0.281 | 0.280 | 0.356% |
| Traffic | 720 | 0.452 | 0.444 | 1.77% | 0.300 | 0.298 | 0.667% |
| Traffic | Avg | 0.415 | 0.408 | 1.69% | 0.283 | 0.281 | 0.708% |
These results demonstrate the effectiveness of CCTG. A plausible explanation for the comparable performance in several settings of Table 6 is that integer cyclic templates already capture the recurring waveform well, leaving limited additional benefit from finer alignment and explicit amplitude–phase modulation. CCTG is expected to provide greater benefits when predictable amplitude variations and temporal alignment differences are inadequately represented by the existing cyclic template.
Q1.
Thank you for pointing this out. LaTeX’s float placement put Table 1 in Section 3 of the original submission. We have moved it to Section 4 of the revised manuscript, alongside the experimental results.
Q2.
Thank you for catching this. We have removed the duplicate MSE/MAE header row from Table 1 in the revised manuscript.
Response to Reviewer KcTc
W1.
Re. Thanks. We focus on structured second-order non-stationarity within recurring components. Representative existing methods address non-stationarity through statistical calibration or latent dynamics. For example, Non-stationary Transformers handle statistical changes through series stationarization and de-stationary attention, while Koopa distinguishes time-variant from time-invariant dynamics. From their formulations, these methods do not jointly express amplitude variation, temporal alignment variation, and their second-order statistical effects through an explicit waveform generation structure.
Equation (3) in the revised Sec. 3.1 characterizes this structure. Consider the harmonic process
\qquad \Theta\sim\mathrm{Unif}[0,2\pi).$$ Here, $A(t)\geq 0$ and $\phi(t)$ are deterministic functions, and a single random phase $\Theta$ is shared across time. Its second-order statistics are $$\operatorname{Var}[h(t)]=\frac{1}{2}A(t)^2,$$ $$\operatorname{Cov}[h(t),h(t+\tau)] \\ = \\ \frac{1}{2}A(t)A(t+\tau) \\ \cos\left(\omega\tau+\phi(t+\tau)-\phi(t)\right).$$ Even when the carrier frequency is fixed, amplitude variation can make the variance depend on temporal position, while changes in amplitude products or phase increments can make the covariance at a fixed lag depend on temporal position. In particular, even with constant amplitude, mean, and variance, changing phase increments can still make the covariance time-dependent. Thus, this form of non-stationarity has an identifiable amplitude–phase origin, and calibrating the mean and variance alone is insufficient to fully characterize its variation. **NSTime explicitly represents this structure and its generation mechanism.** When a recurring waveform is learned directly, changes in magnitude and temporal position are jointly encoded in waveform values, leaving their separation and interaction implicit. NSTime separately parameterizes amplitude and phase fields for each detail component on the continuous cyclic coordinates provided by CCTG, then generates the waveform through the AM–PM synthesis in Eq. (16). This gives oscillation magnitude and temporal alignment distinct modeling variables and explicitly specifies how they jointly change the waveform. The cyclic fields represent amplitude–phase structure that recurs by cycle position, while the residual predictor uses historical observations to compensate for window-specific deviations. This modeling structure is directly related to forecasting error. Equation (4) shows that, for predicted and target harmonics sharing the same carrier and the same random phase, phase mismatch contributes $$A\widehat A\left[1-\cos(\Delta\phi)\right]$$ to the expected squared error. Thus, with other factors held fixed, the error caused by a given phase mismatch increases with the product of the predicted and target amplitudes. AM–PM synthesis incorporates this interaction between magnitude and temporal alignment directly into waveform generation, providing a targeted representation of the structured non-stationary component described above. The matched synthesis comparison below evaluates the forecasting benefit of this modeling choice. **The NSF module ablation directly tests the forecasting contribution of this structure.** The *w/o NSF* variant retains the residual forecasting path while removing NSF’s structured AM–PM path. Table 10 in Appendix D.1 (p. 23) shows that removing NSF increases MSE in all 12 dataset–horizon settings across ETTh1, ETTm1, and Weather, with a mean relative increase of **6.50%** over Full. Fixing the amplitude to one (*w/o Amp*) or setting phase modulation to zero (*w/o Phase*) increases MSE by **2.77%** and **2.67%** on average, respectively. These ablations show that NSF’s explicit amplitude–phase structure provides additional forecasting gains beyond the residual forecasting path. **A matched comparison further examines the contribution of the amplitude–phase synthesis rule.** Full NSTime and **Direct Template** use the same two CCTGs, the same number of trainable parameters, the same cyclic lookup operations, and the same initial waveform values at the sampled cycle positions. Direct Template adds the two generator outputs directly. Full instead applies Softplus to one output to determine the amplitude, uses the other to modulate the carrier phase, and generates the waveform through AM–PM synthesis.