- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PhaseAlign proposes stage-dependent phase modeling for long-term time-series forecasting. A channel-independent model extracts a shared complex-spectrum representation from each observed window, uses relative harmonic relations to guide historical attention, and propagates window-referenced phase to condition future queries. Time–frequency interaction and local temporal modeling complement these operators. The paper reports competitive results on seven benchmarks, including Electricity, and evaluates its hypothesis through unified-phase controls, component ablations, repeated runs, and phase-shift, frequency-drift, and off-grid experiments.
Critical strengths
- A clear and testable architectural hypothesis. Distinguishing relative harmonic compatibility in historical attention from phase-referenced future conditioning provides an interpretable design rationale. The paper carefully limits its invariance argument to the dedicated operators rather than asserting exact invariance or equivariance of the entire network. This makes the proposed mechanism concrete enough to analyze and test.
- Evaluation extends beyond benchmark accuracy. The reported experiments cover seven datasets and multiple horizons, with repeated runs and targeted controls. The unseen relative-phase experiment and distortion-matched phase/magnitude interventions examine temporal placement more directly than aggregate forecasting metrics alone. These experiments could provide meaningful support for the hypothesis if their implementation and provenance are reconciled.
Critical weaknesses
-
The central stage-dependent claim is only partially justified. Equation (1) explains phase cancellation and propagation for fixed-frequency harmonics, but does not establish why historical modeling should favor relative phase while future generation should favor absolute phase. The mathematical argument motivates a plausible design; stronger controlled evidence is needed to support its claimed advantage over unified alternatives.
-
Method–implementation inconsistencies weaken the attribution of the reported gains. The phase-form controls are described as preserving a common positional backbone, yet the supplied implementation also changes generic positional encoding. Likewise, the alignment objective is described as regularizing the forecasting encoder, but instead operates on separate auxiliary representations. Differences in the spectral loss and the use of seasonal correction further complicate interpretation. These discrepancies need to be reconciled before the ablations and auxiliary-objective gains can substantiate the paper's explanation.
-
The drift results do not establish retained predictive utility under severe nonstationarity. In Table 14, PhaseAlign reaches MAE=0.7302 under the strongest drift. Under the stated clean, unit-amplitude generator with uniform random phase, a zero forecast has theoretical population MAE 2/π≈0.6366. Although the exact test-set comparison remains necessary, this raises the possibility that the reported advantage reflects smaller degradation among failing models rather than effective phase tracking.
-
Periods longer than the observation window remain an important untested boundary. The method derives its phase trajectories from the window's discrete Fourier grid, making the adaptive phase features periodic with the input-window length. Its ability to support forecasting when the true period greatly exceeds that window is therefore unclear. The synthetic studies mainly use roughly 24-step oscillations with a 96-step history and do not examine this regime.
-
Validation of the mechanism is narrower than validation of overall accuracy. Electricity provides high-dimensional benchmark evidence, but the real-data stage-specific ablations are restricted to ETTh1, ETTh2, and Exchange. It remains unclear whether the same mechanism explains the gains on higher-dimensional datasets. The robustness probes also focus on simple harmonic processes, leaving stronger, more heterogeneous nonstationarity insufficiently characterized. It is suggested that the authors include performance results on high-dimensional datasets, such as Traffic and PEMS, to further demonstrate the method's generalization capability.
Questions for authors
-
Which exact code revision and commands generated the main tables? Please reconcile the output shape and label broadcasting, the phase-loss definition, and the mixed-loss/seasonal-blending recipes with the manuscript.
-
Did the reported phase-form controls retain RoPE, and did the alignment loss backpropagate into the main encoder? Please provide the corresponding implementation and matched results, particularly for Appendix A.2 and Table 23.
-
On the exact Table 14 test sets and evaluation scale, how do zero/mean prediction and a phase-disabled control perform? Does PhaseAlign retain an advantage when judged against these baselines, rather than only against the other trained models?
-
How does the stage-dependent benefit change as the dominant period exceeds the input window, and does it persist in matched controls on Electricity? A focused period/window-ratio sweep and a high-dimensional control experiment would materially affect my assessment.
3 comments
Response to Reviewer qmHZ (Part 2/2)
W4 / Q4(a) — Period-to-window ratio and complementary future-query modeling.
We thank the reviewer for this insightful question. Importantly, PhaseAlign does not rely solely on FFT-derived phase extrapolation. As defined in Eqs. (8)–(10), future queries combine adaptive phase features with learned horizon queries and deterministic Fourier features, while retrieving historical context through cross-attention. Thus, the -periodicity of FFT-grid phase features does not impose the same constraint on the complete decoder.
We further evaluate frequency estimation across different period-to-window ratios:
| Estimator diagnostic | T/L=0.5 | T/L=1 | T/L=2 | T/L=4 |
|---|---|---|---|---|
| Relative frequency error | 5.1% | 5.1% | 100% | 301% |
| Grid MAE/MAE₀ | 0.61 | 0.32 | 1.51 | 1.01 |
| 4× zero-padding + interpolation | 0.22 | 0.49 | 1.06 | 1.24 |
The results demonstrate accurate frequency estimation when sufficient periodic evidence is available, with 4× interpolation reducing normalized error by 2.77× at . More importantly, the adaptive phase trajectory operates jointly with learned horizon queries and historical context, enabling multi-source future-query construction rather than relying on direct spectral extrapolation alone.
W5 / Q4(b) — High-dimensional generalization and heterogeneous nonstationarity. We additionally examine phase-specific controls on Electricity (321 variables) and Traffic (862 variables).
| ΔMSE vs Full | ETTh1 | Electricity | Traffic |
|---|---|---|---|
| w/o RelPhase | +4.0% | +2.9% | +3.3% |
| w/o FutPhase | +4.8% | +4.4% | +4.0% |
| Unified-Rel | +2.4% | +4.8% | +4.5% |
| Unified-Abs | +3.1% | +3.1% | +3.6% |
The positive differences support the stage-dependent mechanism across different dimensionalities. Additional tests cover close frequencies, amplitude modulation, intermittent cycles, abrupt changes, non-periodic mixtures, and noise:
| Condition | Gain vs best baseline |
|---|---|
| Close frequencies (1/5/10%) | +14.2 / +11.7 / +6.9% |
| Amplitude modulation (0.2/0.5) | +9.4 / +5.1% |
| Intermittent cycles (0.3/0.5/0.7) | +8.8 / +12.3 / +10.6% |
| Abrupt changes (±π/2, ±π) | +7.2 / +3.4% |
| Non-periodic mixture (α=0/0.5/0.75/1) | +15.8 / +6.4 / +2.1 / −1.3% |
| Noise (σ=0/0.3/0.5/1.0) | +16.1 / +9.2 / +4.6 / +1.2% |
The advantage is positive in 17 of 18 conditions, gradually diminishing as periodicity weakens or noise increases. The fully non-periodic setting is the only negative case, indicating a natural limitation of the periodic inductive bias.
Thank you for the detailed rebuttal and additional experiments. While my concerns have been partially addressed, several key weaknesses remain unresolved. Therefore, I am maintaining my original score.
Response to Reviewer qmHZ (Part 1/2)
We thank the reviewer for the detailed and constructive feedback. We clarify the theoretical motivation, reconcile the implementation, and provide additional robustness analyses.
W1 — Stage-dependent phase modeling. Historical modeling compares observed positions, where the common phase origin cancels: Δθk,ij=2πfk(τi−τj). Future generation instead requires the observed phase reference: θk,h=ϕk+2πfk(L+h). Our operator-level test confirms this asymmetry: historical relative-phase sensitivity is 0.0, versus 1.998 for absolute circular coordinates at δ=π; future-placement error is 0.076 vs. 1.245, respectively. The original Table 2 further shows consistent advantages over Unified-Rel/Unified-Abs on ETTh1 (0.421/0.431/0.434), ETTh2 (0.365/0.379/0.381), and Exchange (0.343/0.360/0.365). These results support the proposed stage-dependent design without assuming network-wide equivariance.
W2 / Q1–Q2 — Implementation reconciliation. We apologize for linking an outdated development version. The reported experiments used the corrected implementation, which produces [B,H,C] predictions, preserves RoPE across phase controls, and propagates alignment gradients into the main encoder. All controls share spectral context and registered parameter capacity. The reported protocol uses MSE with λp=λa=0.1, without seasonal post-processing. We will provide the experiment-generating revision, configurations, and exact reproduction commands.
W3 / Q3 — Severe frequency drift. We confirm R4's zero-baseline observation: empirical MAE is 0.6368, consistent with 2/π≈0.6366, whereas PhaseAlign reaches 0.7302 at 4π (H=96). Additional references on the same test distribution are summarized below.
MAE ↓, H=96
Mean closely matches Zero, while seasonal-naive deteriorates under stronger drift. At 4π, PhaseAlign outperforms the stationary-extrapolation references and PhaseFormer, although its zero-reference skill is negative (−0.147). The interpolated zero-skill crossover lies around 1.55π–1.73π across horizons. We therefore interpret the severe-drift results as relative robustness rather than retained absolute predictive utility.