- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PhiMixer uses forecast-origin phase to condition temporal and cross-channel processing for multivariate time-series forecasting. It combines cyclic decomposition, FiLM modulation, rhythm-aware relative attention, STAR-style aggregation, and a Phase-Informed Low-Rank Channel Mixer, followed by a dual-path prediction head. Experiments cover twelve datasets, with component, phase, loss, sensitivity, and efficiency analyses.
Critical strengths
- Forecast-origin phase provides information about recurring temporal patterns that may not be clear from the observed window alone. Using this information to condition forecasting operations is relevant to periodic data such as electricity consumption and traffic.
- The model uses shared processing and global aggregation to keep inference cost linear in the number of channels. Its parameter count is relatively small under the standard ETTh1 configuration.
- The evaluation covers twelve datasets and multiple prediction horizons. The component, phase, and loss ablations provide evidence that several parts of the model contribute to its performance.
Critical weaknesses
- The released code does not implement the experiment described in the paper. The training script uses plain MSE instead of the stated composite objective, and the data loaders return only inputs and targets while the training loop requires an additional forecast-origin index. The provided entry point therefore cannot consume its own batches, and the central phase-conditioning pipeline is incomplete for real data. This release is insufficient to reproduce or verify the reported results.
- The released data pipeline contradicts the stated evaluation protocol. Validation and test boundaries subtract the lookback length twice, causing prediction targets to overlap the preceding split. At L=H=96, the first ETTh validation sample exactly duplicates the final training-set sample, including its target. This is an evaluation defect. The authors need to identify the code version used for the tables and establish that those results were obtained with correctly separated targets.
- The methodological contribution remains insufficiently established. PhiMixer combines existing cyclic decomposition, FiLM, and aggregate-redistribute processing without a direct accuracy comparison with CycleNet. The central PILCM claim is also overstated: shared phase-conditioned projections and uniform pooling do not substantiate the claimed recovery of asymmetric channel interactions. The paper does not demonstrate a distinct modeling advance beyond this integration of established components.
- Wrapping a complete cycle can be motivated by periodicity, but RRF wraps the input window without ensuring that it spans a complete cycle. On PEMS and Weather, the windows cover only part of the stated daily cycle, yet their first and last patches are treated as neighbors. Appendix A.2 argues that attention can override this soft prior, but does not justify the assumed relationship between these window boundaries. The ablation replaces RRF with an MLP rather than removing only the circular bias, leaving the claimed rhythmic benefit of this boundary assumption unverified.
- The architecture diagram and implementation disagree on the composition of the channel modules. Figure 1 shows STARPool and PILCM in parallel, whereas the code applies STARPool first and then PILCM to the updated representation. This changes the computation being described. The figure's dense layout, small labels, and unexplained final output projection further obscure the forward path. The diagram, equations, and released implementation do not provide a consistent account of the evaluated model.
- The channel interaction provided by PILCM may be restricted. Its phase-dependent transformations are shared across channels, while information is exchanged through uniform global aggregation. This does not establish the claimed ability to recover asymmetric channel interactions. Further analysis is needed to show whether the gains come from modeling channel relationships or from additional phase-conditioned feature processing.
Questions for authors
- Which exact code version generated the reported results? Provide an executable training and evaluation pipeline that supplies the forecast-origin index and implements the stated composite objective. Explain why the current release instead uses plain MSE and incompatible dataset outputs.
- Were the reported results generated with the released split-boundary logic? Identify the actual validation and test target ranges, and provide corrected results if overlapping targets were used.
- What substantive modeling contribution is established beyond the existing components? Which operation supports PILCM's claimed asymmetric channel interactions, and where is the comparison with a simpler CycleNet-based alternative under the same protocol?
- What evidence supports circular adjacency across partial-cycle window boundaries? Report the comparison with the same attention module after removing only its circular bias.
- Are STARPool and PILCM applied in parallel or sequentially in the model used for the experiments? Reconcile Figure 1 with the released forward computation, including the additional output projection shown after inverse normalization.
3 comments
Thank you for your detailed response and revisions. You have partially addressed my concerns, although I still find the methodological novelty limited. Taking these improvements into account, I will raise my score from 1 to 2
We thank the reviewer for the score revision. On the remaining point -- methodological novelty -- we would like to state the contribution precisely, since our earlier response focused on correcting the PILCM description and may not have made the advance itself clear.
The contribution is not any individual component: cyclic decomposition, FiLM and STAR-style aggregation are prior work, as the reviewer notes. The advance is that forecast-origin phase is used as a shared conditioning signal for two operators that are otherwise independent — the temporal mixer (through FiLM, Section 3.3 (Page 05) ) and the cross-channel mixer (through PILCM, Section 3.4 (Page 06)) -- so that one parameter set produces different effective transformations at different positions of a cycle, while channel interaction remains linear in the number of channels (Section 4.5 (Page 10)). Conditioning the cross-channel operator, not only the temporal operator, on forecast-origin phase is the specific choice that prior periodic-modeling methods do not make (Section 4); the phase-weighted low-rank parameterization is what makes it affordable, and it is what allows phase to modulate how channel information is shared rather than only how temporal features are mixed.
Three results in the paper support this reading:
(i) CycleNet comparison (Tables 1–2 (Page 08) and 13–14 (Pages 22–23)): identical protocol, same look-back, splits, horizons, and seed. PhiMixer achieves lower MSE and MAE on all 12 datasets (e.g., ETTh1 0.433 vs. 0.450; ECL 0.152 vs. 0.189), which isolates the gain over the closest periodic-modeling baseline — a baseline that uses learnable cyclic tables but does not condition its transformations on phase.
(ii) Phase-only ablations (Table 3 (Page 08)): removing phase from both FiLM and PILCM produces the largest degradation among phase variants on every evaluated dataset (ETTh1 0.433 → 0.446; PEMS04 0.127 → 0.196), while removing phase from one module degrades less. This separates the phase-conditioning contribution from the architecture itself.
(iii) PILCM decomposition (Table 3 (Page 08)): removing PILCM entirely costs 7.1% MSE on PEMS04, while removing only its phase conditioning costs 3.9% (ETTh1: 3.7% and 2.8%). The phase-conditioned component of the channel operator is therefore separately measurable, and it contributes even when the channel-mixing path is intact.
Together these show that the phase-conditioning choice is doing work, that the gain is not attributable to cyclic decomposition or channel mixing alone and that the effect holds across datasets. These three results establish the contribution: phase conditioning of the channel operator is a specific architectural choice, it is measurable independently of the other components, and it produces consistent gains across datasets.
We thank the reviewer for the careful audit of the released code and the paper. We address each weakness and question below; all corresponding changes are reflected in the revised manuscript and the revised release.
Weaknesses 1–2 / Q1–Q2 — Code corrections: Last time, we uploaded an older version of the code by mistake. The released code matches the version used for the paper's results: composite loss in run_main.py, t0 returned by the data loader, and split boundaries with a single - seq_len (validation/test targets are strictly disjoint from the preceding split).
Weakness 3 / Q3 — Methodological contribution and CycleNet comparison: We have added a direct comparison with CycleNet under the identical protocol — L = 96, the same splits, horizons, and seed as PhiMixer. A CycleNet column now appears in the main results Tables 1 and 2 (Page 08) and in the full per-horizon Tables 13–14 (Pages 22–23). The reproduced averages on the main benchmarks are:
On the PEMS benchmarks:
PhiMixer achieves lower average MSE and MAE than CycleNet on every dataset in both tables. Taken together with the phase-only ablations in Table 3, these results identify the distinct advance as the use of forecast-origin phase as a shared conditioning signal for both the temporal mixer (via FiLM) and the low-rank cross-channel operator (via PILCM): the CycleNet comparison isolates the gain over static cyclic tables, and Table 3 isolates the contribution of phase conditioning within each module.
Weaknesses 3 and 6 / Q3 — PILCM asymmetry and source of gain: We agree the original text overstated the asymmetric-interaction claim. Appendix A.2 now states that PILCM uses uniform channel-mean aggregation and does not model pairwise asymmetric interactions; learned asymmetric aggregation is left to future work (Appendix A.2, Page 16). To address whether PILCM's gain comes from channel mixing or from phase-conditioned feature processing, we decompose Table 3. On PEMS04 (average over horizons), removing PILCM entirely changes MSE from 0.127 to 0.136 (+7.1%), while removing only its phase conditioning changes it to 0.132 (+3.9%); the channel-mixing component and the phase-conditioned component therefore both contribute, and their contributions are separable (approximately 3.2% and 3.9% respectively). On ETTh1 the corresponding values are 0.433 (full), 0.449 (w/o PILCM, +3.7%), and 0.445 (w/o phase in PILCM, +2.8%). Thus the gain is not attributable to one component alone, and the phase-conditioned portion is separately measurable.
Weakness 4 / Q4 — RRF boundary justification and bias-only ablation: Section 3.3 adds a paragraph acknowledging that the circular distance is approximate when the look-back window spans only part of a full cycle (e.g., L = 96 against P = 288 on PEMS). It explains that the learned decay parameters adapt the strength of the prior per dataset, so the bias acts as a soft preference that the query–key product can override when non-cyclic structure is present (Page 05). In addition, we ran the specific bias-only ablation you suggested (attention module kept intact, circular bias set to S = 1). Removing only the bias changes average MSE by less than 1.3% across the five evaluated datasets (a small degradation on ETTh2, a small improvement on ETTh1). This shows that the primary benefit of RRF comes from the attention mechanism itself rather than the specific circular-distance prior. We report this finding in Appendix D (Pages 23–24) and reference it from Section 3.3, noting that the learned decay parameters can neutralize the bias when non-cyclic structure is present.
Weakness 5 / Q5 — Figure 1: We corrected the arrow flow in Figure 1. STARPool and PILCM are shown sequentially, matching the code, and the post-denormalization projection box has been removed. Fonts have been enlarged.