- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
FIST is a frequency-conditioned multivariate forecasting framework. It encodes each variable independently, partitions the representation into latent frequency bands, and learns a sparse interaction graph per band, with independent and shared-graph variants as matched controls. A restricted linear analysis predicts band-specific interaction helps only when dependencies differ across bands. On standard benchmarks, however, band conditioning gives only modest, setting-dependent gains after representation learning, with the independent control often competitive.
Critical strengths
- The controlled design is the main contribution: independent, shared-graph, and band-conditioned variants share one backbone and heads, cleanly isolating component-specific interaction.
- Proposition 1 gives a precise, falsifiable prediction of when band conditioning should help, and the controlled regression confirms both the sharing and independent regimes.
Critical weaknesses
- External comparison is thin: only DLinear and iTransformer are run, and DLinear attains lower MSE on both ETTh1 and Exchange (Table 1). The named recent baselines (DUET, TimeFilter, xCPD) are not evaluated.
- The evaluation scale is small: a compact CPU budget (width 16, one graph layer, at most 16 epochs) on four datasets, leaving unclear whether the null interaction gains reflect the method or limited capacity.
- The "frequency" bands act on learned token representations, not physical frequencies (Section 3.2), so the motivating frequency story is not interpretable.
Questions for authors
- Please add at least one recent dependency-selection baseline (DUET, TimeFilter, or xCPD) with matched tuning on the standard benchmarks.
- Please report a larger-budget configuration (wider model, more epochs) to test whether band-conditioning gains emerge with capacity.
- Please clarify whether the latent bands correspond to physical frequencies, and whether any interpretability check is feasible.
2 comments
Thank you for the detailed response and clarifications. Most of my concerns have been adequately addressed. I will maintain my original rating.
Added Recent Baselines, Larger-Budget Experiments, and Latent-Band Interpretability Analysis
We thank the reviewer for a precise review. All three requests match the gaps named in our Limitations (Sec. 5.6), and we have now run all three.
W1/Q1. Recent baselines, matched tuning. We added DUET, TimeFilter and xCPD, and extended DLinear/iTransformer to all four datasets. All models use FIST's windows, splits and scaling (Table 4), L = H = 96, validation-MSE checkpoint selection and the same five seeds. Each baseline runs its official code and default configuration, with the learning rate chosen on validation from {1e-3, 5e-4, 1e-4}; FIST keeps its frozen configuration, so any tuning advantage goes to the baselines.
Table R1. Test MSE, mean of 5 seeds, H = 96.
W2/Q2. Do band-conditioning gains appear with capacity? We trained a larger configuration on all four datasets: width 64 (4×), 2 temporal blocks, 2 graph layers, epoch cap 50 (vs. 16), 247K parameters (vs. 34K), with the same seeds and variants.
Table R2. Test MSE, mean of 5 seeds. Δ = paired MSE reduction (%) of band- vs. shared-sparse, 95% t-interval; positive favors bands. Compact Δ: Table 14.
Capacity lowers MSE by 1.0–2.1% for all three variants, yet the band-vs-shared gap does not widen and every large-budget interval contains zero; a capacity artifact would make it grow. This supports Sec. 1 and 5.2: a stronger encoder absorbs much of the component-specific structure before interaction, leaving little sharing cost (Prop. 1) to remove.
W3/Q3. Do the latent bands correspond to physical frequencies? Only partially, and many-to-one. The bands are Fourier bins of the learned token sequence (Sec. 3.2), and Prop. 1 holds for generic components, so our claims do not rely on a physical reading.
Exact mapping. With L = 96, P = 16, s = 8, a linear patch embedding maps a raw period of T steps to token bin ≈ 11·fold(8/T), where fold(x) is the distance to the nearest integer. Each bin therefore also collects aliased periods: on hourly ETTh1, the 24-h and 12-h cycles land on the same token frequency (≈69% of their energy in band 3, ≈21% in band 2), and an 8-h cycle falls entirely in the DC bin. Nonlinear layers mix bins further.
Checks on the frozen band-sparse checkpoints: a ridge probe from the four latent band energies to the input's log energy in the four nominally matched physical bands (fit on validation, R² on test); Spearman ρ between latent and physical spectral centroids; and a control with graphs on a fixed FFT partition of the raw input.
Table R3. Mean of 5 seeds.
The latent bands carry limited physical-frequency information (R² ≤ 0.31), as the mapping predicts, and physical bands change MSE by at most 0.0003, so our conclusions do not depend on the distinction. We now say "latent token-frequency bands" throughout and present the trend/fluctuation example as motivation for the operator-sharing question.
Revised PDF: five external baselines with parameter counts (Table 1, App. D); larger-budget study (App. I); latent-to-physical mapping and checks (Sec. 3.2, App. H); updated Limitations. Together, these results strengthen the paper's central finding: component-specific dependencies can exist (Sec. 5.5) without improving forecasts after representation learning. We hope this resolves the three concerns and would be grateful if it is reflected in your assessment.