- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper investigates whether the benefits of Fourier-based time-series forecasting methods actually originate from their prescribed frequency structures. The authors replace Fourier transformations with fixed random filters and find no consistent advantage of Fourier over Random, while both often outperform the raw-input baseline, suggesting that the improvements primarily come from providing multiple distinct filtered views rather than the Fourier basis itself.
Critical strengths
This paper raises a question about the benefits brought by a widely used design (Fourier-based spectrum) in time series forecasting, questioning whether it comes from the inductive biases from Fourier basis. This is a meaningful question, and experiments (Fourier vs. Random, especially for the eight published models) do show that the Fourier basis won't consistently help.
Critical weaknesses
It supports that Fourier basis is not consistently helpful, but does not validly proves what the benefits comes from. This paper tries to do this by comparing Fourier and Random with Raw, and polar decomposition. The key problem is, all the methods with expanded filter views repeat model forwarding 9 times (1 for original and 8 for each ), and use a small linear layer (the and in Appendix A.1.3) to ensemble the 9 repeats. Though model parameters are barely increased, but computation budgets are multiplied by 9. Polar decomposition experiments do not resolve this; in the contrast, it supports my concern. Table 9 shows that Repeat and H brings marginal improvement but Q and QH show significant gains. Notably, there are only 2 times authentic computation budget for Repeat, as all the are the same for all . Experiments that controls computation budgets are needed to analyze whether the benefits just come from more computation.
This repeating setting itself is also a problem. First, sharing model parameters brings irrelavant variables. The model has to learn to deal with 9 different input space, and we have no idae whether this will affect performance. Also, generalization of existing conclusion is limited, as no other input paradigms are examined. I look forward to experiments for more input paradigms.
Questions for authors
- Conduct experiments that controls computation budgets.
- Apart from Q, H analysis, provides results with a random matrix for B.
- Conduct experiments for more paradigms of providing the filtering views as inputs.
- Provides grounded analysis about what contributes to the gains of Fourier spectrum. See 'Critical Weaknesses' for more information.
If these four questions are resolved (especially the last one), I will be happy to raise my score to 3.