- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents WaveFM, a time series foundation model designed for industrial forecasting. By replacing traditional time-domain patches with wavelet-based tokens and introducing frequency-aware positional embeddings, WaveFM aims to better capture transient and high-frequency patterns, making it suitable for industrial forecasting scenarios. Extensive experiments on 7 public and 8 proprietary industrial datasets demonstrate that WaveFM achieves forecasting accuracy comparable to state-of-the-art TSFMs, with fewer model parameters and faster inference.
Critical strengths
-
The methodology is well-motivated. Compared with time-domain patching and Fourier transforms, wavelet transforms are particularly suitable for capturing transient and non-stationary signals that commonly occur in industrial systems, as their multi-resolution representation preserves both temporal localization and frequency information. The wavelet-based tokenization design is also reasonable.
-
The experimental results, especially the comparisons with same-corpus pretrained baselines and the high-frequency error analysis, provide useful evidence of the effectiveness of the wavelet-based design. The analysis of high-frequency windows and transient events is particularly relevant to the motivation of this paper.
Critical weaknesses
-
The presentation of the methodology needs improvement. For example, the authors should clarify how the attention mechanisms operate on different types of tokens during the intra-channel and cross-channel phases, and how the compressed channel summaries are incorporated into the subsequent intra-channel phase. In particular, it is unclear how the output of the second cross-channel phase is utilized by the final output heads. The architecture figure should also be reorganized to more accurately illustrate the information flow and the details of each phase.
-
Some architectural choices require further justification or empirical ablation. For example, why is a 5-level DWT adopted, and why is each channel compressed into 25 tokens? Additional ablation studies on the latent bottleneck and special token designs, particularly the CLS-only re-injection mechanism, would help establish the effectiveness of these design choices.
Questions for authors
-
What is the overall MASE performance of WaveFM on the complete GIFT-Eval benchmark, beyond the five high-frequency subsets reported in the paper?
-
Why does WaveFM adopt a relatively long context length of 1,536 time steps? Is there any empirical evidence showing how the forecasting performance changes with different context lengths?
Dear Authors, I could not locate the corresponding revisions in the updated PDF, as the changes do not appear to be clearly highlighted or marked. This makes it difficult to verify whether my concerns have been adequately addressed.