- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
In order to model long-range dependencies via multi-scale while preserving the scale-specific semantics, the paper proposes JacoWaveNet, which uses wavelet residual pyramid. The method polish existing ones to solve cross-scale feature entanglement and unsigned temporal aggregation. Experiments show competitive performance of the proposed method.
Critical strengths
- The methodology is based on solid theories.
Critical weaknesses
- Although the motivation looks somewhat reasonable, it is too abstract and hard to prove. For example:
- Why repeatly re-encoded smooth trends will obscure scale-specific signals? As long as smooth trends are not fake signals, re-encoding them will not introduce unrelated noise, and there's no evidence provided in this paper that can prove this assertion.
- Why signed aggregation is definitely better than unsigned one? Theoretically, the signed one indeed distinguishes positive and negative correlations, but can models actually leverage negative correlations instead of being misled?
- Method novelty is incremental. The individual ingredients are all established, so the contribution is limited to their specific combination and ordering. Also, the model's small capacity makes attribution of performance gains uncertain.
Questions for authors
Why the proposed method is based on DWT instead of other multi-scale techniques, like Pathformer[1] or Pyraformer[2]?
[1] P. Chen et al., “Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecasting,” presented at the The Twelfth International Conference on Learning Representations, 2024.
[2] S. Liu et al., “Pyraformer: Low-Complexity Pyramidal Attention for Long-Range Time Series Modeling and Forecasting,” presented at the International Conference on Learning Representations, 2022.