- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes RAP, a reconstruction-augmented predictor (RAP) that improves the performance of forecasting without classic data augmentation approaches such as spectral filtering or Gaussian noise. In practice, the forecaster is trained with two designated heads: a reconstruction head and a prediction head. This approach, which is generally simpler and motivated by theoretical analysis with respect to some data augmentation approaches, is shown to perform better than other prominent forecasters utilizing a transformer.
Critical strengths
- Framing reconstruction as an alternative to augmentation, with theoretical backing, is an interesting and practically relevant approach.
- Many claims are motivated by theory.
- Overall, I find the paper was well structured and clearly written.
Critical weaknesses
- Claims and analysis refer to augmentation on the lookback of the time series only: Many of the claims in secs 2.1-2.2, as well as the toy study, perturb or filter the lookback X while keeping Y clean. Generally, forecasting augmentations ([1],[2],[3]) instead transform the concatenated lookback + horizon window. This keeps the input and target pair consistent and from the same augmented distribution. (I attached here a handful of works but several more works support my observation)
[1] FrAug: Frequency Domain Augmentation for Time Series Forecasting.
[2] Chronos: Learning the Language of Time Series. (see ts mixup)
[3] Towards Diverse and Coherent Augmentation for Time-Series Forecasting.
- Limited Novelty of reconstruction: Joint reconstruction and prediction is well established; NBEATS [4] uses backcasting, which is the same as reconstruction. PatchTST, MOMENT [5,6] have shown that reconstruction parts of the input improve forecasting accuracy. However, these approaches and elements are not fully discussed or compared in this paper. The aforementioned works are prominent works in the TSF literature; I also believe more works utilize this approach
[4] N-BEATS: Neural basis expansion analysis for interpretable time series forecasting
[5] MOMENT: A Family of Open Time-series Foundation Models
[6] A Time Series is Worth 64 Words: Long-term Forecasting with Transformers
-
Incomplete benchmarks. The evaluation section omits prominent datasets from the LTSF benchmark, namely weather, ETT, and PEMS08. Which may raise questions on the robustness of the proposed approach
-
Outdated Baselines. The newest baseline is TimeXer (Neurips 2024). The TSF forecasting literature is a fast-paced research area, while it is indeed difficult to be up to date with all models, the paper would benefit from a more recent representation of 1 or 2 models in my opinion.
-
The general claims are model-agnostic, yet the approach is only tested DLinear, iTransformer and the proposed transformer. A richer and more focused comparison would strengthen the claims of the work.
-
The work makes strong claims against augmentation, while this work only addresses spectral filtering and Gaussian noise as potential augmentation methods; however, the TSF data augmentation literature has richer and more sophisticated approaches to offer.
Questions for authors
see above