- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes RecFlowTime, a rectified-flow framework for time-series generation using a bidirectional transformer with rotary position embeddings and self-conditioning. The results show that RecFlowTime outperforms multiple baseline methods across four synthetic, financial, sensor, and biomedical datasets and it also supports conditional generation for imputation and forecasting tasks.
Critical strengths
None
Critical weaknesses
- Limited Novelty: most of the components are proposed by previous work, and the remaining modification is minor. For example, the training and sampling framework of rectified flow, minibatch OT coupling, self-conditioning, and the min SNR weighting strategy are almost the same as the original work. In particular, the author doesn’t mention and cite the self-conditioning paper [1], which sounds like claiming to be your proposed method.
- Outdated Baseline Methods: two of the baselines, TimeGAN and TimeVAE, are old methods. The author should include more recent baselines such as SDformer [2] or the other Rectified Flow-based TS generation FlowTS [3].
[1] Ting Chen, et al. Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning. (ICLR 2023)
[2] Zhicheng Chen, et al. SDformer: Similarity-driven Discrete Transformer For Time Series Generation. (NeurIPS 2024)
[3] Yang Hu, et al. FlowTS: Time Series Generation via Rectified Flow.
Questions for authors
Clarification requests:
- The self-conditioning part is one of the main components for the proposed method but is poorly explained. It is hard to understand why we need this condition c as input in the first place and how it is actually used during the training.
- Several baseline results in Table 1 differ substantially from those reported in the original papers. For example, PaCoDi reports Context-FID 0.018 and discriminative score 0.010 on Sines at L = 64 in Table 8 in PaCoDi paper, whereas Table 1 in this paper reports 0.774 and 0.362. Could the author explain what is the reason for this large performance gap?
Suggestions for future work:
- The three additional metrics “spectral, increment and autocorrelation distances” are explained through definition and motivation only. The author should include more experiments to validate the reliability of these metrics, even using some synthetic data. Otherwise, it is unclear if we can trust these metrics.
- The conditional generation results are only compared to linear interpolation (imputation) and last value (forecasting) which may not be enough.