- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes unconditional multivariate time-series generation through flow matching in the wavelet domain. A channel-token transformer models the joint distribution of multilevel wavelet coefficients. The authors argue that differences in coefficient variance produce an implicit coarse-to-fine progression under a shared interpolation schedule. Experiments compare against five baselines across seven datasets and four sequence lengths, with particularly strong Context-FID and discriminative scores. Ablations examine channel identity, coefficient scaling, the wavelet representation, time sampling, and wavelet choice.
Critical strengths
-
At sequence length 24, the method achieves the lowest reported mean Context-FID on six of seven datasets and discriminative score on five. The evaluation covers multiple domains and sequence lengths, and the main comparison includes three independent training runs. This indicates strong empirical performance.
-
The paper includes a matched time-domain ablation and investigates coefficient standardization, channel identity, time sampling, and fixed versus learned wavelets. These experiments provide useful evidence about the design choices, including the finding that learning the wavelet transform does not systematically improve performance.
Critical weaknesses
-
Prior work has already explored diffusion-based time-series generation in transformed domains, including Fourier and wavelet representations. While the proposed combination with flow matching and channel-wise attention achieves strong empirical results, the additional insights into the benefits of transformed-domain generation are relatively limited. The SNR analysis provides useful motivation, but a clearer account of when and why the proposed approach is particularly beneficial would strengthen the paper’s contribution.
-
The experiments include four diffusion models and one flow-matching model, but no GAN or VAE baseline. GT-GAN [1] and KoVAE [2] would broaden this comparison. ImagenTime [3] is also particularly relevant because it applies diffusion to transformed time-series representations. Although all three are cited, their exclusion from the experiments is not explained, limiting the assessment of the method’s broader empirical advantage.
Furthermore, the comparisons at sequence lengths 32, 64, and 128 use only one generator training run; repeated metric evaluations do not capture training variability. These limitations leave some uncertainty about the breadth and robustness of the reported advantages.
[1] Jeon et al., GT-GAN: General Purpose Time Series Synthesis with Generative Adversarial Networks (2022)
[2] Naiman et al., Generative Modeling of Regular and Irregular Time Series Data via Koopman VAEs (2024)
[3] Naiman et al., Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series (2024)
Questions for authors
See weaknesses.
3 comments
Response to Reviewer TAQr - Part 2
Multiple Independent Training Runs at Longer Sequence Lengths (Weakness 3)
We thank the reviewer for highlighting the importance of accounting for training variability. We fully agree with this concern, which is why our original submission already included three independent training runs at (T=24), each evaluated five times.
While multiple independent generator training runs across all datasets and sequence lengths are not standard practice in diffusion-based time-series generation research, we agree that extending this evaluation strengthens the robustness of our conclusions. Such an extensive multi-seed evaluation is computationally demanding, particularly for an academic research group with limited resources.
Nevertheless, we have extended our experiments to three independent training runs at , in addition to . The revised results are reported in Tables 8–10, with the corresponding updates reflected in Figures 4 and 10. The results preserve our main findings: our method maintains the best mean rank in Context-FID and discriminative score across all six evaluated sequence lengths, including the newly added .
Together with the additional experiments at , this expands our original benchmark from 252 to 588 planned independent model trainings () across the original six methods. Furthermore, incorporating KoVAE and ImagenTime requires 98 additional trainings each, bringing the expanded benchmark to 784 trainings ( the original), excluding ablations and repeated evaluations. These extensions substantially strengthen the evidence for the robustness and breadth of our empirical comparison.
Follow-up: ImagenTime Baseline Results
Dear Reviewer,
As a brief update to our response, we have now included the ImagenTime results in the revised manuscript, as suggested. The experiments cover all seven datasets with three independent training runs for sequence lengths , following the same evaluation protocol as the other baselines.
We are also completing the ImagenTime evaluations for and plan to include these results in the camera-ready version.
We thank you again for your feedback and hope that the expanded experimental comparison addresses your remaining concerns and strengthens your overall assessment of the paper.
Response to Reviewer TAQr - Part 1
We thank the reviewer for their positive feedback and suggestions. Below, we address each point individually.
Benefits of Wavelet-Domain Generation (Weakness 1)
We thank the reviewer for this observation and agree that a clearer understanding of when and why wavelet-domain generation is beneficial strengthens the contribution. We have therefore expanded both the analysis and discussion in the revised manuscript.
First, we clarify the role of the wavelet representation. Since the DWT is orthogonal, wavelet- and time-domain flow matching are mathematically equivalent under a change of coordinates (Remark 3.1). The wavelet transform does not introduce a different generative process, but explicitly separates temporal scales, which can facilitate optimization. This is particularly beneficial when fine-scale fluctuations are much smaller than coarse-scale trends. On Exchange, the finest wavelet level has a 70× smaller standard deviation than the coarsest (Table 7). Stocks and Exchange show the largest improvements over our matched time-domain variant (2.8× and 1.75× in Context-FID, Table 15), and our model achieves the best Context-FID on both datasets across all evaluated sequence lengths.
Second, we directly investigated the learned sampling trajectories (new Appendix F.2, Figures 8–9). Rather than inferring coarse-to-fine generation solely from SNR crossing times, we track the model's running endpoint predictions along the sampling ODE. On six of seven datasets, coarse-scale structure emerges first, followed by progressively finer details, consistent with the predicted ordering. Equalizing the coefficient variances substantially collapses this progression, while the matched time-domain model exhibits similar trajectories. This confirms that the wavelet representation makes the progression explicit rather than creating it.
Third, we added a multi-scale fidelity analysis (Section 5.1, Appendix F.5, Tables 13–14), comparing wavelet-level energy, spectral properties, and local high-frequency structure across seven generative methods. Our model achieves the best average rank across five statistics (2.11, compared with 3.00 for WaveletDiff and 3.36 for FourierDiffusion), ranking first or second on every statistic. In particular, time-domain models tend to misrepresent fine-scale energy, whereas FourierDiffusion matches the power spectrum but less faithfully reproduces the localization of fine-scale events.
Together, these findings clarify when and why wavelet-domain generation is beneficial: it provides an explicit multiscale parametrization that appears easier to optimize, particularly for signals with strongly unequal energy across scales, and yields more faithful multi-scale structure in the generated samples.
Additional Baselines: KoVAE, GT-GAN, and ImagenTime (Weakness 2)
We thank the reviewer for this suggestion. Our original evaluation focused on diffusion and flow-matching models, as these are most closely related to our proposed approach and have shown strong performance in recent time-series generation benchmarks. Nevertheless, we agree that including other generative paradigms and transformed-domain approaches would strengthen the comparison.
Regarding KoVAE, we have now included it as a VAE-based baseline across all seven datasets and six sequence lengths (Tables 1 and 8–12). KoVAE generally performs worse than the diffusion and flow-matching baselines, particularly on Context-FID and discriminative score. Our model consistently achieves substantially better Context-FID, reinforcing the conclusions of our original comparison.
We also attempted to reproduce GT-GAN but encountered substantial training instabilities and considerably longer training times than for the other baselines, preventing a reliable comparison within our computational budget. However, KoVAE already reports outperforming GT-GAN on all four datasets in both discriminative and predictive scores (Tables 1–2 of Naiman et al., 2024). We therefore prioritized KoVAE as a representative non-diffusion baseline, while acknowledging that this does not replace a direct comparison with GT-GAN. For the final version of the paper, after rebuttal, we aim to include GT-GAN as well, for completeness.
Finally, we agree that ImagenTime, which applies diffusion to transformed time-series representations, is a relevant baseline. We are currently evaluating it across all seven datasets and sequence lengths using the same protocol, expect to complete the experiments within the next few days, and will add the results to the revised manuscript.
References
Naiman, Ilan, et al. "Generative modeling of regular and irregular time series data via Koopman VAEs." International conference on learning representations. Vol. 2024. 2024.