- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies reference-conditioned zero-shot time series generation, where a pretrained model generates samples from a single reference sequence in an unseen target domain. MarkovTS represents temporal structure through multiscale morphological states and contextual transitions, which condition a pretrained flow-matching generator. The paper reports evaluations on 12 unseen target datasets, together with data augmentation experiments for forecasting, classification, and anomaly detection, to assess generation quality, transferability, and downstream utility.
Critical strengths
-
Broad reported empirical validation. The paper reports evaluation on 12 unseen target datasets and downstream augmentation across forecasting, classification, and anomaly detection. This breadth is valuable because it examines both generation quality and practical utility, providing support for the relevance of the approach across different applications.
-
Clear motivation and coherent problem formulation. The paper connects target-domain data scarcity to a well-defined generation setting with a single reference and no parameter updates. The proposed multiscale state–transition representation follows naturally from this motivation, making the intended contribution and its practical significance clear.
Critical weaknesses
The single-reference conditioning mechanism limits the scope of generation. The method relies on one reference to supply target-domain information and explicitly aims to preserve its temporal organization. For domains containing multiple regimes or substantially different evolution patterns, this reference may provide incomplete coverage. Reference consistency and stochastic variation alone therefore do not establish that the generated samples capture the broader variability needed for simulation or effective augmentation.
Questions for authors
How do the authors characterize the variability that can be generated from a single reference? What evidence shows that the samples provide meaningful structural diversity while preserving reference consistency? Can author also provide few-shot performance, as reference is kind of one-shot
5 comments
We agree with the reviewer’s emphasis on broader structural diversity. We understand structural diversity to include changes in phase, pattern placement, occurrence intervals, and pattern combinations while retaining recognizable reference patterns. OATS[1] offers a valuable exploration of this direction. It uses TimeDP as its generative backbone, trains on multi-domain subsets of LOTSA-100M, and combines example guidance with subset-class conditioning to generate sequences with varied patterns. Its online augmentation improves forecasting performance in time series foundation models, demonstrating the value of reference-guided generation for broader training-data diversification.
The default outputs already exhibit measurable shape variation, with average Shape RMS and Shape APD of 0.314 and 0.302, respectively. These values are similar in magnitude to TimeVQVAE’s 0.452/0.371 and TimeVQVAE-C’s 0.457/0.380. The additional patch-aligned visualizations also show waveform variation under a fixed reference condition. We further examine how to control generated structure and expand the range of variation supported by reference conditioning.
To this end, we introduce State–Transition Recombination (STR), a variant of codebook conditioning in MarkovTS. Given a single reference of length , STR samples windows of length to form a reference-window pool, allowing overlap between windows. STR then recombines state–transition code blocks at patch boundaries shared across scales, using the same source window across scales within each block. The frozen flow-matching generator produces a complete sequence from the recombined condition and a Gaussian source. The multi-reference setting further allows selection of reference sources and code positions at each scale, combining temporal patterns from different references.
The new visualizations show changes in pattern placement, local morphology, amplitude, and occurrence intervals while retaining recognizable reference patterns. In the multi-reference comparison, we fix the references, source assignments, and Gaussian inputs, and vary the code positions to examine changes in generated structure. The Supplementary Material provides an extended collection of single-reference STR 16 and STR 32 examples, displaying the source references, multiple input crops, and generated samples side by side across diverse datasets.
In the single-reference experiments, we set and , recombine 256-point code blocks, and use window-pool sizes and . These settings correspond to MarkovTS (STR 16) and MarkovTS (STR 32) below. Across 12 datasets, we evaluate Shape RMS, Shape APD, and ACF/PSD PRDC Coverage. Shape RMS measures the shape difference between an output and its conditioning reference, Shape APD measures differences among outputs sharing a reference, and ACF/PSD PRDC Coverage measures coverage of real autocorrelation and spectral structures. The summaries weight the datasets equally, and Coverage uses 100 candidates per reference.
| Model and setting | Shape RMS | Shape APD | ACF/PSD PRDC Coverage ↑ |
|---|---|---|---|
| MarkovTS (default) | 0.314 | 0.302 | 41.25% |
| MarkovTS (STR 16) | 1.339 | 1.324 | 32.92% |
| MarkovTS (STR 32) | 1.326 | 1.340 | 32.62% |
| ImagenFew | 0.605 | 0.693 | 41.23% |
| TimeDP | 1.008 | 1.008 | 55.20% |
| Diffusion-TS | 0.825 | 0.634 | 9.66% |
| TimeVQVAE | 0.452 | 0.371 | 44.30% |
| TimeVQVAE-C | 0.457 | 0.380 | 45.08% |
| Reference replication | 0.000 | 0.000 | 24.00% |
| Gaussian 0.2 | 0.196 | 0.276 | 27.39% |
STR increases average Shape APD from 0.302 in the default setting to 1.324 and 1.340, with structural coverage exceeding reference replication and Gaussian perturbation. Together with the visualizations, these results demonstrate how recombining reference conditions expands shape variation and changes pattern placement and combinations. Single-reference STR combines patterns within that reference, and multi-reference STR further combines patterns supplied by different references.
Evaluation using the main benchmark’s MMD and flat-KL shows that STR expands structural variation and maintains competitive distributional matching. STR 16 and STR 32 achieve average MMD of 0.0674 and 0.0673, compared with the default MarkovTS score of 0.0605. Their average flat-KL scores of 0.1908 and 0.1891 are comparable to the default score of 0.1905. Both STR settings achieve lower averages on both metrics than the nine comparison generators in Table 1.
| Model and setting | Average MMD ↓ | Average flat-KL ↓ |
|---|---|---|
| MarkovTS (default) | 0.0605 | 0.1905 |
| MarkovTS (STR 16) | 0.0674 | 0.1908 |
| MarkovTS (STR 32) | 0.0673 | 0.1891 |
| Winformer | 0.0691 | 0.1940 |
| ImagenFew | 0.0850 | 0.4201 |
| TimeDP | 0.0744 | 0.2123 |
| Diffusion-TS | 0.0951 | 0.4253 |
| TimeGAN | 0.4135 | 2.4536 |
| GT-GAN | 0.3618 | 1.3796 |
| TimeVAE | 0.3607 | 1.3715 |
| TimeVQVAE | 0.1858 | 0.8419 |
| TimeVQVAE-C | 0.0996 | 0.9073 |
Dataset-level changes further illustrate the effects of condition recombination. On Temperature, both STR settings increase MMD from 0.134 to 0.161, with flat-KL increasing from 0.098 to 0.138 and 0.139. On Air, MMD decreases from 0.015 to 0.010 and flat-KL from 0.026 to 0.020, improving both metrics. The effects are therefore dataset-dependent. For example, NN5 MMD increases from 0.145 to 0.189 and 0.186, while flat-KL decreases from 0.045 to 0.040 and 0.039. Electricity flat-KL increases from 0.001 to 0.079 and 0.080. These results characterize how the structural variation introduced by STR affects matching to specific target distributions.
The current experiments support MarkovTS’s augmentation advantage over alternative generators and augmentation methods in in-domain multivariate forecasting, and demonstrate its augmentation value in classification and anomaly detection. Systematic comparisons among generators on classification, anomaly detection, and broader foundation forecasting model training remain for future work. The revision introduces State–Transition Recombination at the end of the method section and reports distributional matching results, structural diversity metrics, and generation visualizations in the experiments.
The appendix also provides multi-reference and cross-domain generation examples, such as combining Exchange and Traffic signals through state–transition conditions to generate sequences that retain source patterns and exhibit new pattern combinations. Future work will investigate diverse time series generation and fine-grained editing controlled through state–transition conditions.
[1] OATS: Online Data Augmentation for Time Series Foundation Models. NeurIPS 2026.
Manuscript revisions: Section 4.5 (State–Transition Recombination); Sections 5.2 (Generation Quality), 5.4 (Downstream Utility), and 5.5 (Structural Diversity, Table 8); Appendices B.7 (STR Details), D.2–D.3 (Evaluation Protocol and Metrics), E.1.2 (Shape Metrics and Structural Coverage, Tables 24–25), E.2.4 (STR Distributional Results, Table 28), F.1–F.2 (Limited-Support Comparisons), G.5 (STR Visualizations, Figures 14–16), and H.3 (Alternative Augmentation, Table 36). Supplementary Material: markovts_str_samples.pdf (extended single-reference STR 16/32 generation examples).
To W1Q1: Structural Diversity, Single-Reference Conditioning, and Few-Shot Generation
Thank you for suggesting that we further characterize the range of variation under reference conditioning and the relationship between structural diversity and reference consistency. In its default setting, MarkovTS uses patch-level temporally aligned state–transition conditions to preserve the reference sequence’s temporal organization, with Gaussian sources providing variation in local morphology and amplitude. We adopt this design primarily for data augmentation in multivariate forecasting, classification, and anomaly detection, where the relative timing of patterns across variables matters.
First, the default generation setting demonstrates downstream utility. For multivariate forecasting, we compare MarkovTS with five generators, Gaussian perturbation, and Temporal Patch Shuffle (TPS). Across 30 backbone–dataset combinations, MarkovTS achieves the lowest average MAE and MSE, reducing the Real-only errors by 3.30% and 3.39%, respectively. Relative to the alternative augmentation methods, its reductions range from 2.01% to 4.73% for MAE and 2.46% to 6.26% for MSE. MarkovTS uses three-run means, and the alternatives use one run per setting.
The generated data also improve aggregate performance in multivariate classification and anomaly detection. These results support the practical augmentation value of the current reference-aligned generation setting.
For few-shot evaluation, we further consider support sets of 3, 10, and 100 target-training windows on Stock and Web, both unseen during MarkovTS pretraining. Zero-shot denotes transfer to unseen target domains without parameter updates, and the number of references specifies the information budget at inference. MarkovTS keeps its parameters fixed and conditions each output on one reference from the support set. The following table reports three-run mean MMD / flat-KL, both lower-is-better.
MarkovTS improves both metrics over TimeDP’s frozen domain prompting at every support size. The appendix also provides comparisons with other generators and limited-support experiments on the 12 generation benchmarks.