- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes ANTS, an Adaptive Noise for Time Series diffusion models with experiments showing time series generation and forecasting. An offline method, Integrated Absolute Autocorrelation Time (IAAT) is used based on dataset statistics to design the noise schedule for time series noising and stated as an efficient noise schedule that distribute corruption process to maintain uniform information degradation across diffusion steps, which eliminates redundant noise levels that contribute to little learnable signal. Also prior of the diffusion is also estimated using dataset statistics. Experiments related to time series generation and forecasting are shown with ablations.
Critical strengths
- The proposed method is model/architecture agnostic and can be computed offline with dataset characteristics.
- The ablations with multiple component variations (Figure 4) and Raw, Lag1AC, VarAC, comparisons (Table 3, Appendix D.3) are useful and provided further insights.
Critical weaknesses
- Proposed components are of very marginal or of no effect on performance. The ablation results of Figure 4 clearly shows that in several experimental settings, removing adaptive schedule, temporal prior, or Gaussian process components leads to very less change in performance. Although certain specific settings shows some improvement (eg: ETTh1-DiffusionTS, Wind) but it is not consistent across models and datasets (eg: ECL dataset for forecasting and ETTh1-PaDTS for generation).
- Tables 6 and 7 do not convincingly demonstrate the superiority of the proposed IAAT, alternatives such as Lag1AC and VarAC achieve comparable or better results in numerous settings.
- Core idea of ANTS (adaptive noise scheduling based on time-series statistics) has substantially overlap with a well established paper ANT (NeurIPS 2024) and another idea (controlling diffusion schedules through uniform distributional changes) is very much similar to CRS (Arxiv 2024 and TMLR 2026) which makes the proposed work, a incremental of existing methods.
Questions for authors
- Can authors provide direct experimental comparison over ANT (NeurIPS 2024) and Constant Rate Scheduling (CRS) under identical settings ?
- Proposition 1 establishes monotonic IAAT degradation under temporally independent Gaussian noise, but ANTS uses GP-correlated noise. Does IAAT still decrease monotonically under this prior? If not, how are Eq. 9 and Theorem 1 justified?
- What concrete advantages does IAAT offer over Lag1AC and VarAC, and why should it be preferred ?
- Are the hyper-parameters and denoising steps same for Baseline and Baseline + ANTS ?
5 comments
Response to Reviewer wQns
Response to W3 and Q1:
Thank you for raising this important issue. Our core contribution is an efficient schedule constructed directly from unique characteristics of corrupted time series which is underexplored. (1) ANT selects the best schedule from a manually specified candidate space. Its performance is limited by the space and incurs the cost of evaluating. By contrast, ANTS directly resamples the captured trajectory to construct target schedule. In this sense, ANTS represents the optimal solution that ANT seeks to approximate. (2) CRS introduces uniform distributional change but primarily focus on image. Besides,it incurs additional model training and computation overhead, whereas ANTS estimates the IAAT trajectory and constructs schedule offline. We previously discussed these points briefly in Related Work Section. We have revised it and added Appendix D.4 to more clearly highlight how ANTS differs from ANT and CRS.
While no publicly code is available to reproduce CRS, we provide a fair comparison between ANTS and ANT using the same diffusion backbone, prior and diffusion steps. The noise function and temperature search space are consistent with official ANT implementation. As shown in the table below, ANTS outperforms ANT in generation quality across datasets and metrics.
| Dataset | Model | Context-FID Score () | Correlational Score () | Discriminative Score () | |||
|---|---|---|---|---|---|---|---|
| ETTh1 | DiffusionTS | ||||||
| PaD-TS | |||||||
| Wind | DiffusionTS | ||||||
| PaD-TS |
Response to Q2:
Thank you for careful review which helps us identify missing theoretical derivation. The monotonic degradation conclusion in Proposition 1 remains applicable to GP-correlated noise. We agree that Proposition 1 alone is insufficient to establish the conclusion. Therefore, we have extended theoretical derivation and revised the manuscript accordingly as below:
Specifically, letting denote the GP prior, we obtain the corresponding autocorrelation:
w_\tau=\frac{\alpha_\tau^2\operatorname{Var}(X_0^t)}{\alpha_\tau^2\operatorname{Var}(X_0^t)+(1-\alpha_\tau^2)\operatorname{Var}(X_1^t)}.$$ Accordingly, $$\psi_{\mathrm{IAAT}}(X_\tau)=1+2\sum_{k=1}^{\infty}\left|w_\tau\rho_k(0)+(1-w_\tau)\rho_k(1)\right|.$$ Since time series data typically have larger aggregate autocorrelation than GP prior, we suppose that $\sum_{k=1}^{T-1}\rho_k(0)>\sum_{k=1}^{T-1}\rho_k(1)$. This makes the derivative of convex $\psi_{\mathrm{IAAT}}$ positive. Thus, as $\alpha_\tau$ and $w_\tau$ decrease during forward diffusion, IAAT decreases monotonically toward $\psi_{\mathrm{IAAT}}(X_1)$. Our empirical IAAT trajectories show consistency with this result. Besides, the theoretical terminal boundary is not $1$ under GP-correlated noise. In practice, we use empirically measured values at endpoints. Thank you for pointing out this error and we have revised Eq. (9) accordingly. --- **Response to Q4:** For each *Baseline* and *Baseline + ANTS* variant, we keep the backbone hyper-parameters and number of denoising steps identical for fair comparison. We only modify the noise schedule and prior, as verified by our submitted anonymous code. --- We thank you again for your valuable comments, which have helped us strengthen the reliability and rigor of the paper. All revisions have been incorporated into the updated manuscript and highlighted in blue. We sincerely hope our detailed explanations could address your concerns. If you have any further questions or concerns about the method, we remain fully available to discuss them as thoroughly as possible. If the revisions meet your expectations, we would greatly appreciate your consideration of updating your score accordingly to support our work.Response to Author rebuttal
I appreciate the authors' effort in giving rebuttal, some of my concerns got resolved. But some concerns still remain open,
- ANT vs ANTS comparison (New comparison shown by authors in rebuttal) shows that many of the improvements are within one standard deviation, so the improvement is marginal, which does not outweigh the methodological overlap.
- The ablation table reports no standard deviations. Using Table 1’s std as reference, multiple variants on ETTh1 are within one std of full ANTS: w/o Adaptive Schedule and w/o Temporal Prior on DiffusionTS, and IAAT-Focused and w/o GP on PaD-TS.
- Section 5.3 still states "As evidenced by Figure 4, both w/o Adaptive Schedule and IAAT-Focused variants consistently lead to substantial performance degradation", from the table authors provided in rebuttal several differences are within std (e.g., 1.247 vs. 1.303 on ETTh1/DiffusionTS), which contradicts the statement "substantial performance degradation".
- The response on IAAT is not convincing. Lag1AC and VarAC still achieve comparable or better performance in many settings.
Considering the rebuttal, I maintain my score.
Response to Reviewer wQns
Dear Reviewer wQns,
We sincerely appreciate your thorough review and valuable comments. We believe that the main concerns may stem from experiment results and distinctions from prior work. We respond to each point below to clarify core contributions of our method.
Response to W1:
Thank you for raising this point. We clarify that the ablation results indicate that each component is necessary and contributes to the overall performance of ANTS. Although the gains may appear modest in a few cases from figure, the actual improvements are consistent across experiments and can be substantial for particular settings. Since ANTS is designed to be a architecture agnostic method, each component that potentially play a critical role is essential to achieving broad effectiveness.
We understand that the differing scales may obscure some effects. We provide the numerical ablation results in the table below. It shows the contribution of each component more clearly and indicate that full ANTS performs best among variants.
Response to W2 and Q3:
Thank you for your feedback. We prefer IAAT since it achieves optimal overall performance across a broad range of settings compared with Lag1AC and VarAC. IAAT captures autocorrelation across all lags and reflects finer temporal dependence than Lag1AC and VarAC. Tables 3, 6 and 7 support its strong average performance. In particular, IAAT ranks among the top-2 in 42 of 48 settings, compared with 26 for Lag1AC and 22 for VarAC. It supports IAAT as a generally effective statistic.
Besides, as we have discussed in Section 5.4, there is no universally optimal statistic for measuring time series corruption. We emphasize that the advantage of IAAT is its broad robustness rather than being best for each individual setting. More generally, our main contribution lies in the method for adaptively constructing schedules based on time series statistics. As demonstrated by experiments in Appendix D.3, it exhibits strong robustness to different statistical measures. Although we adopt IAAT in the current implementation, the framework can be flexibly adapted to other suitable measures.