- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a context-aware diffusion framework for continuous time event sequence forecasting. The key idea is to introduce flexible noise scales that adapt to the temporal structure of individual events over the diffusion process. The experimental results show improvements on time predictions.
Critical strengths
- The key idea is clear and straight-forward.
- The improvements showed in experimental results are convincing.
Critical weaknesses
- The temporal heterogeneity of the experimental datasets is not characterized. Although some datasets are qualitatively described as sparse, it is difficult to determine whether larger performance gains actually correspond to greater temporal heterogeneity.
- Eq. (19) appears to contain a notation or formulation error on my side. May need a check.
Questions for authors
- How does ScaleDiff differ from existing data-dependent adaptive noising frameworks?
- Could the authors explain how the framework achieve “locality-aware”?
- Since ScaleDiff is specifically designed for datasets with significant variation in temporal event distributions, how does its performance change across datasets with different levels of temporal heterogeneity?
6 comments
Response to Reviewer p4uw (continued)
Q1: How does ScaleDiff differ from existing data-dependent adaptive noising frameworks?
We thank the reviewer for raising this question. The central novelty of ScaleDiff is not simply the introduction of adaptive noise, but the explicit connection between relative inter-arrival times, local temporal density, and event-specific corruption variance. Existing frameworks demonstrate that data-dependent or structured noising can improve diffusion. However, their adaptation mechanisms operate at different levels and are designed to capture different structural properties. In the following, we discuss the existing adaptive noising frameworks and demonstrate how ScaleDiff differs from them.
-
MuLAN [1]: Input-dependent adaptation versus temporal-density-guided adaptation. MuLAN introduces multivariate, input-dependent diffusion schedules learned through a variational objective, enabling different noise rates across image coordinates. Thus, MuLAN is genuinely data-dependent. ScaleDiff differs in how this adaptation is determined. Rather than relying on a generative objective to learn an unrestricted coordinate-wise noise allocation, ScaleDiff explicitly constructs event-specific scale targets from relative inter-arrival times. This introduces a direct relationship between temporal proximity and corruption magnitude: short intervals in dense regions receive smaller scales, while longer intervals receive relatively larger scales. For temporal event streams, input dependence alone does not guarantee that noise allocation reflects local event density. MuLAN learns adaptive corruption from input characteristics; ScaleDiff explicitly supervises the adaptation using a temporal-density-based scaling rule. This provides a targeted inductive bias for protecting fine-grained event timing.
-
Inverse Heat Dissipation [2]: Spatially structured corruption versus irregular temporal locality. Inverse Heat Dissipation employs heat-equation-based smoothing to progressively suppress high-frequency spatial information. Its forward operator exploits the regular geometry of image grids and is not dynamically adjusted according to the local density of individual input samples. In temporal point processes, consecutive event indices may correspond to milliseconds or hours of elapsed time. Therefore, applying an image-oriented smoothing operator over event positions would not automatically distinguish dense bursts from sparse regions. ScaleDiff instead determines the corruption magnitude from actual relative inter-arrival times, explicitly accounting for irregular physical-time separation rather than assuming uniformly spaced neighboring observations.
-
Non-Isotropic Gaussian Diffusion [3]: General covariance flexibility versus data-dependent, locality-aware covariance. Non-Isotropic Gaussian Diffusion generalizes the forward process to Gaussian noise with a specified non-isotropic covariance. Its central contribution is mathematical flexibility in the noise distribution, rather than learning a separate covariance from each sequence's temporal-density structure. ScaleDiff goes beyond allowing non-uniform covariance by specifying what determines that covariance. Event-specific scales are constructed from relative inter-arrival times, ensuring that the target corruption variance explicitly reflects dense and sparse temporal regions. Thus, non-isotropic diffusion establishes that covariance can be structured, whereas ScaleDiff establishes a temporally meaningful rule for constructing sample-specific covariance. The distinction lies in explicitly incorporating event-time heterogeneity into the corruption mechanism.
-
Blue Noise for Diffusion Models [4]: Spectrally structured corruption versus temporal-density-dependent variance. Blue Noise introduces time-varying, spatially correlated noise to exploit the spectral properties of images. Although its correlation structure changes across diffusion timesteps, it is not designed to estimate separate noise magnitudes from the dense and sparse regions of each input event sequence. ScaleDiff instead adapts the marginal Gaussian variance associated with individual inter-arrival times. This distinction is particularly important because neighboring event indices do not imply fixed physical-time separation. While Blue Noise addresses how corruption is correlated across coordinates, ScaleDiff addresses how strongly each event interval should be corrupted according to its local temporal density.
[1] Sahoo et al 2024 Diffusion Models With Learned Adaptive Noise NeurIPS 2024
[2] Rissanen et al 2023 Generative Modelling With Inverse Heat Dissipation ICLR 2023
[3] Voleti et al 2022 Score-based Denoising Diffusion with Non-Isotropic Gaussian Noise Models NeurIPS Workshop 2022
[4] Huang et al 2024 Blue Noise for Diffusion Models ACM SIGGRAPH 2024
Response to Reviewer p4uw (continued)
Continuing Q1 response here.
What makes ScaleDiff methodologically distinct?
ScaleDiff introduces a complete locality-aware diffusion framework that explicitly connects temporal structure to event-specific noise variance.
First, relative inter-arrival times determine the initial scale targets, establishing a direct relationship between dense and sparse regions and their intended corruption magnitudes.
Second, these scales are incorporated into the forward Gaussian covariance.
Unlike a global scalar schedule, the diagonal matrix () allows different intervals within the same sequence to receive different noise variances at the same diffusion timestep.
Third, a separately trained scale prediction module learns to recover the initial scale targets from historical context, noisy intermediate states, and timesteps, enabling the adaptation during inference without access to future ground-truth intervals.
Finally, the predicted scales are incorporated into the corresponding Gaussian reverse transitions, allowing the proposed event-specific scaling mechanism to operate throughout sampling.
The distinction from existing data-dependent approaches is therefore precise - learning input-dependent corruption. ScaleDiff uniquely targets relative inter-arrival-time heterogeneity through sample-specific, event-wise variance scaling.
This design directly addresses the unequal relative impact of Gaussian perturbations on short and long inter-arrival times. Our region-wise reconstruction analysis, synthetic experiments, and forecasting evaluations across five real-world datasets provide empirical support for this locality-aware formulation. In summary, data-dependent noising alone does not imply locality-aware noising. MuLAN adapts according to learned input characteristics, and the other vision-based methods exploit prescribed structural properties. ScaleDiff explicitly identifies local temporal density as the property governing corruption and incorporates it into the forward covariance and scale-aware reverse process. This is the central methodological distinction of our work. We updated the Related Works in summary in Appendix D
Response to Reviewer p4uw
We thank the reviewer for their careful reading of our manuscript and for their constructive feedback. We appreciate the insightful comments and suggestions, which have helped us identify areas that require further clarification and improvement. We address each concern in detail below.We have uploaded a revised version of the manuscript, with updated and newly added text highlighted in blue for ease of reference.
W1 & Q3: The temporal heterogeneity of the experimental datasets is not characterized. Although some datasets are qualitatively described as sparse, it is difficult to determine whether larger performance gains actually correspond to greater temporal heterogeneity. Since ScaleDiff is specifically designed for datasets with significant variation in temporal event distributions, how does its performance change across datasets with different levels of temporal heterogeneity?
We thank the reviewer for asking the question of temporal heterogeneity in data.
We characterize inter-event timing using three global statistics: mean ($\mu$), standard deviation (σ), and coefficient of variation (CV=σ/μ). The mean quantifies the typical inter-event interval, the standard deviation measures absolute temporal dispersion, and CV measures dispersion relative to the mean. Statistics are computed over all inter event time values pooled within each dataset, including the initial event's gap; the global standard deviation uses the sample definition.
Lower RMSE Time is better. The relative improvement is
AA−B×100
where A=RMSETimeCDiff
B=RMSETimeScaleDiff
Performance across diverse real-world temporal distributions. We assess temporal heterogeneity using the global mean, standard deviation, and coefficient of variation (CV) of inter-event intervals. The five real-world datasets span markedly different temporal characteristics: global mean intervals range from 0.1734 (Taobao) to 12.0068 (Retweet), global standard deviations range from 0.2946 (Taxi) to 16.9006 (Retweet), and CV ranges from 0.652 (Amazon) to 2.506 (Taobao).
ScaleDiff consistently outperforms CDiff in temporal RMSE on all five real-world datasets, achieving reductions of 25.86% on Amazon, 18.02% on Stack Overflow, 21.65% on Taxi, 22.24% on Retweet, and 26.50% on Taobao. In particular, strong improvements are obtained at both relatively low temporal dispersion (Amazon: CV = 0.652) and high relative dispersion (Taobao: CV = 2.506). Retweet additionally demonstrates a substantial improvement despite having the largest absolute mean interval and standard deviation of the real-world group.
These results highlight ScaleDiff's consistent effectiveness across diverse real-world event-time distributions, encompassing distinct temporal scales and degrees of variability. The broad improvements support the practical value of ScaleDiff for temporal prediction under heterogeneous event-timing patterns. We provided the updated discussion in Appendix L.
W2: Eq. (19) appears to contain a notation or formulation error on my side. May need a check.
We thank the reviewer for identifying this error in the mathematical formulation. We acknowledge the oversight and clarify that the correct formulation is given by:
\operatorname{diag}\left( \frac{x_0-x_l}{x_u-x_l}(\kappa_u-\kappa_l)+\kappa_l \right).$$ We have corrected the corresponding equation in the revised manuscript to accurately reflect the intended formulation. We appreciate the reviewer's careful observation, which has helped us improve the mathematical clarity and correctness of the presentation.