- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces a dynamic Dirichlet process mixture model for privacy-aware synthetic-data generation. It uses time-dependent Ornstein–Uhlenbeck diffusion priors to modify centroid trajectories and derives an approximate differential privacy guarantee for posterior Dirichlet mixture weights. The method is evaluated using a synthetic temporal mixture and a smart-meter dataset.
Critical strengths
-
The paper identifies a meaningful distinction between group-level temporal information and record-level membership information.
-
The diffusion-based formulation provides interpretable controls over the temporal behavior of mixture centroids.
-
The authors provide detailed mathematical derivations and an application to real electricity-consumption data.
Critical weaknesses
-
Unclear privacy guarantees. The proposed diffusion-privacy definition only characterizes posterior mean deviations and does not establish protection against an adversarial trajectory reconstruction attack. The DP guarantee applies to a restricted randomized weight mechanism, not necessarily to the complete synthetic-data release.
-
Potential inconsistencies in the theoretical and experimental mechanisms. The posterior predictive construction uses expected mixture weights, whereas the DP theorem analyzes sampled Dirichlet weights. Additionally, the reported ((26.2,0))-DP guarantee in the smart-meter experiment is not adequately justified by the stated theorem, which includes a potentially nonzero failure probability.
-
Insufficient experimental validation. The evaluation relies on a one-dimensional synthetic example and one smart-meter dataset. The reconstruction attack is limited to clustering and smoothing, without stronger model-aware adversaries. The experiments also use manually designed perturbation targets, making it difficult to isolate the benefit of diffusion itself.
Questions for authors
-
What formal reconstruction-risk guarantee follows from -diffusion privacy?
-
Does Theorem 2 apply to the exact posterior predictive release implemented in the experiments?
-
How is the reported ((26.2,0))-DP guarantee justified given the positive tail probability in the theorem?
6 comments
Response to Reviewer ciqJ (Weakness 2)
Weakness 2: Consistency between the theoretical and experimental mechanisms and the reported DP guarantee
We would like to clarify that . Both points raised by the reviewer are consistent with our theoretical framework and numerical results.
1. Sampled Dirichlet weights versus expected mixture weights.
Theorem 2 establishes an -DP guarantee for the sampled Dirichlet mixture weights. Although the posterior predictive construction uses expected mixture weights, .
Specifically, Remark 1 explains how the privacy analysis of the sampled Dirichlet weights is related to membership leakage through the expected mixture weights used in the posterior predictive distribution. Thus, the use of expected weights in the posterior predictive construction does not represent an inconsistency with the theoretical analysis. Rather, the two results address related aspects of the proposed framework, as explicitly discussed in Remark 1.
2. Interpretation of the reported -DP setting.
The reported privacy setting is also consistent with the behavior of our theoretical bounds and numerical results. In Theorem 2, depends on the Dirichlet concentration parameter . $\color{#245A9B}{\text{Figure 7 in Appendix A.4.3 explicitly illustrates how decreases toward zero as increases}}$, across different sample sizes.
In particular, our experimental section states:
"Throughout, we set to impose only a weak -DP effect on the weights."
For the experimental sample size , Figure 7 shows that \color{#245A9B}{\text{\delta(500)$ is numerically extremely close to zero}}$, explaining the reported approximation and providing numerical evidence supporting the asymptotic result established in Corollary 3.
Importantly, the general definition of differential privacy permits , corresponding to pure differential privacy. Our theoretical analysis establishes the limiting behavior as , while the numerical results demonstrate that the failure probability is already negligible at the chosen value .
To avoid any ambiguity, we will clarify that the reported zero represents a numerical approximation to a very small positive value of .
Response to Reviewer ciqJ (Weakness 3)
Weakness 3: Experimental validation, reconstruction attacks, and perturbation design
We now clarify the scope of our experimental evaluation and address the reviewer's concerns.
1. Real-world dataset and higher-dimensional simulations.
Our real-data experiment uses electricity-consumption records from 7,975 customers, providing a substantial real-world sample for evaluating sensitive group-level temporal behaviors.
As discussed in our response to , we have investigated additional publicly available time-series datasets suitable for time-dependent clustering, where centroid trajectories are meaningful and potentially sensitive. However, the alternative datasets we identified either did not align with our primary research objective or were not publicly available. The was publicly accessible and provided an appropriate setting for evaluating our framework.
Regarding the one-dimensional simulation, our objective was to , including its variation across sensitive and nonsensitive periods. Visualizing these effects becomes more challenging in higher dimensions. We are currently exploring suitable higher-dimensional simulation designs, together with appropriate visualizations and numerical metrics, to extend this evaluation.
2. Reconstruction attacks and adversary knowledge.
Our reconstruction experiment considers an adversary who repeatedly clusters synthetic releases using -means and applies Savitzky-Golay filtering to estimate the underlying centroid trajectories. This attack is motivated by the reconstruction vulnerability discussed in the related literature.
Importantly, clarifies that the adversary may know the mean-reversion rates and the functional specification of the diffusion coefficients . Thus, our protection does not rely on keeping the general mechanism or its diffusion schedule secret.
However, the original observations, empirical centroids, instantiated data-dependent target means, and original cluster sizes are not released. Knowledge of the diffusion schedule alone therefore does not provide sufficient information to directly invert the posterior centroid estimates.
Despite our efforts to identify additional reconstruction attacks in the existing literature, we have not found model-aware attacks directly aligned with our setting. We would greatly appreciate any suggestions from the reviewer if they are aware of suitable methods that could further strengthen our experimental evaluation.
3. Owner-specified perturbation targets and the role of diffusion.
The perturbation targets are intentionally specified by the data owner because . This flexibility is an essential feature of our framework rather than an inconsistency in its implementation.
As clarified in , the general diffusion parameters and may be known to the adversary, whereas the instantiated data-dependent target means remain internal to the data owner. The sensitive time windows are also not explicitly disclosed, although periods of stronger perturbation may be inferred from the diffusion schedule.
We kindly encourage the reviewer to see our responses to regarding dataset diversity and regarding owner-specified perturbation parameters and the experimental baseline.
Response to Reviewer ciqJ (Weakness 1)
Weakness 1: Trajectory protection and scope of DP guarantees
We would like to clarify the two privacy guarantees and their distinct objectives.
1. Trajectory protection and reconstruction risk (Theorem 1 and new Proposition).
Theorem 1 characterizes the displacement of posterior centroid means through Us(βj), allowing the data owner to control perturbation over time, particularly during sensitive periods.
To quantify this protection more explicitly, we have added a new proposition immediately after Definition 1, establishing that
{\|\mathbf m_j(s)-\bar{\mathbf X}_j(s)\|} =1-\mathcal U_s(\beta_j).$$ This provides an exact quantitative measure of posterior centroid displacement from the empirical centroid relative to the distance between the empirical centroid and the prior mean trajectory. Unlike conventional differential privacy, which bounds changes in the output distributions of a randomized mechanism under neighboring datasets, our trajectory-protection measure quantifies how strongly the posterior centroid is displaced from its empirical counterpart. Specifically, the measure $1-\mathcal U_s(\beta_j)$ takes values between 0 and 1, representing the proportion of displacement from the empirical centroid toward the prior mean trajectory. For example, a value of 0.95 means that the posterior centroid is displaced by 95% of the distance between the empirical centroid and the prior mean trajectory, indicating substantial perturbation of the original centroid. This provides a direct quantitative characterization of the temporal perturbation achieved by our diffusion mechanism. Regarding adversarial reconstruction, $\color{#245A9B}{\text{Appendix A.3 (Threat Model and Adversary Knowledge)}}$ clarifies that the adversary may know the diffusion schedule. However, the original observations, empirical centroids, instantiated data-dependent target means, and original cluster sizes are not released. These undisclosed quantities prevent direct inversion from knowledge of the schedule alone. We also evaluate reconstruction attacks using repeated $K$-means clustering and Savitzky-Golay filtering. We kindly encourage the reviewer to see our response to Reviewer 5d3Y (Weakness 1, item #1) for further discussion of the quantitative trajectory-protection measure. **2. Motivation and scope of the formal DP guarantee (Theorem 2).** Our paper begins by identifying $\color{#245A9B}{\text{a different privacy risk arising in dynamic clustering applications, where sensitive}}$ $\color{#245A9B}{\text{temporal behaviors of cluster trajectories may matter more than individual observations.}}$ Motivated by reconstruction concerns identified in the literature, our primary objective is to protect these temporal patterns through controlled stochastic perturbation. $\color{#245A9B}{\text{Dirichlet process mixtures (DPMs) provide a natural foundation for addressing this problem.}}$ Unlike conventional clustering methods with deterministic centroids, DPMs model cluster centroids as random variables. Their Bayesian structure is therefore well suited to incorporating diffusion processes, opening a new direction for protecting sensitive temporal behaviors through stochastic centroid trajectories. This motivation led us to develop the proposed diffusion-based protection framework. After adopting the DPM framework, we recognized an additional useful property: $\color{#245A9B}{\text{the Dirichlet distribution governing the mixture weights provides a natural basis for establishing differential privacy for the}}$ $\color{#245A9B}{\text{sampled weights.}}$ We therefore investigated this property and established a formal $(\epsilon(\alpha),\delta(\alpha))$-DP guarantee in Theorem 2 under the stated conditions. $\color{#245A9B}{\text{This weight-level DP result is a complementary theoretical contribution, rather than the original motivation or primary}}$ $\color{#245A9B}{\text{objective of our framework.}}$ Our main contribution is not to establish individual-level DP simultaneously for mixture weights and centroid trajectories. Instead, we introduce and quantify a distinct form of protection for sensitive temporal behavior, while also demonstrating an additional privacy advantage of the Dirichlet weight mechanism. Accordingly, the DP guarantee in Theorem 2 applies to the sampled mixture weights, not to the complete synthetic-data release. For applications requiring individual-level DP guarantees for centroid trajectories which address a different privacy objective, Appendix A.7 (Limitations and Future Work) outlines two possible scenarios for extending the proposed framework in this direction. We kindly encourage the reviewer to see our response to Reviewer 5d3Y (Weakness 1, item #3) for further discussion of our primary motivation, the role of DPMs, and the complementary weight-level DP contribution.