- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper propose Differentially Private Vine Copulas (DPRIVVE), an end-to-end differentially private synthetic data generator that models higher-order dependence via conditional propagation. This paper argues that, high-order dependences among data features, often being low-signal effects, can easily be wiped out via standard DP mechanisms. Therefore, the paper introduces vine copulas, a previously studied approach in other fields, to provide a framework for multivariate modeling by decomposing a joint distribution into univariate marginals and a sequence of bivariate copulas arranged in a vine structure. Experiment on both real and controlled higher-order simulation settings, showing the proposed DPRIVVE method's capability in modeling high-order dependencies among data features.
Critical strengths
- I like the controlled higher-order simulation datasets in the experimental part that directly demonstrates the effectiveness of the proposed method in the problem it aims to solve: modeling the high-order dependences among different sample features.
- The paper is clearly written and easy to follow. The way it introduces vine copulas is easy to follow and quickly gives me a high level sense of what the this part is for.
- The assumptions that are based on the mathematical formulation part is clearly stated and reasonable.
Critical weaknesses
- Although I like the controlled higher-order simulation datasets in the experimental part, they are way too easy and seem more to me like a toy demo rather than something that should appear in the main experiments. Other datasets included in the main experiments are also simple datasets (often tabular datasets) with limited number of features to deal with. Therefore, I think the experimental part is too weak given this interesting question. I would like to see experiments on (1) harder real datasets with more features compared to the current ones; (2) even image datasets that may also benefit from the high-order dependences within the dataset.
- Like show in Figure 5 and Figure 14, the results lines are flat with the change of epsilon, which does not reflect how larger noise under stricter noise will affect the method's performance. So I would like to see results with smaller values that should bring some more changes to the lines.
- How is calculated is not described in the paper.
- The models used in the experimental part is too easy, like decision trees. I do not doubt the importance of simple models, but I would like to know if this method has a potential to be still effective in larger and more complex deep learning models, even transformers models. Or, will DPRIVVE's effect be wiped out if applied with more complexed models?
Questions for authors
- Why don't you put more results to the main paper? currently it is shorter than 9 pages, but you still have a lot more results in the appendix.