- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper provides mechanisms for differentially private inference in the setting of manifold-valued regression. In particular, it does a one-shot DP release, followed by post-processing to obtain pointwise and Wald confidence regions.
Critical strengths
- The work is substantial in the context of the niche DP-Geometric Statistics community, with potential advanced applications involving manifold-valued data.
- The theory is reasonably done, although some questions remain as covered in the review.
Critical weaknesses
- How is K chosen in practice though? What kind of apriori information is needed to get a guess for a reasonable K? 2.) Why is the error lower for the private (noised) setting than the no-noise setting? Seems counter-intuitive. What insight are you trying to emphasize as a take away there?
Questions for authors
- How is K chosen in practice though? What kind of apriori information is needed to get a guess for a reasonable K?
- The description of some terminologies needs substantial care, before using them. -For instance, the phrase shooting-vectors is not known to the wider generic community overall, and is used about 18 times without explaining it. -Similarly, the concept of clipping for sensitivity bounding is well known in the DP community. But you use the concept of active and inactive clipping, without explaining what they refer to. 3.) Why is the error lower for the private (noised) setting than the no-noise setting? Seems counter-intuitive. What insight are you trying to emphasize as a take away there?
3 comments
Thank you again for your thoughtful review and helpful suggestions. We hope our responses and revisions have addressed the issues you raised, and we would be glad to clarify any remaining points. If you are satisfied that your main concerns have been resolved, we would be grateful if you would reconsider your assessment and score in light of the revisions.
Follow-up on our responses
As the discussion period draws to a close, we would like to thank you again for your time and careful review. If time permits, could you let us know whether any questions remain after reading our responses? We would be happy to clarify any remaining points. We appreciate your consideration and the valuable feedback you have provided.
Thank you for your time and valuable comments. We appreciate the opportunity to clarify our work and improve the manuscript.
W1. Please see Question 1.
W2. Please see Question 3.
Q1. In our experiments, we specified K by setting ranges for the footpoint and shooting-vector coordinates based on the units of the variables and the scope of the study. The choice of K should reflect the interpretation of the parameters, estimation uncertainty, and the geometric conditions required by the model. It generally does not require knowledge of the true parameters or the full data-generating distribution. A formal approach is to use a private pilot computed from a sample independent of the subsequent inference sample. Suppose an error bound r is available such that the distance between the pilot and the true parameter is at most r with high probability. One can then choose K=\left\\{\eta: \\|\eta-\widetilde{\eta}\\|\le 2r\right\\}. The factor of 2 just leaves a positive margin, and it's not an optimal constant. Related ideas also appear in CoinPress (Biswas et al., 2020).
In practice, one can also specify parameter ranges directly from the units of the variables and the scope of the study. For geodesic regression, the main considerations are the plausible location of the footpoint p and the magnitude of the shooting vector v. For example, with a single predictor whose study range is scaled to [−1,1], imposing ∣v∣≤s ensures that the fitted curve travels a distance of at most s from x=0 to either endpoint. Thus, a useful starting point is to consider how much the fitted response could reasonably change over the predictor range, and then translate this into a bound on v. Together with a plausible range for p, this gives a specification of K in the chosen coordinates. These ranges should allow room for estimation uncertainty while satisfying the geometric conditions.
The relevant prior information therefore concerns the predictor units and range, plausible footpoint locations, and plausible variation of the fitted response. Public reference data can help supply this information but are not necessary. A publicly specified K can also be a parameter range fixed before the analysis and independently of the protected observations.
Q2. We will explain these terms when they first appear. A shooting vector is a tangent vector specifying the initial velocity of a geodesic. We use norm clipping for per-sample scores, Hessians, and score second moments. Clipping is active when a contribution's norm exceeds its threshold and the vector or matrix is scaled down to that threshold. Clipping is inactive when its norm is at or below the threshold and the contribution remains unchanged.
Q3. In the main simulations, Full LS applies no privatization at all and minimizes the geodesic least-squares loss over the full sample. We use it as a nonprivate error benchmark. No-noise keeps the same private pilot and sample split as Ours, but adds no Gaussian perturbation at the inference stage. This gives a benchmark for the cost of privatizing the inference stage, which is exactly the stage we focus on given a private pilot. The other methods (Ours, Seq-E, and Seq-M) privatize both the pilot and the inference stage. In Table 1, all three fully private methods have higher mean curve error than both No-noise and Full LS in every reported configuration, and No-noise also has higher mean curve error than Full LS. This is consistent with the accuracy cost of privatization. To avoid confusion, we will rename No-noise and write Full LS as Full LS (nonprivate).
Thank you again for your valuable feedback. We hope our responses address your concerns, and we welcome any further questions or discussion.
[1] Sourav Biswas, Yihe Dong, Gautam Kamath, and Jonathan Ullman. CoinPress: Practical Private Mean and Covariance Estimation.