- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper investigates the non-response problems under local differential privacy: those independent of private categories and those dependent on private categories. For the former, the authors model the response as independent erasure following a random response and derive the information contraction and estimation risk; for the latter, the authors analyze additional privacy loss, sample selection bias, and the unidentifiability of the population distribution, and provide an unbiased corrected estimator when the response probability is known.
Critical strengths
-
The paper studies a meaningful problem: how nonresponse affects privacy guarantees and statistical estimation under local differential privacy. Understanding these effects is important for reliable privacy-preserving data collection.
-
The paper is well presented and easy to understand. Its clear organization helps readers follow the problem formulation and theoretical results.
Critical weaknesses
-
The category-dependent analysis assumes that users’ response probabilities depend on their private categories. However, it is unclear how such dependence can be established or verified in practice. The authors should clarify the empirical justification for this assumption and its implications for the applicability of the analysis.
-
The proposed unbiased correction requires knowing the true response probability for each category. These probabilities are difficult to obtain in practice, particularly. The authors should explain how these quantities can be obtained and evaluate how inaccurate estimates affect the correction.
Overall, the more refined results may stem from stronger assumptions about the response mechanism and the availability of category-specific response probabilities. This dependence should be made explicit when discussing the paper’s contributions and practical applicability.
Questions for authors
see Weaknesses
Rebuttal for Reviewer aWGa
Thank you for your careful review. We agree that the applicability of category-dependent nonresponse should be demonstrated rather than assumed, and that knowing the true category-specific response probabilities is an idealized benchmark. The revision addresses both concerns.
1. (Evidence for heterogeneous participation.)
Section 6.3 uses observed examination participation from two NHANES cycles. In August 2021--August 2023, 11,933 individuals completed the interview and 8,860 completed the examination. Examination participation across four age groups ranged from 0.6675 to 0.7911. The ℓ1 difference between the interviewed and examined age distributions was 0.0640.
These data establish unequal second-stage participation, not refusal to submit an LDP report; k-RR is simulated.
2. (How response propensities can be obtained.)
Section~7 now discusses two settings: response probabilities determined by a reporting protocol and probabilities estimated using a consented validation sample that observes both category and response status.
The NHANES experiment uses 1,000 held-out records from the same survey cycle for calibration. This is a sample-splitting demonstration, not evidence that an independent external source exists. In a prospective application, validation would require a consented subset containing both category and response status, or a documented reporting protocol, with sufficient representation of rare categories. Without such additional information or assumptions on selection, the nonidentifiability result applies. In particular, population marginal totals alone do not generally determine all category-specific response probabilities.
3. (Effect of estimation error.)
We retain the known-propensity estimator as a theoretical benchmark but extend the analysis to estimated propensities. Eqs. (27)--(28) give the exact conditional bias and mean squared error, while Section 5.1 and Figure 1 quantify how estimation error can also affect the actual privacy guarantee when estimated propensities determine the informative channel.
A separate experiment in Appendix C.2 varies the calibration sample size from 100 to 20,000 while keeping the study channel fixed. At fixed study size, mean raw MSE decreases from 0.009791 to 0.005340. This experiment is distinct from the matched joint deployment in Figure 1. It also exposes the limits of plug-in calibration: at Ncal=100, only 32.7% of estimated designs are feasible under the estimated constraints; at Ncal=20,000, the estimated feasibility fraction reaches 100%, yet 49.5% of those point-estimate designs exceed the target when evaluated at the true propensities. This is not evidence that larger samples worsen privacy. As sampling noise becomes smaller, a boundary-calibrated design can still be on either side of the target unless it has a validated safety margin.
4. (Practical performance.)
For NHANES 2021--2023, plug-in correction changes mean projected ℓ1 error from 0.19362 to 0.17883 for age (paired difference −0.01479, 95% simulation-bootstrap interval [−0.02521,−0.00383]), but from 0.31672 to 0.32272 for race/ethnicity. We report both outcomes: finite-sample gains depend on the strength of selection and the quality of calibration.