- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies learning under user-level LDP, where each of n users holds m samples and releases only a privatized message based on their entire local dataset. The authors first develop nearly minimax-optimal methods for one- and high-dimensional mean estimation across different privacy regimes, and then extend these ideas to stochastic optimization, nonparametric classification, and regression.
Critical strengths
S1. The paper studies an important and relatively underexplored privacy model.
User-level local differential privacy is highly relevant when each user contributes multiple observations, yet it has received much less attention than either item-level LDP or user-level central DP.
S2. The main statistical message is interesting.
The paper shows that, under the authors' i.i.d. user-sampling model, user-level and item-level LDP can have nearly the same convergence rates for bounded distributions. For heavy-tailed mean estimation, the user-level rate can even be faster.
S3. The paper covers a broad range of statistical problems.
Starting from mean estimation, the authors consider high-dimensional mean estimation under different support geometries, stochastic optimization, nonparametric classification, and regression.
Critical weaknesses
W1. The statistical model is much more restrictive than the motivating user-level/federated-learning setting.
The paper assumes that all data are i.i.d. from a common distribution. In realistic user-level or federated settings, observations from the same user are often dependent, and different users can have heterogeneous distributions. It is unclear whether the main conclusions survive under even mild within-user dependence or user heterogeneity.
W2. Beyond the mean-estimation primitive, several extensions appear largely reduction-based.
The paper is broad, but I am less convinced that all of these applications provide substantial new methodological ideas beyond the core mean estimation result.
W3. There is no empirical evaluation.
The paper is entirely theoretical. Even for a theory-focused ICLR submission, numerical experiments would be valuable for illustrating the claimed phase transitions, the finite-sample effect of , the transition between privacy regimes, and the practical gap between the upper bounds and actual performance.
W4. Several results rely on strong assumptions or knowledge of problem parameters.
The bounded-mean results assume a known support radius , the heavy-tailed results rely on moment conditions, stochastic optimization assumes strong convexity and almost surely bounded gradients, and the nonparametric results impose Holder smoothness. It is not clear which tuning parameters require these quantities to be known, or whether adaptive versions are possible.
W5. The presentation is not sufficiently polished.
The paper would benefit from a substantial language and technical-editing pass.
Questions for authors
See weaknesses