- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studied the batch selection strategy for the differential privacy banded matrix factorization ( DP-BandMF) method. The paper proposed three new randomized batch selection strategies for DP-BandMF: Cyclic Random Allocation, Nested Random Allocation and Min Sep Random Allocation. Then the work established privacy analysis and computation analysis for the strategies. The authors evaluate their proposed strategies empirically compared with previous work on improved RMSE. Then they also studied DP-BandMF with Monte Carlo Accounting and show efficiency, GPU acceleration, and improved RMSE
Critical strengths
-
The paper studied a interesting problem.
-
The paper provided theoretical privacy analysis and computational analysis for its proposed batch selection strategies.
Critical weaknesses
-
The writing is confusing, and acronyms are introduced without expansion or full-name explanations, such as DP-BandMF in the title and abstract.
-
The paper contains a privacy analysis but no utility analysis.
-
The contribution and novelty are limited. The main framework is DP-BANDMF proposed in previous work.
Questions for authors
-
The privacy-utility tradeoff is important for DP work. Is it possible to provide a utility analysis like Section 3.2 in [1] for the new batch selection strategies for BandMF?
-
Could you show that your strategies outperform other baselines on other metrics beyond RMSE?
[1].Liang, Hao, et al. "An improved privacy and utility analysis of differentially private sgd with bounded domain and smooth losses." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 40. No. 28. 2026.
5 comments
Thanks for the response. For the utility, I am not asking about the empirical utility. I am asking about theoretical utility analysis like Approximation Error in Theorem 4 of https://arxiv.org/pdf/2505.12128.
For the writing, I mean authors should give the full name of DP-BandMF, like Differentially Private Band Matrix Factorization.
We thank the reviewer for their feedback; we respond to each point raised below:
W1 (Clarity & acronyms): We put a great deal of thought into the clarity of this paper, so we take this feedback seriously. We already define DP-BandMF in the first sentence of the abstract and explicitly define every batch selection strategy referenced throughout the paper in Section 2.3. Since the other two reviewers rated the paper’s presentation as clear and easy to follow, could the reviewer point us to specific passages or sections that felt confusing? We would be glad to clarify any specific parts during the discussion period and in the final revision.
W2 and Q1 (Utility analysis): First, note that RMSE is the standard utility metric for DP-MF. Even in papers that are more theory-focused (rather than application-focused as we are), RMSE is typically reported in place of an SCO bound (see e.g. Theorem 4 of https://arxiv.org/pdf/2505.12128). Second, getting a closed-form bound for σ that would be necessary to prove a theoretical RMSE or SCO bound requires computing a high-dimensional integral which is challenging; if it were not challenging, there would be no need for Monte Carlo accounting in the first place! In turn, any theoretical guarantees we could prove would be loose and in turn uninformative.
W3 (Novelty & simplicity): The reviewer is correct to point out that the paper builds on known building blocks (DP-BandMF, random allocation, Monte Carlo accounting), and we view the simplicity of our approach as a strength rather than a weakness: the batch selection strategies we propose are easy to implement, drop-in replacements for existing ones, and require no changes to standard DP training loops. At the same time, the empirical improvements are indisputably significant: 1.59x at the anchor (and up to 1.85x) lower RMSE than prior PLD-based state of the art (Cyclic Poisson), up to 1.24x lower RMSE than jointly optimized Balls-in-Bins. Moreover, making this simple idea practical required non-trivial theoretical contributions (Theorems 5, 6, and 8) and empirical / analytical contributions (Section 3.4, Section 4, and Section 5.3).
Q2 (Training metrics): Reviewer WZKG raised a similar point (see our response to Reviewer WZKG, W1); we repeat the relevant summary below for convenience.
We ran new fine-tuning experiments on a 2B Gemma 4 model on the PubMed dataset (N=80,000, T=512, K=8, δ=10-5, ε ∈ [1, 16]) and updated Section 5.3 of the paper with the full setup and results. Summarizing our main findings: