- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a privacy amplification framework for black-box LLM inference. The framework shuffles locally privatized prompts with independently generated pseudo prompts, allowing weaker local perturbation under an end-to-end privacy budget. The accountant bounds sequence-level moments using per-step quantities and propagates them through shuffling. Authors conducted experiments on MMLU and MedicalQA and evaluated utility and complexity.
Critical strengths
Combining per-step moment bounds with shuffle accounting addresses a computational bottleneck, making mechanism-aware privacy accounting computationally tractable.
Critical weaknesses
- Evidence is limited for the accountant's tightness or method's utility on longer sequences. Fig. 4 reports tightness only at T=5 and runtime up to T=7, while the application setup allows much more tokens. Sec 5.4 uses worst-case per-step bounds; Sec 6.3 notes that the moment bounds and overlap coefficient can introduce looseness. Experiments in sec. 7.2 show promising utility results, but authors did not report the length or discuss how varying the length would affect the privacy bounds or the utility, which is important for the practical application setting.
- I found it hard to judge the additional contribution of the accountant on top of the prior work Girgis et al. [1], which already derive the common-component reduction and express shuffled likelihood-ratio moments through local ratios.
References
[1] Girgis, A. M., Data, D., Diggavi, S., Suresh, A. T., and Kairouz, P. On the Renyi Differential Privacy of the Shuffle Model. ACM CCS, 2021.
Questions for authors
- Can the authors report privacy bounds and accounting time as sequence length increases, along with the local parameters, overlap values, and actual group sizes used for accounting?
- Which steps go beyond the analysis in Girgis et al.? What improvement in privacy bounds or computation come from those steps?