- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies whether quantization reduces reproduction of training data more than general capability. It measures this difference through a selectivity gap across five Pythia sizes, Amber-7B, several quantizers, and Stable Diffusion models. It also examines which memorized examples survive quantization, finding associations with SAM sharpness in language models and initial-noise basin stability in diffusion. An additional diffusion experiment separates the effects of weight and activation quantization.
Critical strengths
S1. The selectivity gap is a useful and interpretable comparison. Measuring extraction and capability against the same full-precision baseline makes their different responses to quantization clear. The positive gap appears across the tested language-model sizes, quantizers, and both model families. A related concurrent preprint [1] reports the same qualitative phenomenon using a different metric; explaining how the present study extends that work would help position its contribution.
S2. The activation decomposition provides useful insight. Table 2 isolates weight and activation quantization and attributes the observed elimination of image copies primarily to the activation component.
References
[1] Akshay Sasi. Bits and Memories: Measuring Verbatim Extraction Across LLM Quantization. arXiv:2607.25451, 2026.
Critical weaknesses
W1. The diffusion mechanism has unclear independent image coverage and an incomplete definition. The primary set R contains 70 captions but only five independent reference images. The authors acknowledge similar caption dependence in the mechanism set S, but do not report its number of independent image groups. Its caption-level intervals and significance test therefore do not establish generalization across independent images (Section 7; Appendix G). The additional image groups validate the quantization intervention, but not the basin predictor. The paper also omits its complete computation: perturbation distribution, radius values, number of perturbations, similarity measure, and aggregation rule. A reproducible definition and analysis accounting for image groups are needed to assess this central result.
W2. The language-model analysis does not isolate curvature from general perturbation sensitivity. SAM sharpness measures loss increase within a finite perturbation radius. Since an individual sequence's gradient need not vanish, this statistic includes first-order sensitivity as well as curvature. The reported association supports local sensitivity to weight perturbations. A curvature-specific interpretation requires separating the second-order contribution or showing that the association is not explained by the gradient term.
W3. The language-model effect is not specific to memorized training text. Table 7 shows that confidence-matched held-out continuations are about as fragile as memorized continuations. This points to a broader sensitivity of exact generation supported by model weights, rather than a vulnerability specific to training-data memorization. Appendix F also shows that the NF4 extraction reduction at 12B falls from 37.3% under greedy decoding to 23.7% under stronger search. The gap remains a useful empirical finding, but the main text should foreground these limits on its privacy interpretation. As the authors acknowledge, failure of exact reproduction also leaves open whether the same information remains accessible in other forms.
W4 (Minor). Model coverage limits transfer to current deployment settings. The diffusion experiments use SD v1.4 and SD2.1-base. The conclusions should remain tied to this coverage. Newer diffusion backbones would be useful extensions where comparable training-data ground truth is available.
W5 (Minor). The five-bit elimination claim needs qualification. Appendix H already explains the threshold dependence and incomplete suppression in SD2.1, while Appendix G.1 shows that the precise six-to-five-bit collapse is not universal across image groups. The abstract and contribution statements should consistently describe suppression with these qualifications.
Questions for authors
Q1. Could you assess whether the GPTQ selectivity gap persists under the stronger extraction procedure in Appendix F?
Q2. How many independent reference-image groups are in the basin-stability regression? Could you provide its full definition and assess the association at the image-group level, including the additional groups in Appendix G.1?
Q3. How does the implemented SAM statistic distinguish curvature from first-order sensitivity?
Q4. How should the privacy benefit be interpreted if the same information remains accessible through non-verbatim outputs?
We thank the reviewers and the area chair for their time. Reviewers noted that the selectivity gap is interpretable, the paired design is controlled, the use of open-data models is sound, and the weight-and-activation decomposition is informative.
We want to note what the current paper already establishes:
The reviews also gave helpful feedback, which we will use to improve the paper. Table 7 shows that confidence-matched held-out text is about as fragile as memorized text, so the claim is best stated as exact recall stored in the weights, with memorized text as one case. SAM sharpness at a finite radius includes a first-order term, and we will separate it from the second-order curvature term. We will also state the threat model on the first page. Our limitations section already states that the effect is not a guarantee.
We are withdrawing to incorporate these extensions properly rather than within a short discussion window.
Note. arXiv 2607.25451 was posted on 28 July 2026, about seven weeks before the abstract deadline. arXiv 2610.00382 was posted on 30 September 2026, after the submission deadline.