- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how quantization affects bias in LLMs. It introduces QuantiBias, an evaluation protocol combining multilingual open-ended stereotype probes with refusal, over-refusal, multiple-choice bias, and capability benchmarks as controls. The main finding is that quantized models can maintain their performance on standard safety checks while still generating stereotypes in open-ended tasks. Whether open-ended bias increases with stronger compression is less certain, as the trend depends on the judge scoring the responses. The paper also compares reasoning on and off: reasoning roughly halves open-ended bias on Qwen under the lean judge, but does not show the same benefit on Gemma. Overall, the results suggest that standard safety checks alone are insufficient for evaluating bias in quantized models, and that both model configuration and judge choice matter.
Critical strengths
-
The paper identifies a useful gap in how quantized models are evaluated. Refusal and multiple-choice bias scores remain nearly unchanged, while the same models still generate stereotypes in open-ended tasks. This motivates evaluating open-ended behavior rather than relying only on standard checks.
-
I like the comparison between reasoning on and off. Reasoning roughly halves the stereotype endorsement rate on Qwen under the lean judge, but does not show the same benefit on Gemma. This shows that reasoning alone cannot be assumed to provide the same safeguard across models.
-
The evaluation includes multiple languages and a second generative benchmark, CEB. Comparing the same prompts across precision levels and reasoning settings is also useful for examining behavioral changes.
-
The authors acknowledge the limitations of LLM-as-judge and cross-check the lean judge with two independent judges. Reporting the disagreement, including its effect on the compression trend, makes the results easier to assess.
-
Measuring effective bits per weight rather than relying on nominal quantization labels is a practical strength. The evaluation protocol and scoring harness could also be useful for checking models before deployment.
Critical weaknesses
-
The main results are highly dependent on the judge. On Qwen, the lean judge reports endorsement rates increasing from 4.2% to 7.8%, while the independent judge reports much higher but roughly flat rates. The two independent judges agree, but this does not validate the lean judge, which the authors report as uncorrelated with both.
-
The distinction between stereotype endorsement and responding to a loaded prompt needs further validation. Of the 48 one-bit cases labeled as endorsements by the lean judge, 10 received a severity score of zero from the independent assessment. This raises questions about how the rubric separates factual or contextual statements, prompt compliance, and actual stereotype endorsement.
-
Several central comparisons contain only two or three precision levels, and the five-family screen does not resolve the compression slope within its uncertainty intervals. The reasoning benefit is also primarily supported by the lean judge. These results support model-specific observations, but broader claims about compression or reasoning need stronger evidence.
Minor comment
- The text in Figure 1 is too small to read comfortably.
Questions for authors
-
Are all evaluations single-turn? In a multi-turn conversation, does stereotype endorsement persist, become reinforced, or fade as the conversation continues?
-
How do the judges distinguish factual statements about group differences (true statistics) from stereotype endorsement?
-
How do the compression trends compare between MBTP and CEB? The independent judge reports a roughly flat trend on MBTP but an increasing trend on CEB. What might explain this difference?
-
The exact judge prompts and endorsement criteria are not provided in the appendix. In particular, how are judges instructed to distinguish stereotype endorsement from quoting, rejecting, or discussing a stereotype, factual statements about group differences, and compliance with a loaded prompt?
-
Model-specific bias is already well documented in prior works including [1], and the evidence linking stronger compression to increased bias is inconclusive and judge-dependent. What new insight does this study establish specifically about quantization, beyond showing that standard safety scores do not capture open-ended bias?
[1] Jeong, Hyejun, Shiqing Ma, and Amir Houmansadr. "Bias Similarity Measurement: A Black-Box Audit of Fairness Across LLMs." ICLR. Vol. 2026.