- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates why quantization weakens closed-form knowledge edits. Using a classical dither argument and controlled quantization experiments, it attributes most single-edit degradation to changes in upstream keys and downstream readout rather than rounding of the edited weights. It proposes quantization-aware editing (QAE), which recomputes the key and target value through the quantized network.
Critical strengths
The main contribution is a carefully qualified mechanistic explanation supported by theoretical analysis and extensive channel-isolation experiments. The evaluation includes multiple model families, quantizers, released-editor configurations, and held-out paraphrases. Explicit reporting of failed predictions, generic quantization effects, and QAE’s limitations makes the conclusions more credible.
Critical weaknesses
The practical benefit is less established than the margin recovery suggests. Under the tested 4-bit GPTQ/AWQ configurations, only 3 of 800 edit–quantizer pairs lose efficacy, and all eight paraphrase-recovery intervals include zero. At 3 bits, QAE improves free-generation performance on GPT-2-XL but shows no significant recovery on Llama-3.2-3B despite substantial margin gains. These results leave uncertainty about when restoring margins meaningfully improves model behavior.
The deployment conclusions need validation with an actual serving pipeline. The GPTQ/AWQ experiments use custom simulated-quantization implementations rather than checkpoints produced and executed by the released toolchains. Downstream calibration statistics are also retained from the unedited model, and instruction-tuned models are evaluated without chat templates. These choices may affect the conditioning central to the proposed explanation.
Questions for authors
The same as weaknesses