- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper presents a coherent two-stage design that explicitly separates fine-grained error representation from layer-wise compensation-strength selection. The empirical evaluation is relatively broad across three model families and three PTQ methods.
Critical strengths
The main experiments include six models spanning Llama, Qwen, and Gemma and evaluate GPTQ, AWQ, and QuIP under 2-bit weight-only quantization, WikiText-2 PPL results show that PATCH improves substantially over the uncompensated GPTQ and other compensation methods. The ablation experiments also show the contribution of two stages, demonstrating the necessity of the second stage.
Critical weaknesses
Under the w2a16 precision setting, although the PPL after error compensation show substantial improvement over other methods, they still fall short of QAT-based methods such as EfficientQAT. Under the W2A16 setting, post-training quantization (PTQ) seems to offer limited value.
Questions for authors
- In the isolated setting of Figure 2(b), should the end-to-end loss curve reach 1 at its optimum? Please supplement the definitions of local error and end-to-end loss in Figure 2.
- Stage one optimizes m_{c,g}, while stage two optimizes the magnitude of m_{c,g} within each block. Why not directly train with a joint loss in a single stage, rather than splitting the procedure into two stages?
- Why does stage two remain at block-level granularity instead of refining the granularity down to the group level as well?