- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
I have the following questions about this paper. Please help me analyze whether these are genuine issues based on the paper:
- The segmented scale format similar to Core-Tail is not original and has been explored in prior work, which limits the novelty of this paper.
- What advantages are brought by the constraints of segmented parameterization in AdaPivot?
- For AdaPivot's non-uniform quantization, how to design acceleration kernels? Considering the long-tail effect, why is there no comparison with fp4 quantization?
- What is the independent contribution of the additional endpoints proposed in this paper?
- The so-called Core–Tail Gap lacks sufficient statistical and causal evidence.
- Does the improvement under W4A4 truly come from the new format? The authors integrated AdaPivot into a relatively complete PTQ pipeline.
- There is a lack of real inference acceleration and hardware execution analysis.
Critical strengths
-
The paper addresses an important problem in low-bit LLM quantization: efficiently representing long-tailed weight and activation distributions.
-
The proposed format is compact and interpretable, and its parameter optimization is relatively straightforward.
-
The W4A4 results on larger Llama2 models are encouraging, especially the improvement over SliderQuant on Llama2-70B.
Critical weaknesses
- Limited novelty and insufficient justification of the proposed parameterization.
The core–tail representation appears closely related to existing distribution-adaptive and piecewise non-uniform quantization techniques. Previous methods, including LLM-FP4, BiE, and BlockDialect, have already explored flexible numerical formats for accommodating non-uniform distributions and outliers. Moreover, the proposed fitting procedure primarily relies on discrete candidate enumeration and alternating least-squares updates, making its algorithmic novelty relatively limited.
More importantly, the paper does not sufficiently justify why the particular piecewise parameterization offers a favorable trade-off compared with simpler fixed piecewise formats or more general learned non-uniform codebooks. Tables 4 and 5 show that fixed choices such as C=4 or S=6 individually achieve performance close to the full method, raising questions about the necessity of the proposed adaptive search.
A comparison with simpler piecewise quantizers and learned non-uniform codebooks under matched effective bit-width, calibration budgets, and reconstruction pipelines would help establish the distinct contribution of AdaPivot.
- Insufficient empirical evidence for the proposed core–tail gap motivation.
A central motivation of the paper is the claim that LLM weight and activation distributions exhibit a dense core and a sparse tail separated by a distinct low-density gap. However, the evidence is primarily based on selected distribution visualizations in Figure 1, without systematic statistics across layers, tensors, and quantization groups.
Furthermore, Table 3 suggests that adapting the tail stride contributes substantially more than introducing an explicit core–tail gap. Removing the gap only increases WikiText-2 perplexity from 7.15 to 7.55, while restricting the tail stride leads to considerably larger degradation.
Therefore, the current experiments more convincingly establish the usefulness of non-uniform level spacing than the necessity of explicitly modeling a core–tail gap. A quantitative characterization of gap prevalence, together with an analysis of its correlation with quantization improvements, would strengthen the proposed motivation.
- Unclear attribution of W4A4 improvements to the proposed numerical format.
AdaPivot is integrated into a relatively sophisticated PTQ pipeline incorporating GPTQ-style sequential error compensation and optional components such as LET, LWC, and activation-error compensation. Although the paper includes ablations on individual format parameters, it does not adequately isolate the contribution of the numerical format from the surrounding calibration and reconstruction procedures under W4A4.
The supplementary W4A16 comparison provides some evidence of the format's effectiveness, but it does not fully explain the substantially larger improvements observed under W4A4.
A more convincing evaluation would compare uniform INT4, competitive FP4 formats, and AdaPivot under the same calibration and reconstruction pipeline. The authors should also clarify which auxiliary components are enabled for each reported configuration.
- Missing FP4 comparisons and insufficient evidence of practical inference efficiency.
Given that AdaPivot is motivated by the limitations of fixed formats in representing long-tailed distributions, comparisons with FP4-based approaches are particularly important. However, methods such as LLM-FP4 and BlockDialect are discussed in Related Work but are not included in the main quantitative comparisons.
In addition, AdaPivot uses non-standard reconstruction levels with group-specific format parameters. Although the integer-constrained representation may permit integer-based execution, it remains unclear whether these reconstructed values can be efficiently processed by existing low-bit GEMM kernels without additional decoding, conversion, or arithmetic overhead.
The paper does not report kernel-level latency, end-to-end inference throughput, or actual memory consumption. Consequently, while the numerical accuracy improvements are promising, the practical inference benefits remain insufficiently established. At minimum, the authors should clarify the intended execution path, effective storage cost, and computational overhead of the proposed format.
Questions for authors
1.Contribution of the extra negative endpoint. The paper compares assigning the redundant negative-zero code to positive and negative tail endpoints. However, it does not isolate the contribution of endpoint reuse itself relative to a format without the additional level. Given the connection to previous redundant-zero remapping methods such as RaZeR, a targeted ablation would help clarify its independent contribution.
2.Generalization of the experimental comparisons. The Qwen3 W4A4 experiments omit several strong baselines included in the Llama2 evaluations. More comprehensive comparisons would be useful to support the claimed improvements across model families.