- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The writing quality is significantly below the bar. I would advise authors to make a complete work and carefully review before submission. This work doesn't follow usual scientific writing rules. The claims are just claims in this work not supported by evidences.
Critical strengths
NA
Critical weaknesses
This work's writing quality doesn't follow usual scientific writing rules and practices and significantly under the bar. Spending large amount of time for reading this work is difficult for reviewer. I managed to ignore the unusual presentation and focus on content/its idea. Unfortunately, after the reading the introduction, I still can't understand what is the method.
Questions for authors
- Presentation quality is significantly under the bar.
For example in abstract:
tatic 4-bit post-training quantization leaves each activation tensor only sixteen codes, making their allocation a first-order design choice.
In transformer MLPs, GELU confines negative outputs to a narrow, bounded interval, so nearly all of the output range lies on the long, unbounded positive side.
... there are more.
I would advise the authors to have LLM/native writer for reviewing the manuscript before submission.
- What is "Two-branch quantizers"?
Two-branch quantizers fit one range per sign yet split the codes evenly (8/8), spending half of them on the narrow negative interval.
-
Abstract is not the usual abstract in top conferences. The work wrapers almost everthing into the abstract making it worse for reading.
-
L39
Static post-training quantization (PTQ)
What is Static PTQ?
- L44-46
The GELU output, which feeds the second linear layer (fc2) of every transformer MLP, is a clear example. GELU is bounded below by−0.169971, so all negative outputs lie in an interval narrower than 0.17, whereas positive outputs are unbounded.
Why assume GELU?
The experiment (light) here is presented not well for scientific papers.
- Lacking experiments and baselines.