-
Quantization is important per-se, but this paper's motivation for why Quantization is important poorly defined. Check the section below on Introduction/Motivation related flaws. There are various factual flaws in the paper's positioning and I strongly recommend fact-checking and rewriting.
-
Contributions are overly oversold. Regarding the actual method, I detail what's been obfuscated and wrongly attributed in the following points, here I strongly recommend removing the contribution number 3 from this paper. Demonstrating "on-device deployment" engineering is a good to have, but cannot be claimed as a contribution of a research submission anymore. Especially given the ready availability of AI agents, and their capability of porting complex systems over to hardware [1] such as Apple Metal, I strongly vote against allowing submissions to claim this effort as a major contribution.
-
Regarding the proposed method, the authors do not properly delineate what's new and what's being taken from previous papers. For instance line 160 - 198 are borderline plagiarism from Fairy2i [2], including equation-by-equation copy. The problem isn't that the paper uses it, but that it calls it their proposal, instead of calling it a preliminary section.
-
Same with the section on Hierarchical quantization strategy: This is basically HAWQ’s second-order perturbation analysis [3], HAWQ-V2’s HVP-based aggregate-curvature layer ranking [4], and FIT’s empirical-Fisher-trace sensitivity metric [5]. None of these are properly pointed out in the this paper, and are appropriated as the paper's own original proposals.
-
Weight Channel Reorder appears to be the paper’s only original algorithmic contribution. The method is simple and technically motivated: output channels are ranked by the magnitude of their signed mean and interleaved so that adjacent ranked channels form complex pairs, with the objective of improving alignment with the four-axis complex quantization codebook. Although the proposed statistic is a coarse heuristic and does not directly minimize complex quantization error, the method is computationally inexpensive and appears empirically beneficial. Its novelty and effectiveness should be evaluated against random permutations, alternative channel statistics, and direct quantization-error-based pairing. Some simple, but important baselines, especially for a paper that is entirely resting on the shoulders of this weight channel reordering strategy alone.
-
The experiments are mostly sound, and it is interesting that this simple WCR does improve what is otherwise just application of Fairy2i [2] for image generation, but as mentioned in 5, the simple permutation and pairing flavor baselines must be included to demonstrate the robustness of the WCR clearly.
Introduction/Motivation flaws:
-
Lines 38-43 are highly speculative. I have not seen any direct need so far, for the years I have worked myself, so any references or surveys backing these statements would be helpful. Otherwise, consider rewriting the motivation or toning down the speculative claims. To my understanding, the Dhar et al 2021 survey covers old ML techniques and nothing about generative models image/video/audio or otherwise. Same with lines 44-48, they are highly speculative and under-backed. As far as I know, the highest demand in the industry at the moment is for hybrid deployments for generative models, and not for entirely edge deployments.
-
Lines 49-53, Note that Quantization is just one technique that offers a low-effort-low-reward generic solution for on-device deployments. On the contrary, specialized model post-trainings, Efficient Attentions, FLOPs reductions, and Model pruning are still preferred over, or in conjunction with, off-the-shelf quantizers. Consider revision. This argument is further strengthened by Figure 4, where model size is drastically improved, but latency is not affected much. Thus as mentioned, Quantization is not a one-stop solution for improving all aspects of on-device deployments, and other efficiency techniques are equally important for deploying E2E complex generation systems on edge devices.
-
Line 58, I'd recommend to stay away from power consumption for this paper. Because power consumption is a very complex phenomenon for on-device executions. For instance the authors correlate Matmul operations and power-consumption, which is very loosely true, but it turns out that power-consumption is actually most affected by memory transfers, and any gains if to be obtained lie there. Fact checking recommended. This argument is further strengthened by figure 4, where very minimal power consumption effect can be seen with Quantization.
References:
[1] https://x.com/unixpickle/status/2109502228620840976?s=20
[2] Wang, F., Tan, X., Huang, B., Zhang, Y., Wang, G., Cong, P., & Yang, T. (2025). Fairy2i: Training Complex LLMs from Real LLMs with All Parameters in ${\pm 1,\pm i} $. arXiv preprint arXiv:2512.02901.
[3] Dong, Z., Yao, Z., Gholami, A., Mahoney, M. W., & Keutzer, K. (2019). Hawq: Hessian aware quantization of neural networks with mixed-precision. In Proceedings of the IEEE/CVF international conference on computer vision (pp. 293-302).
[4] Dong, Z., Yao, Z., Arfeen, D., Gholami, A., Mahoney, M. W., & Keutzer, K. (2020). Hawq-v2: Hessian aware trace-weighted quantization of neural networks. Advances in neural information processing systems, 33, 18518-18529.
[5] Zandonati, B., Pol, A. A., Pierini, M., Sirkin, O., & Kopetz, T. (2022). Fit: A metric for model sensitivity. arXiv preprint arXiv:2210.08502.
Justification: Overall, this paper is a Borderline for me, mostly inclining towards rejection actually, because of the notorious presentation and borderline plagiarism. But I am not opposed to giving the benefit of doubt to the authors here. I don't mind borderline accepting this paper, in spite of minimal incremental contribution. But the wrong claims and contributions must be fixed, which I am unsure if this is something that can be done within the scope of rebuttal. Generally interested in other reviews for this paper as well.
No response received from authors on this one yet.