- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes Modality-Native Functional Equalization (MNFE), a post-training quantization method for vision-language models. To address these limitations, the authors introduce MNFE, which consists of three components. Functional reconstruction partitions the projections within each Transformer block into three groups and employs group-specific reconstruction targets that incorporate subsequent operations. Hierarchical role-balanced reconstruction distinguishes visual, textual context, and answer tokens, assigning adaptive reconstruction weights based on their reference-state energy characteristics, while structured scale search improves the calibration procedure. Extensive experiments across multiple VLMs and quantization configurations demonstrate that MNFE achieves SOTA average performance among the evaluated methods in most settings.
Critical strengths
- The paper identifies limitations of existing PTQ methods for VLMs and addresses them using a unified framework that integrates functional reconstruction, role-adaptive weighting, and structured scale search. These complementary designs demonstrate methodological novelty and achieve strong quantization performance.
Critical weaknesses
- Despite its relatively complex design, hierarchical allocation improves the average score by only 0.1 points over fixed role weighting, while degrading performance on 5 out of 9 benchmarks. This marginal and inconsistent improvement raises concerns about whether the additional complexity is justified.
- Insufficient ablation studies. The paper lacks an isolated ablation of the structured scale search and a complete component-wise ablation of the three proposed components. Existing results suggest that functional reconstruction accounts for most of the performance gains, while the other components provide only marginal improvements or lack independent validation. Consequently, the main demonstrated contribution appears to lie primarily in functional reconstruction, rather than the full framework.
Questions for authors
- The effectiveness of hierarchical role-balanced reconstruction and structured scale search is not sufficiently supported by the current ablation studies. Could the authors provide additional experiments to isolate and quantify the contributions of these two components?
- Although MNFE emphasizes going “beyond local error,” the downstream operations considered in functional reconstruction are largely confined to the current Transformer block and the input RMSNorm of the subsequent block. This appears to be a form of short-range reconstruction rather than modeling long-range error propagation. Could the authors clarify the extent to which MNFE captures downstream effects and provide evidence that these local functional targets adequately reflect quantization errors propagated through deeper layers?
Response to Reviewer HYy8
We sincerely thank the reviewer for the careful evaluation of MNFE and for raising important questions about the individual contributions of its components and the scope of its downstream reconstruction objectives. We particularly appreciate the concern that the original presentation did not sufficiently distinguish the central contribution from the complementary components. We conducted additional component-wise experiments and cross-layer diagnostics to address these concerns.
Q1. Independent contributions of hierarchical weighting and structured scale search.
We agree that the original ablations did not fully isolate the contributions of all three components. We therefore conducted a complete 2×2×2 component ablation on Qwen2.5-VL-7B/W4A8, varying reconstruction targets (Local vs. Functional), role weighting (Fixed vs. Adaptive), and scale search (Initialization only vs. Initialization + Refinement), while keeping the calibration data and evaluation protocol fixed. The eight configurations are:
Across the four matched comparisons for each factor, the average effects are:
These results clarify the complementary roles of the three components. Functional Reconstruction provides the central change in the reconstruction objective, adaptive weighting further balances multimodal reconstruction errors, and group-wise refinement improves scale selection beyond initialization. We acknowledge that adaptive weighting provides a modest improvement and does not improve every benchmark. However, its additional three-seed comparison demonstrates consistently positive gains of +0.28, +0.41, and +0.23 points over fixed weighting. Group-wise refinement also provides gains of +0.39 to +0.64 points across the tested configurations. We believe these controlled experiments provide stronger evidence for the individual and complementary contributions of MNFE.
Q2. Does MNFE model long-range error propagation?
We thank the reviewer for raising this important conceptual question. We clarify that MNFE does not explicitly simulate quantization-error propagation through the entire remaining Transformer stack. Instead, it selects module-specific reconstruction targets that incorporate relevant subsequent operations at carefully chosen functional boundaries, including residual addition, normalization, and multiplicative gating. To investigate whether these targets better reflect deeper computational deviations, we conducted an additional cross-layer diagnostic on Qwen2.5-VL-7B/W4A8. Using 18 matched intervention positions, we measured Spearman correlations between reconstruction objectives and hidden-state deviations at progressively deeper Transformer blocks.
Functional Reconstruction achieves higher mean correlations at all four examined depths. This suggests that module-specific functional targets provide a modestly better proxy for certain deeper hidden-state deviations.
We also examined final-output metrics. The correlation with final-answer KL is 0.7228 for Functional Reconstruction versus 0.7459 for Local Reconstruction; the corresponding labeled-answer NLL correlations are 0.0222 and 0.0185. We therefore interpret the results as evidence that module-specific functional targets better reflect selected downstream hidden-state deviations, rather than claiming that MNFE explicitly models or consistently predicts full-network error propagation. We will clarify this scope in the revised manuscript. Importantly, this distinction does not change the central motivation of MNFE: reconstruction targets should account for relevant downstream computations rather than only local projection outputs.
Closing remarks. We sincerely thank the reviewer for the thoughtful comments on component-wise validation and the conceptual scope of downstream reconstruction. In particular, the question about long-range error propagation prompted us to conduct additional cross-layer diagnostics and sharpen the methodological positioning of MNFE. We greatly appreciate the careful reading and constructive suggestions, and would be delighted to address any further questions or continue the technical discussion.