- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies multimodal knowledge editing for resource-constrained on-device MLLMs and proposes EdgeEdit, an edge-oriented framework that jointly considers model compression and input compression for efficient in-context editing. Specifically, the paper identifies two compression-related challenges: quantization can degrade the utilization of retrieved edited knowledge, while edit-agnostic visual token reduction may remove edit-critical visual evidence. To address these issues, EdgeEdit introduces an edit-aware mixed-precision quantization strategy and an evidence-saliency guided token reduction module. The paper evaluates EdgeEdit on multimodal knowledge editing benchmarks with both server-side and mobile-device settings, providing a relatively novel experimental perspective by considering editing effectiveness together with practical system metrics such as memory usage, latency, and energy consumption. However, the technical contributions are mainly based on adapting existing compression techniques, including sensitivity-aware mixed-precision quantization and visual token reduction, to the knowledge editing scenario. Therefore, while the problem setting and evaluation perspective are interesting and practically meaningful, the methodological novelty is relatively limited and the work is more characterized as an engineering-oriented optimization framework rather than a fundamentally new algorithmic contribution.
Critical strengths
- The work extends multimodal knowledge editing from conventional server-side evaluation to resource-constrained on-device MLLM deployment, where practical constraints such as memory, latency, and energy consumption are considered together with editing quality. This provides a valuable perspective for real-world deployment and makes the evaluation setting more realistic than existing MKE studies.
- The paper evaluates the proposed framework across multiple MLLM backbones, editing benchmarks, and hardware platforms, while reporting both editing metrics and system-level efficiency metrics. Although the algorithmic novelty is limited, the extensive system evaluation demonstrates the practical effectiveness of applying compression-aware optimization to multimodal knowledge editing and supports the empirical claims of the paper.
Critical weaknesses
- The technical novelty of EdgeEdit is somewhat incremental. EAMPQ follows the sensitivity-aware mixed-precision quantization paradigm, similar to AWQ and KVTuner [1,2], while ESGTR is closely related to existing visual token reduction methods such as SparseVLM [3]. The main difference is introducing editing-aware objectives into these existing compression frameworks. Therefore, the contribution appears to be primarily an adaptation of existing quantization and token reduction techniques to the knowledge editing scenario rather than a fundamentally new compression methodology.
- The practical effectiveness for real-world on-device editing remains insufficiently validated. Although EdgeEdit targets resource-constrained deployment, the paper does not fully characterize the practical deployment cost and scalability. In particular, the offline overhead introduced by EAMPQ profiling is not reported, and the mobile efficiency comparison may be affected by the use of NPU acceleration for EdgeEdit while baselines run on CPU. Moreover, the evaluation mainly focuses on individual editing requests and does not investigate realistic scenarios with sequential edits or growing retrieval contexts, which are important for long-term on-device knowledge editing.
[1] LIN J, TANG J, TANG H, et al. AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration[C]//Proceedings of Machine Learning and Systems. 2024.
[2] LI X, XING Z, LI Y, et al. KVTuner: Sensitivity-aware Layer-wise Mixed-Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference[C]//International Conference on Machine Learning. 2025.
[3] ZHANG Y, FAN C K, MA J, et al. SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference[C]//International Conference on Machine Learning. 2025.
Questions for authors
1.Could the authors clarify the key novelty of EdgeEdit compared with existing compression-based optimization methods? 2.Could the authors provide the offline profiling cost of EAMPQ? 3.Could the authors clarify the contribution of NPU acceleration to the reported mobile efficiency gains? 4.Could the authors provide results under sequential editing settings?