- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes GeoPACT, a framework design that explicitly preserves spatial information during compression for VLMs. By leveraging two off-the-shelf encoder modules and training a connector, GeoPACT achieves high-ratio compression (i.e. 20 tokens per view). Experimental results show that GeoPACT achieves improvements on various benchmarks including 2D and 3D.
Critical strengths
- The research question is correct and important. How to compress multi-view images into compact token sets for VLMs is a long-standing and hard problem, so research in this branch has a solid background.
- The idea of Auxiliary Supervision is interesting. Attaching lightweight dense-prediction heads to Zb and training on pseudo-labels is an interesting way to ensure feature effectiveness. This is a method worth attention in the field of 3D VLMs.
Critical weaknesses
- Limited novelty. The main technical contribution, adding a connector merging features from various vision encoders is not novel. The selection of visual encoders and the design of connectors are well-explored in “mixture of vision experts” literature: Cambrian-1 [1], Eagle [2], MoVA [3]. Therefore, I don’t actually think either of the contributions listed at the end of Introduction holds.
- Weak performance and experimental design. It is surprising to see GeoPACT, which undergoes two stages of training, underperform Qwen3.5-0.8B-FT by ~10 percentage points in 2 of VSI-Bench and all categories of CV-Bench 3D. This undermines the effectiveness of the proposed method, and raises doubts for whether the performance gain in other categories is merely due to a distribution shift compared with Qwen3.5 model. Besides, it is not convincing to conduct experiments on a 0.8B model, which can barely be called a large model.
[1] Tong, Shengbang, et al. "Cambrian-1: A fully open, vision-centric exploration of multimodal llms." Advances in Neural Information Processing Systems 37 (2024): 87310-87356. [2] Shi, Min, et al. "Eagle: Exploring the design space for multimodal llms with mixture of encoders." International Conference on Learning Representations. Vol. 2025. 2025. [3] Zong, Zhuofan, et al. "Mova: Adapting mixture of vision experts to multimodal context." Advances in Neural Information Processing Systems 37 (2024): 103305-103333.
Questions for authors
Due to my recognition of this paper as of limited novelty and weak experimental performance, I would personally recommend authors reconsider what is their contribution, sharpen their claims and observations, redesign their method to gain noticeable performance gain and conduct experiments on larger models, before submitting to another conference.