- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Compositional Grounded Contrast (CGC), a low-cost framework for improving fine-grained multi-image understanding in MLLMs. CGC automatically constructs multi-image training data from existing single-image grounding annotations through Inter-Image Contrast and Intra-Image Contrast. It further employs GRPO with a rule-based spatial reward to improve source-image attribution and object localization. Experimental results demonstrate strong performance on MIG-Bench and VLM2-Bench, along with improvements on broader multimodal reasoning benchmarks.
Critical strengths
(1) The paper addresses important challenges in fine-grained multi-image understanding, particularly cross-image attention leakage, spatial hallucination, and object constancy. The motivation is clear, and the proposed method directly targets these issues.
(2) The method constructs multi-image training data from existing single-image grounding annotations without requiring additional human annotations or large-scale CoT generation. This makes the data construction process relatively simple.
(3) The experiments show substantial improvements on MIG-Bench and VLM2-Bench, as well as gains on several general multimodal reasoning benchmarks.
Critical weaknesses
(1) The proposed data synthesis strategy primarily relies on relatively simple image compositions and grounding tasks, which remain substantially different from the complex multi-image understanding and reasoning required in real-world scenarios. Although accurate visual grounding is an important foundation for fine-grained multi-image understanding, it does not necessarily imply reliable cross-image relational reasoning, semantic correspondence, or object identity preservation. Specifically, we have the following two concerns:
(a) Cross-view generalization of Intra-Image Contrast. This strategy constructs correlated views through multi-scale cropping of the same image, preserving nearly identical object appearances without introducing genuine viewpoint changes. Therefore, it remains unclear whether it can effectively improve cross-view object constancy in complex scenarios. For example, in the vehicle tracking case shown in Figure F.1 (Q1), although CGC ultimately predicts an accurate bounding box, its reasoning states: “The bounding box coordinates from the first image can be applied to the 6th image to locate the same car.” This reasoning is questionable, as the vehicle's position and scale may change across frames, and the final predicted coordinates actually differ from those in the first frame. This suggests that correct localization does not necessarily correspond to reliable cross-frame spatial reasoning.
(b) Effectiveness of Inter-Image Contrast for complex cross-image semantic reasoning. This strategy primarily constructs training instances by randomly combining semantically unrelated images, requiring the model to identify the corresponding image and localize the target based on a given label. However, real-world multi-image tasks often involve more complex cross-image semantic relationships. For example, Figure F.1 (Q2) requires the model to identify a shared semantic concept across different scenes, rather than simply locating a predefined target among unrelated distractors.
Although the ablation studies demonstrate the contributions of both data construction mechanisms to the final performance, we remain somewhat skeptical about the claimed improvements in cross-view object constancy and cross-image semantic reasoning.
(2) The paper claims state-of-the-art performance on fine-grained multi-image understanding benchmarks. However, several recent works, such as UniVG-R1 (2025)[1] and GeM-VG (AAAI 2026)[2], have reported stronger results on MIG-Bench using the Qwen2-VL-7B backbone. These highly relevant methods are neither cited nor discussed in the paper, raising concerns about the completeness of the related work and the validity of the SOTA claim. Furthermore, the comparison with MIRG-RL in Table 6 is not fully fair, as CGC-8B uses the stronger Qwen3-VL-8B backbone, while MIRG-RL is based on Qwen2-VL-7B.
(3) The paper emphasizes CGC as a low-cost framework, but this advantage primarily comes from avoiding additional human annotations and large-scale CoT data generation. The full training procedure still relies on GRPO and requires 8 NVIDIA H200 GPUs. However, the paper lacks a systematic comparison of computational costs, such as GPU-hours, training throughput, and total computational overhead.
[1] UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learning. Bai S, Li M, Liu Y, et al. Univg-r1: Reasoning guided universal visual grounding with reinforcement learning[J]. arXiv preprint arXiv:2505.14231, 2025.
[2] Zheng S, Zhu Y, Zhao H, et al. GeM-VG: Towards Generalized Multi-image Visual Grounding with Multimodal Large Language Models[C]//Proceedings of the AAAI Conference on Artificial Intelligence. 2026, 40(34): 28857-28865.
Questions for authors
Please refer to the Critical Weaknesses section.