- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Look to Understand, a Small Model-Guided Collaboration (SGC) framework for traffic scene VQA. It combines a lightweight object detector that provides structured object categories and bounding boxes to a large VLM with Question-Region Contrastive Learning (QRCL), which aligns question representations with relevant visual region features. The framework is jointly trained using answer-generation and contrastive losses and evaluated on RoadSceneVQA and DRIVINGVQA, including ablation studies.
Critical strengths
-
Small-Large Model Collaboration: Leveraging lightweight models to provide additional visual and spatial information to large VLMs is a promising direction for improving scene understanding.
-
Socially Relevant Application: The focus on traffic scene understanding is meaningful, with potential applications in road safety and intelligent transportation, aligning well with AI for social good.
-
Evaluation Across Multiple Datasets: The authors evaluate their framework on two traffic scene VQA datasets and provide ablation studies to examine the contributions of the proposed components.
Critical weaknesses
1. Limited Novelty and Insufficient Comparison with Prior Work. The proposed framework primarily combines object detection, structured bounding-box representations, and conventional contrastive learning. Existing works, such as Ego3D-VLM (ICLR 26), have already explored providing explicit spatial information to VLMs for reasoning. Although the tasks differ, the paper does not sufficiently establish its methodological novelty relative to existing spatially grounded VLM frameworks.
2. Unclear Motivation. The introduction does not clearly establish why existing VLMs cannot adequately address the targeted traffic scene understanding tasks or why the proposed combination of object detection and contrastive learning is necessary. The motivation remains broad, without identifying a sufficiently specific technical limitation that the proposed method resolves.
3. Insufficiently Supported Claims. Several broad claims in the introduction concerning limitations of existing VLMs, small-large model collaboration, and fine-grained visual understanding lack sufficiently specific supporting citations. The discussion would benefit from stronger grounding in relevant literature.
4. Missing Implementation Details. The paper does not specify the lightweight object detection model, its architecture, training data, supported object categories, or detection configurations. Furthermore, the process of extracting region features from the detected bounding boxes is insufficiently described. These omissions significantly affect reproducibility.
5. Unclear Handling of Multiple Object Instances. The framework does not explain how it reliably distinguishes between multiple instances of the same object category, particularly when questions involve specific objects or spatial relationships. Although question-guided attention is employed, there is no explicit mechanism or evaluation demonstrating correct instance-level identification.
6. Architectural Ambiguity. Figure 1 identifies the language model as Qwen2.5 rather than Qwen2.5-VL, while the experimental section specifies Qwen2.5-VL-7B. It is unclear whether the authors use the pretrained VLM architecture or independently integrate a vision encoder and projector with a language model. Additionally, the interaction between the proposed contrastive learning module and the answer-generation pathway is insufficiently explained.
7. Weak Question-Region Grounding Formulation. The proposed contrastive objective considers matching question-image samples as positive pairs rather than using explicit question-to-object correspondences. Moreover, contrastive learning is performed using aggregated region representations instead of individual target regions. Consequently, the objective does not directly enforce the fine-grained question-region grounding claimed by the authors.
8. Lack of Grounding Evaluation. Despite emphasizing fine-grained question-region correspondence as a central contribution, the paper provides no quantitative evaluation of region selection, localization accuracy, or question-object alignment. The reported VQA metrics alone are insufficient to establish whether the model actually learns to identify the relevant visual regions.
9. Limited and Inadequate Baseline Comparisons. The experimental evaluation includes only a small selection of VLMs, omitting numerous recent and stronger alternatives. More importantly, there are no comparisons against existing region-aware, grounding-enhanced, or structured-perception VQA methods. This substantially limits the evidence supporting the competitiveness and novelty of the framework.
10. Inconsistent Experimental Reporting. Table 1 reports an Exact Match score of 0.152 for Qwen2.5-VL, whereas Table 3 reports a baseline score of 0.188 without clearly explaining the difference in experimental configurations. Additionally, InternVL3-8B is mentioned among the experimental models, but its results are not reported in the main comparison tables.
11. Poor Figure Quality and Presentation. The figures suffer from low visual resolution and readability, particularly Figure 1, where several components and connections are difficult to interpret. The architectural presentation also lacks sufficient clarity regarding the data flow and integration of the proposed modules, making the methodology unnecessarily difficult to follow.
Questions for authors
Please refer to the concerns raised in the Weaknesses section.