- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes the Semantic Role Projector (SRP), an MoE-like projector for vision-language models that aims to mitigate semantic role flattening and preserve task-relevant visual information for compositional reasoning. The method introduces role-specific projection heads, with geometric constraints derived from the language model’s contextual text representations and a separate auxiliary counting objective. Experiments on LLaVA-1.5-7B and Qwen-VL-7B report improvements over standard and capacity-matched projector baselines.
Critical strengths
- The paper is well motivated by semantic role flattening in VLM projectors, a potentially important direction for improving visual reasoning.
- I appreciate the authors’ focus on representative question types in multimodal reasoning, which are valuable for evaluating VLMs’ practical capabilities.
- Using specialized projectors to preserve fine-grained information, such as counts and spatial relations, rather than relying on a general semantic representation, is interesting.
Critical weaknesses
- The construction of the target role geometry is rather coarse. The predefined vocabulary sets may have limited coverage, and direct alignment with a text subspace does not guarantee preservation of task-relevant visual information.
- Why is Count excluded from the subspace alignment loss? This special treatment is not sufficiently justified.
- The evaluation is limited to Qwen-VL-7B and LLaVA-1.5-7B. It remains unclear whether the same bottleneck persists in more recent VLMs, or whether basic counting and spatial reasoning errors mainly reflect limitations in training data rather than projector design.
Questions for authors
See in weakness.