- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces H-GRPO, a reinforcement learning framework for improving spatially grounded reasoning in vision-language models. Instead of optimizing only final-answer correctness, the method represents intermediate reasoning as structured triplets consisting of a sub-question, sub-answer, and supporting bounding box, allowing both semantic reasoning quality and visual grounding to be evaluated. Its main technical contribution is a permutation-invariant Hungarian matching objective that aligns predicted reasoning steps with reference steps without assuming a fixed step order; the paper also introduces H-GRPO+, which first uses fixed-order supervision and then applies permutation-invariant optimization.
The authors construct a 10,000-example synthetic grounded reasoning dataset for SFT and RL training, and evaluate the approach on RoboSpatial, CV-Bench, and EmbSpatial-Bench. Results show consistent improvements in intermediate grounding and decomposition quality, with competitive or improved answer accuracy on most benchmarks. The paper further analyzes the relationship between grounding quality and answer correctness and performs evidence-masking interventions, showing substantial accuracy drops when predicted evidence regions are removed.
Critical strengths
-
Well-motivated structured reasoning formulation. The paper goes beyond final-answer supervision by explicitly representing each intermediate step with a sub-question, sub-answer, and supporting bounding box. This makes the reasoning process more inspectable and allows semantic and spatial grounding quality to be evaluated directly.
-
Useful permutation-invariant optimization and thorough process-level evaluation. H-GRPO uses Hungarian matching to avoid penalizing valid reasoning decompositions solely because their step order differs from the reference. The experiments also evaluate grounding quality and evidence dependence in addition to answer accuracy, including counterfactual masking of predicted evidence regions.
Critical weaknesses
-
The current objective establishes reference alignment, but does not sufficiently establish faithful perception-to-reasoning integration. H-GRPO rewards semantic and spatial agreement between generated steps and reference triplets, but a high matching score does not necessarily demonstrate that the localized visual evidence is faithfully internalized and actually used in subsequent reasoning. This distinction has been explicitly addressed in recent work. Guo et al. [1] explicitly decouple visual interpretation from downstream reasoning; CogFlow [2] introduces a dedicated knowledge-internalization stage and visual-gated policy optimization; EVICT [3] further distinguishes cited evidence from decision-relevant evidence through counterfactual evidence dropout; and MathFlow [4] similarly separates perceptual information extraction from subsequent reasoning to make the role of visual evidence more explicit. Although this paper includes an evidence-masking experiment, it remains an aggregate post-hoc intervention and does not verify whether the evidence associated with each intermediate step is causally used by subsequent reasoning.
-
The reliability of the synthetic process supervision is insufficiently established. GVRS reasoning traces are generated conditionally on the ground-truth final answer, making them potentially post-hoc rationales rather than independently derived reasoning trajectories. Moreover, only 100 examples out of the 10,000 synthetic samples are manually inspected. This concern is especially relevant given that prior work such as Bootstrapping Grounded Chain-of-Thought [5] explicitly addresses factual errors in synthetic CoT supervision through grounding-based verification. Since H-GRPO directly optimizes similarity to these synthetic references, errors or stylistic artifacts in the references may be reinforced during training.
-
The permutation-invariance assumption may be too strong for genuinely sequential reasoning. Hungarian matching treats alternative step orders as equivalent, but some reasoning steps have explicit dependencies and should not be freely reordered. This is also somewhat inconsistent with the paper’s own generation prompt, which requires the sub-questions to form a logical and sequential progression. A controlled step-order perturbation experiment would help clarify when permutation invariance is beneficial.
-
The semantic reward may be insensitive to critical spatial errors. The method uses Sentence-BERT cosine similarity for sub-question and sub-answer matching. However, spatially opposite statements such as “left” vs. “right” or “above” vs. “below” can remain highly similar in embedding space. The paper does not provide hard-negative analysis to show that the reward reliably distinguishes such relation reversals.
[1] GUO Z, LIU M, WANG Q, et al. Integrating Visual Interpretation and Linguistic Reasoning for Geometric Problem Solving[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2025: 3988-3998.
[2] CHEN S, XU Y, XIE J, et al. CogFlow: Bridging Perception and Reasoning through Knowledge Internalization for Visual Mathematical Problem Solving[C]//The Fourteenth International Conference on Learning Representations. 2026.
[3] KOTTE V. EVICT: Evidence-Sufficiency Verification via Counterfactual Dropout for Visually-Grounded Selective Question Answering[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 2026: 11251-11259.
[4] CHEN S, YUAN H, XU Y, et al. MathFlow: Enhancing the Perceptual Flow of MLLMs for Visual Mathematical Problems[C]//Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics. 2026: 967-992.
[5] XIA J, TONG B, ZANG Y, et al. Bootstrapping Grounded Chain-of-Thought in Multimodal LLMs for Data-Efficient Model Adaptation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2025: 208-217.
Questions for authors
-
How were the reference reasoning triplets for RoboSpatial, CV-Bench, and EmbSpatial-Bench constructed and validated?
-
Can the authors report the human evaluation results and inter-annotator agreement for the 100 manually checked GVRS samples?
-
How robust is the Sentence-BERT reward to critical spatial relation reversals such as left/right and above/below? For example, do pairs such as “left of” vs. “right of” or “above” vs. “below” receive sufficiently different similarity scores? A small hard-negative analysis would help determine whether the semantic reward can reliably distinguish the errors that matter most for these benchmarks.
-
Can permutation-invariant matching assign high reward to reasoning steps that are individually correct but ordered incoherently?
-
Can the authors add random or area-matched masking controls to verify that the evidence-masking performance drop is specifically caused by removing decision-relevant regions?