- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The intermediate visual states generated by the model are fed back into subsequent reasoning steps. Therefore, once an intermediate image becomes inconsistent with the textual decision or the underlying task state, the resulting error may accumulate and propagate throughout the multi-step reasoning process, a phenomenon the authors refer to as compounding drift. To address this issue, the authors propose GroundedVCoT. Its core idea is to verify the textual claims and visual states at each step along the model’s self-generated reasoning trajectory, and to combine these intermediate grounding rewards with the final task reward. A shared cross-modal advantage is then used to jointly optimize the text policy and the image policy.
Critical strengths
- The paper points out that once intermediate generated images are fed into subsequent reasoning steps, errors can evolve from isolated generation mistakes into multi-step state drift. This issue is highly relevant to the current development of interleaved multimodal reasoning.
- The method is well designed. The paper not only reports overall performance improvements, but also validates its core design through reward ablations and credit assignment ablations. On Rush Hour, terminal-reward RL achieves 63.3%, while the full method improves performance to 71.3%. In addition, the shared advantage outperforms separate advantages.
Critical weaknesses
- The current tasks are highly structured and rely on explicit simulators or geometric rules, while GroundedVCoT depends on manually designed verifiers for supervision. Therefore, it remains unclear whether the method can effectively generalize to open-world settings or tasks where state transitions cannot be explicitly verified. The authors also acknowledge this limitation.
- GroundedVCoT uses relatively rich step-wise supervision, but the paper lacks a baseline with a comparable level of supervision density that does not explicitly enforce text–visual grounding. As a result, it is still difficult to determine whether the performance gains mainly come from improved grounding consistency or from dense reward shaping more generally.
Questions for authors
Could the authors include a step-wise reward baseline with a similar reward density but without explicit grounding consistency? This would help disentangle the contribution of grounding itself from the more general benefit of dense supervision.
3 comments
Thank you for the detailed response and additional experiments.
Regarding W2, the newly added BRAID-style dense reward comparison addresses my main concern. Under the same training setup and shared advantage mechanism, GroundedVCoT still achieves better results, which provides further support for the effectiveness of the grounding reward design. Although this experiment uses an adapted version of BRAID's reward design and cannot fully disentangle the effects of different reward mechanisms, I believe this additional comparison substantially strengthens the evidence supporting the authors' conclusions. Regarding W1, I understand that the authors primarily focus on verifiable, structured visual reasoning tasks, and I appreciate their clarification of the scope of the method.
Overall, the additional experiments have largely addressed my concern about the reward design. I still have some reservations regarding generalization, but I acknowledge the authors' explanation of the current scope and limitations of the method.
Thank you for the thoughtful follow-up and for recognizing that the additional experiments address your main concern about the grounding reward design. Regarding generalization, we have obtained new results that we believe help address your remaining reservation. New experiments: Transfer to broader visual reasoning. Starting from the ThinkMorph SFT checkpoint, we additionally trained GroundedVCoT using a subset of StructCoT (Wang et al., 2026) and evaluated it on six visual reasoning benchmarks following ThinkMorph's protocol.
| Benchmark | ThinkMorph SFT | GroundedVCoT |
|---|---|---|
| VStar (out-of-domain) | 64.40% | 67.02% |
| MMVP (out-of-domain) | 80.67% | 81.00% |
| SAT (out-of-domain) | 51.33% | 53.33% |
| VSP (in-domain) | 73.83% | 78.17% |
| VisPuzzle (in-domain) | 77.25% | 77.50% |
| ChartQA (in-domain) | 79.26% | 80.12% |
| GroundedVCoT achieves numerical improvements over its SFT initialization on all six benchmarks, including VStar, MMVP, and SAT, which fall outside the training task families. These results provide encouraging evidence that grounding-based RL can benefit broader visual reasoning capabilities, rather than only improving performance on the tasks used for training. | ||
| We agree that extending the training framework to arbitrary open-world settings remains an important challenge. Nevertheless, these findings suggest that the benefits of grounding-based supervision need not be confined to the tasks on which the supervision is provided. No task-specific verifiers are required at inference time. | ||
| We hope these additional results further strengthen the evidence for the broader relevance of GroundedVCoT. |
Thank you for the positive assessment and the suggestion to distinguish explicit grounding from the general benefit of dense supervision.
W2,Q. Dense-reward comparison We agree that Table 3 alone does not disentangle explicit grounding from the general benefit of dense supervision. To identify whether the performance gains mainly come from improved grounding consistency or from dense reward shaping, we decided to test our reward design against the dense reward design of BRAID [1] which is one of the closest prior work as stated by other reviewers. We contacted the BRAID authors, who confirmed that their code and checkpoints cannot currently be shared pending release approval. We therefore adapted BRAID's published intermediate visual-reward design within our Rush Hour training pipeline, using Qwen3-VL-32B-Instruct instead of its original GPT-5.2 judge. We keep the BAGEL SFT initialization, training data, rollout budget, policy optimizer, and evaluation protocol fixed across all variants.
The BRAID-style dense reward achieves 62.7%, close to terminal-reward RL (63.3%), whereas GroundedVCoT reaches 71.3%. Thus, under the same training framework, this BRAID-style dense visual reward does not reproduce the gains of GroundedVCoT. Our method differs by verifying both textual claims and generated visual states against the evolving task state induced by the model's own trajectory. In this comparison, both GroundedVCoT and the BRAID-style adaptation use the same shared-advantage mechanism to update text and image policies, allowing us to compare intermediate reward designs under matched credit assignment. Table 4 separately examines credit assignment within GroundedVCoT: holding the grounding rewards fixed, sharing their advantage across both policies improves solve rate from 64.7% to 71.3% over modality-specific advantages. Together, these results support our intermediate grounding design and the benefit of shared cross-modal credit assignment. We have added the BRAID-style comparison to the revised manuscript.
[1] Bridging Interleaved Multi-Modal Reasoning as a Unified Decision Process
W1. Generalization beyond structured tasks We agree that our reliance on task-specific verifiers limits the immediate applicability of GroundedVCoT to unstructured reasoning tasks. Our current contribution targets verifiable interleaved visual reasoning, where state transitions or geometric constraints can be checked during training.
To assess transfer beyond structured puzzle solving, we are additionally evaluating GroundedVCoT on broader visual understanding and reasoning benchmarks following ThinkMorph's evaluation protocol [2]. We will share the results during the rebuttal period and incorporate them into the revised manuscript as soon as the evaluations are complete.
[2] ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning. ICLR 2026.