- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses overthinking in medical multimodal reasoning, where models reach a correct intermediate prediction but continue reasoning, wasting tokens or overturning the answer. The proposed VERGE framework extends GRPO by locating points where a rollout commits to an answer or bounding box, forcing a transition to answering via </think>, and verifying the resulting prediction. The earliest verified point serves as an early-exit boundary. It is used both to redistribute token-level advantages within the original rollout (with separate rules for discrete QA and continuous grounding rewards) and to supervise </think> generation through an auxiliary loss. Probe outputs are used only for verification, not as training targets. On Qwen3-VL-4B-Thinking, VERGE improves average medical QA accuracy from 54.17% to 57.54% and grounding mIoU across all eight modality groups. Against Vanilla GRPO, it achieves higher accuracy and mIoU with roughly 70–77% shorter outputs, with most gains attributed to the early-exit loss.
Critical strengths
- Well-targeted problem in medical reasoning. The paper clearly identifies overthinking as a practical issue in medical MLLMs, where correct intermediate predictions are often followed by redundant or answer reversing reasoning. The motivation is well illustrated (Figures 1 and 3), and the approach improves both accuracy and efficiency rather than trading one for the other.
- Strong grounding improvements with substantially shorter outputs. VERGE improves mIoU across all eight modality groups, with large gains on challenging modalities such as fundus (+27.1), ultrasound (+23.5), and MRI (+22.5), while reducing output length by roughly 70% compared to Vanilla GRPO.
- Principled verification-only design. Probe completions are used only to verify intermediate predictions and never enter the rollout group or training targets. This keeps the original GRPO reward statistics intact and clearly distinguishes the method from approaches that augment rollouts with edited trajectories.
Critical weaknesses
- Limited backbone coverage. All experiments use only Qwen3-VL-4B-Thinking, a thinking model that inherently produces long reasoning. Since VERGE also relies on the model explicitly committing to intermediate predictions, it is unclear whether similar overthinking patterns and gains hold for other models, such as instruct models trained with a <think> format or medical-specific MLLMs.
- Unclear contribution of credit redistribution. Although CR is presented as a core contribution, adding it on top of the early-exit loss yields only +0.41 (MedMCQA) and +0.70 (grounding mIoU) from a single run, both on in-distribution data. A CR-only variant (Vanilla GRPO + CR) and ablations on OOD benchmarks (e.g., MMLU-Med, SGPQA) are needed to isolate its effect.
- Insufficient related work on credit assignment. Although task-aware credit redistribution is presented as a core contribution, the related work focuses only on efficient reasoning and early exit. In the medical domain, several methods also address fine-grained credit assignment beyond outcome-level rewards (e.g. Med-PRM[1], MRPO[2], ChestX-Reasoner[3]). Since these works share the same motivation as VERGE, discussing them and clarifying VERGE’s distinction would better position its contribution.
- Limited analysis of premature exit. Aggregate gains may mask cases where VERGE stops reasoning too early, which is critical in the medical domain. The paper does not report cases where the base model is correct but VERGE is wrong, particularly on difficult benchmarks such as SGPQA where shorter reasoning may be harmful. Beyond the two examples in Figure 3, a quantitative analysis of the quality of the shortened reasoning would strengthen the claim that VERGE preserves task-relevant evidence.
[1] Yun et al. Med-PRM: Medical Reasoning Models with Stepwise, Guideline-verified Process Rewards
[2] Jung et al. Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning
[3] Fan et al. ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step Verification
Questions for authors
Q1 : It would be helpful to evaluate VERGE on an instruct model from the same family (e.g., Qwen3-VL-4B-Instruct) and on larger backbones of 8B or above (e.g., Qwen3-VL-8B), reporting accuracy, output length, and the proportion of rollouts with a verified boundary.
Q2 : I would suggest adding a GRPO + CR variant (without the early-exit loss) to Table 5 and extending all ablation variants to OOD benchmarks (MMLU-Med, SGPQA, MMMU-Med) and held-out grounding datasets not used in training, reporting both task scores and output length.
Q3 : It would strengthen the paper to expand the related work to cover medical credit assignment methods (see W3) and to clarify how VERGE differs from them.
Q4 : Adding a qualitative analysis of premature-exit failures, such as cases where the base model is correct but VERGE is wrong (especially on SGPQA), would make the evaluation more convincing. Further qualitative examples of the shortened reasoning, beyond the two in Figure 3, showing whether key clinical evidence is retained or omitted, would also be valuable.
- I would be willing to raise my score if these concerns are adequately addressed.