- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a post-training strategy for VLMs that includes a reward based on the confidence of model's visual grounding output. Through experiments, the author shows this strategy achieves strong performance compared to mentioned open-source models and spatial reasoning models, demonstrating the effectiveness of including confidence.
Critical strengths
The idea of including confidence of visual grounding into the design of reward is reasonable. The results shows strong performance and improvement on SpatiaLab suggests the transferability of the proposed strategy.
Critical weaknesses
- Although the idea of including confidence is interesting, but it is not novel. For example, [1] [2] have already investigated the inclusion of confidence into the reward signal and link it with visual grounding. The comparison with these paper should be included in the manuscript and explicitly mention the difference other than the different calculation of confidence.
- Based on the results in Tab. 2, the improvement of SpatialCORE-8B compared to Qwen3-VL-8B-Thinking+GRPO is little, with an average of only 1.7.
- As illustrated in Eq. 5, since the uncertainty is calculated based on digit-token entropy, the uncertainty between coordiantes 100 and 900 can receive the same score as uncertainty between 100 and 101, which both involve one uncertain digit and two certain digits.
- For Fig. 4, the author should include comparison with a model trained with the same grounding supervision without confidence weighting instead of compare to an unadapted backbone.
[1] Wenyi Xiao, Xinchi Xu, Leilei Gan. "VL-Calibration: Decoupled Confidence Calibration for Large Vision-Language Models Reasoning".
[2] Mihir Prabhudesai, Lili Chen, Alex Ippoliti, Katerina Fragkiadaki, Hao Liu, Deepak Pathak. "Maximizing Confidence Alone Improves Reasoning"
Questions for authors
Please refer to weakness 1, 3, 4.
2 comments
W3, W4
W3
As illustrated in Eq. 5, since the uncertainty is calculated based on digit-token entropy, the uncertainty between coordiantes 100 and 900 can receive the same score as uncertainty between 100 and 101, which both involve one uncertain digit and two certain digits.
Answer:
Equal entropy does not mean equal reward, because each sampled box is still scored by its overlap with the reference. Coordinate-token entropy determines the confidence weight; IoU evaluates the box's geometric overlap with the reference (Eqs. 3, 5–7). The entropy term therefore weights the reward rather than measuring spatial error itself.
Taking 100 as the correct coordinate in the reviewer's example, uncertainty between 100 and 900 produces rollouts that choose either value. When choosing 900 substantially reduces the box's overlap with the reference, that box contributes less to the spatial reward. In contrast, choosing between 100 and 101 generally preserves nearly the same box and IoU. With comparable probabilities of generating the incorrect coordinate, the 100–900 case therefore receives a lower expected spatial reward despite having the same entropy. IoU captures how the generated coordinates affect localization quality and incorporates this into the spatial reward.
W4
For Fig. 4, the author should include comparison with a model trained with the same grounding supervision without confidence weighting instead of compare to an unadapted backbone.
Answer:
We complement Figure 4 with a matched comparison of SpatialCORE with and without confidence weighting. Figure 4 compares SpatialCORE with the unadapted backbone; the added comparison isolates confidence weighting. Both models use the same cold-start SFT checkpoint, grounding-first prompts, pseudo-GT boxes, vision and language LoRA settings, and training budget. The ablated model retains the spatial reward and answer gate; only confidence weighting is removed.
Both models are evaluated on the same OmniSpatial test questions. Predicted bounding boxes are ranked by coordinate-token uncertainty, and the same proportion of highest-confidence boxes is retained for each model. Localization error is measured as 100(1-IoU), including zero-overlap predictions so that confident localization failures remain counted.
When all predictions are retained, localization errors are similar: 64.7 for SpatialCORE and 65.9 without confidence weighting. Among the most confident 25%, the errors are 18.8 and 26.8, respectively. This matched comparison suggests that confidence weighting makes the model's confidence a better indicator of box accuracy, supporting improved confidence–localization reliability. The comparison is now included in Section 4.3, Table 3 of the revised manuscript.
Table 9: Localization error at matched confidence-retention proportions on OmniSpatial. Brackets indicate 95% confidence intervals.
| Highest-confidence boxes retained (%) | SpatialCORE Error ↓ | SpatialCORE w/o confidence weighting Error ↓ | Error reduction ↑ with confidence weighting |
|---|---|---|---|
| 25 | 18.8 [6.3, 38.9] | 26.8 [8.4, 46.7] | +8.0 [-0.4, +19.5] |
| 50 | 41.7 [25.2, 57.3] | 43.8 [28.3, 59.3] | +2.1 [-0.9, +8.0] |
| 75 | 57.1 [45.1, 68.8] | 59.7 [47.8, 70.2] | +2.6 [-0.9, +6.4] |
| 100 | 64.7 [56.1, 73.4] | 65.9 [57.3, 74.3] | +1.1 [-0.3, +3.5] |
Error reduction is the confidence-removed model's error minus SpatialCORE's error, computed before rounding.
W1, W2
W1
Answer:
We thank the reviewer for highlighting these studies. While these studies share some techniques with SpatialCORE, they differ fundamentally in their learning objectives. To our knowledge, SpatialCORE is the first to turn the model's confidence in its generated grounding into a learning signal for spatial reasoning.
VL-Calibration [1].
VL-Calibration trains the model to report confidence that reflects its visual certainty and answer correctness. Its “visual grounding” signal measures how predictions change when image regions are masked. This indicates whether the model relies on the image, but does not establish whether it correctly locates the objects needed for spatial reasoning.
Its calibration objective evaluates whether reported confidence matches the calibration target; it does not directly evaluate the accuracy of predicted object locations. SpatialCORE provides this feedback by comparing predicted bounding boxes with pseudo-GT boxes and giving greater credit to accurate boxes generated with greater confidence. The difference lies in the learning objective: extending VL-Calibration to reward accurate, confident object locations would require grounding-quality feedback, beyond a different confidence estimator.
RENT [2].
RENT studies text-only mathematical problem solving and scientific question answering; it does not investigate visual grounding. Further, its reward depends on confidence alone, without checking whether the generated answer is correct.
In our spatial-reasoning setting, confidence alone does not establish whether predicted bounding boxes correctly locate task-relevant objects. Equally confident boxes can have different localization quality yet receive the same confidence reward. SpatialCORE makes confidence's reward contribution depend on grounding quality, evaluated against pseudo-GT boxes. The answer gate further ties the spatial reward to final-answer correctness. These are substantive differences in the learning objective, beyond how confidence is calculated.
We have added both studies and these distinctions to the Related Work section of the revised manuscript.
W2
Answer:
SpatiaLab is evaluated entirely zero-shot: no SpatiaLab samples are used during post-training, and its scenes and task designs differ from OmniSpatial. Standard GRPO improves the backbone by 1.43 percentage points (44.78% to 46.21%), while explicit grounding SFT falls below the backbone (44.21%; Table 8), showing that additional grounding supervision does not guarantee improved transfer. SpatialCORE improves the backbone by 3.13 points to 47.91%, more than doubling GRPO's zero-shot gain using the same post-training data. Its additional 1.70-point improvement over GRPO shows that the benefit extends to an unseen distribution, complementing the 2.54-point improvement over GRPO on OmniSpatial.
Table 8: Accuracy (%) after explicit grounding SFT and SpatialCORE post-training. SpatiaLab is evaluated entirely zero-shot.
Base denotes Qwen3-VL-8B-Thinking.