- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Soft Spatial Reasoning, a post-training framework for adaptive soft reasoning in LVLMs. Intermediate states mix candidate token embeddings, while AdaptSoft predicts a step-specific mixture temperature from hidden-state features and predictive entropy. The LVLM is trained with GRPO, and the controller receives an auxiliary gradient-alignment signal without intermediate reasoning annotations. Using Qwen3-VL-8B-Thinking, the method improves over matched hard- and fixed-soft baselines on OmniSpatial and SpatiaLab, with additional zero-shot results on MindCube supporting transfer to spatial mental-modeling tasks.
Critical strengths
-
AdaptSoft provides a concrete mechanism for varying token-mixture concentration across reasoning steps. Conditioning on both hidden states and predictive entropy allows control to depend on reasoning context rather than uncertainty alone.
-
Gradient alignment provides a differentiable training signal for the softness controller without requiring annotated reasoning steps or an external process evaluator. The ablation against rollout-level task-advantage training supports its usefulness in the evaluated perspective-taking tasks.
-
Matched-backbone comparisons distinguish the gains from ordinary GRPO, fixed soft thinking, and adaptive softness. Evaluation on unseen SpatiaLab and MindCube further supports transfer beyond the post-training benchmark.
Critical weaknesses
-
Results are reported without variation across independent training runs or confidence intervals. Since both GRPO training and soft rollouts are stochastic, the reproducibility of the gains over fixed soft thinking remains uncertain.
-
The additional training cost of reconstructing soft states and computing gradient alignment is not quantified. Comparisons of wall-clock time, peak memory, and inference latency would clarify the performance–cost trade-off relative to hard and fixed-soft GRPO.
-
The experiments do not establish how much improvement requires the proposed controller and alignment objective rather than simpler temperature control. Comparisons with a tuned fixed temperature or an entropy-based temperature schedule would provide stronger evidence for the necessity of the learned mechanism.
Questions for authors
-
How does AdaptSoft compare with the best fixed temperature selected on validation data, rather than only the default temperature? Would its advantage remain against a simple entropy-based temperature schedule?
-
What are the training-time, peak-memory, and inference-latency overheads relative to fixed-soft GRPO? Do the accuracy gains persist when the methods are compared under matched computational budgets?
3 comments
Thanks to the authors for their detailed response, I appreciate the authors' efforts, my problem is basically solved, and I will keep my score
Thank you for your time and constructive feedback, which has helped us strengthen the paper.
W1 Evaluation Variability and Confidence Intervals
A: We have added repeated stochastic evaluations and a paired confidence interval to assess the stability of the reported gain. Three independent mean@8 evaluations of the same AdaptSoft checkpoint yield 49.65 0.10% overall accuracy (mean standard deviation), showing consistent performance across evaluation runs.
The observed improvement over fixed-soft GRPO is 2.73 percentage points (49.65% versus 46.92%). We quantify uncertainty in this difference using a paired bootstrap over test questions with 10,000 resamples, scoring each question by its mean accuracy over eight generations. The resulting 95% confidence interval is [2.44, 3.25] percentage points.
The repeated evaluations show stable performance, and the paired confidence interval supports a positive gain over fixed soft thinking. These analyses use the evaluated checkpoints, as additional independent training runs were infeasible within the rebuttal window.
Q1/ W3 Fixed-Temperature Tuning and Entropy-Based Control
A: "Soft Thinking + GRPO" already uses a fixed softness temperature selected on validation data. In preliminary experiments, we performed a grid search over training softness temperatures {0.1,0.3,0.5,1.0} and inference softness temperatures {0.1,0.5}. The best validation setting uses =0.1 during training and =0.5 at inference, compared with the original recipe's default of =0.1 for both (SofT-GRPO, Zheng et al.). Soft Spatial Reasoning exceeds this baseline by 2.75 percentage points on OmniSpatial, 1.85 points on SpatiaLab, and 4.11 points on MindCube. We have added the temperature grid search and selected settings to Appendix B.2 of the revised manuscript.
For entropy-based temperature control, the submitted paper includes an ablation without the hidden-state input. In this ablation, AdaptSoft adjusts softness using only predictive uncertainty (entropy), learning how to do so during post-training. With both variants trained on Perspective Taking tasks, adding the hidden-state input increases accuracy from 39.22% to 42.75%, a gain of 3.53 percentage points. This result supports the value of reasoning context even when the uncertainty-to-temperature mapping is learned.
Q2/ W2 Training, Memory, and Inference Costs
A: Compared with "Soft Thinking + GRPO," Soft Spatial Reasoning increases training time per step by 32% and peak allocated GPU memory by 3.2 GB. Full-test mean@8 inference takes 142 minutes versus 62 minutes.
Training response lengths are approximately equal (288 versus 292 tokens). Inference timings cover the complete test set with eight generations per question for mean@8 evaluation. Soft Spatial Reasoning generates longer responses on average and has lower measured decoding throughput, both of which contribute to the end-to-end inference time.
A: Yes. Soft Spatial Reasoning retains a 4.7-percentage-point accuracy advantage at comparable training budgets of approximately 18 hours on the same GPU configuration. We evaluate both methods on OmniSpatial using an image pixel budget of 128282 during both training and evaluation, preserving aspect ratio and flooring image dimensions to multiples of 28. Both methods use the same evaluation procedure.
Matching training time accounts for the additional computational cost of adaptive softness: "Soft Thinking + GRPO" completes 200 steps while Soft Spatial Reasoning completes 140. We have added this analysis to the Results section of the revised manuscript.