- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes VAST, a training-free framework for multimodal soft reasoning. It combines position-aware entropy gating to selectively activate soft thinking during intermediate reasoning steps with visual contrastive reweighting to encourage image-grounded token representations. Experiments on three MLLMs and five benchmarks show improvements over greedy CoT and standard Soft Thinking.
Critical strengths
-
The paper addresses a meaningful problem that naive soft thinking can degrade multimodal reasoning performance.
-
The proposed framework is simple, training-free, and does not require model modification or additional training.
-
The paper includes evaluations across multiple models and benchmarks, along with component ablations.
Critical weaknesses
-
This paper has limited novelty and substantial overlap with existing training-free reasoning methods. The proposed framework is largely built upon existing techniques, including probability-weighted soft token embeddings, entropy-based switching between discrete and latent reasoning, and visual contrastive decoding. Closely related prior works, such as SwiReasoning[1], SeLaR[2], and LEAD [3], have already investigated selective latent reasoning or visual anchoring. In particular, LEAD addresses multimodal latent reasoning through entropy-aware switching and visual anchors. While VAST introduces a position-dependent threshold and applies visual contrastive reweighting to soft embeddings, it is unclear whether these modifications constitute a sufficiently substantial methodological advance.
-
The main experiments only compare VAST against greedy CoT and vanilla Soft Thinking. This is insufficient given the availability of more advanced training-free methods mentioned above, and especially the multimodal method LEAD. Although some of these methods were originally developed for text-only models, their selective reasoning mechanisms are directly relevant, and the paper should provide adapted comparisons or explain why they are not applicable. Without these comparisons, the claimed effectiveness relative to the current state of the art remains unsubstantiated.
-
The paper states in Appendix A.2 that the main experiments use 1500 samples, whereas all ablation experiments use 1000 samples. However, the eight Standard Soft Thinking baseline results in Table 4 are identical to the corresponding results in Table 1, despite the supposedly different evaluation sizes. Moreover, several accuracies in Table 4, such as 63.65%, 66.73%, and 49.33%, cannot arise from a single unweighted exact-match evaluation on exactly 1000 samples.
-
The improvements over standard CoT are modest and lack statistical validation. Although VAST achieves the highest average accuracy among the reported main baselines, the improvements over greedy CoT are only +1.46, +1.11, and +0.29 percentage points on Qwen2.5-VL-7B, Qwen2.5-VL-32B, and LLaVA-NeXT-8B, respectively. In particular, the 0.29-point improvement on LLaVA-NeXT-8B is small relative to the evaluation size. Furthermore, VAST underperforms the original model on some individual benchmarks, including MMBench on LLaVA-NeXT-8B. In Appendix Table 6, its Spatial Relation accuracy decreases from 88.11% to 73.23%. This failure case deserves much deeper analysis, particularly given the paper's emphasis on visually grounded reasoning.
-
The central claim that intermediate reasoning positions are more suitable for soft exploration is supported primarily by comparisons among several threshold schedules. However, the paper does not directly compare early-only, middle-only, late-only, or random soft activation under matched activation budgets. Moreover, the visual contrastive logit adjustment is essentially inherited from VCD, but the paper does not establish whether constructing soft embeddings from the adjusted distribution offers additional benefits over conventional discrete contrastive decoding. A comparison with VCD and a position-gated discrete VCD variant would help isolate the actual contribution of visually anchored soft thinking.
[1] SwiReasoning: Switch-Thinking in Latent and Explicit for Pareto-Superior Reasoning LLMs. ICLR 2026 [2] SeLaR: Selective Latent Reasoning in Large Language Models. ACL 2026 [3] Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding. CVPR 2026
Questions for authors
See weakness.