- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
In this work, the authors propose SIEVE, a self-revisit framework that allows VLMs to re-engage with image evidence through their internal representations instead of external tools. Region embeddings are identified via gradient saliency with respect to the question and cross-modal similarity and are then cached. An RL pipeline teaches the model when to insert the cached embeddings into the reasoning trace. Experiments across multiple benchmarks demonstrate improvements with self-revisit-grounded reasoning.
Critical strengths
-
The motivation is intuitive, and the proposed method is straightforward.
-
Experiments across benchmarks show the effectiveness of the proposed pipeline compared with naive GRPO.
Critical weaknesses
-
Comparisons with highly related works, e.g., Qwen Look-again [1], Look-back [2], VisRef [3], etc., are missing. Qwen Look-again and Look-back share the same spirit of using RL to teach the model to revisit image embeddings/ refocus on image during reasoning, while VisRef proposes a training-free method for injecting relevant image embeddings during inference. None of these works rely on calling external tools or performing operations such as zooming. Compared with these related works, the contribution of this paper seems to be overclaimed, and the novelty of the work is limited.
-
The statements in the paper are inconsistent with the experimental results: i) In the abstract, the authors state that the method achieves “an average gain of 8% across settings,” while in Tables 1 and 2, the margin is much smaller, even when compared with zero-shot performance. ii) “Can disrupt the reasoning trajectory” is stated as a drawback of external tool calling or image re-encoding, but in Figure 12, SIEVE exhibits the same “issue,” with repeated reasoning appearing after the image embeddings are injected.
-
The claims in the abstract are inconsistent with the method. The abstract states that RL teaches the model “when to trigger visual revisiting and which region embeddings to retrieve and insert.” However, according to Section 3.3, the policy only chooses between answering and “triggering insertion of the cached visual evidence,” while the region itself is predetermined by the non-learned Algorithm 1.
-
In Table 1, all baselines are training-free methods. Baselines involving training should also be incorporated into Table 1 for comprehensiveness.
-
The quality of the writing needs to be improved, as there are many minor errors in the manuscript, e.g., i) Figure 5 in L148 should be Figure 2. ii) “Extropy” in L440 should be “entropy.” iii) In Table 1, SIEVE-8B achieves 87.96, while in Table 3, the number is 87.86. iv) In Section 4.3.2, the thinking token is <think>, while <thought> is used in the figures in the appendix.
[1] Chu, X., Chen, X., Wang, G., Tan, Z., Huang, K., Lv, W., Mo, T. and Li, W., 2025. Qwen look again: Guiding vision-language reasoning models to re-attention visual information. arXiv preprint arXiv:2505.23558.
[2] Yang, S., Niu, Y., Liu, Y., Ye, Y., Lin, B. and Yuan, L., 2026, March. Look-back: Implicit visual re-focusing in mllm reasoning. In Proceedings of the AAAI conference on artificial intelligence (Vol. 40, No. 14, pp. 11694-11702).
[3] Ghosal, S.S., Kim, Y., Li, Z., Chaudhry, R., Xu, L., Zhang, H., Zablocki, J., Xing, Y. and Zhang, Q., 2026. VisRef: Visual Refocusing while Thinking Improves Test-Time Scaling in Multi-Modal Large Reasoning Models. arXiv preprint arXiv:2603.00207.
Questions for authors
-
What is the motivation for building on Qwen3-VL-Instruct rather than Qwen3-VL-Thinking, given that the method primarily aims to insert visual cues into the thinking trace?
-
What is the main contribution compared with prior work on visual re-injection and re-focusing?
-
How is the visual evidence obtained at inference time? Is Algorithm 1, including a backward pass, run for every test question? Is the evidence extracted once or recomputed at each insertion? If it is extracted once from the question and reused, what is the advantage over methods that dynamically select visual tokens conditioned on the current reasoning state, e.g., attention-based routing in Qwen-LookAgain [1] or reasoning-state-dependent selection in VisRef [3]?