- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ReSight-SMC, a training-free test-time scaling framework for large vision-language models. Building upon Power-SMC, the method introduces ancestry-isolated particle islands and prefix-conditioned visual scouts to improve trajectory exploration, followed by answer-marginal power sharpening to aggregate support across reasoning paths. Experiments on four LVLM backbones and five benchmarks demonstrate consistent improvements in aggregate accuracy over Power-SMC.
Critical strengths
-
The proposed framework achieves consistent aggregate improvements across multiple LVLM backbones and benchmarks without additional training.
-
The component ablations provide evidence for the effectiveness of the proposed modules.
Critical weaknesses
-
The methodological novelty of the paper appears relatively limited, as several key components are closely related to existing approaches. The sequence-level power sampling framework and importance correction are largely inherited from Power-SMC, while island-based resampling is a well-established technique in the SMC literature. The visual attention reactivation mechanism is closely related to PAI [1], which already introduces training-free attention amplification over image tokens. Furthermore, the answer-level aggregation follows a similar motivation to Self-Consistency[2] and more recent marginal-sharpening approaches. Although combining these techniques into a unified framework for LVLM inference is potentially useful, I find the overall methodological contribution somewhat incremental.
-
The experimental comparisons could be more comprehensive, particularly given the close connections to existing methods. While the authors compare against Power-SMC and low-temperature sampling, several relevant training-free approaches are missing from the evaluation. For instance, incorporating visual attention enhancement strategies such as PAI into the Power-SMC baseline would help determine whether the proposed visual scouts offer advantages beyond simpler attention amplification. Similarly, comparisons with alternative answer aggregation strategies, such as weighted voting or existing marginal-sharpening approaches, would better establish the necessity of the second stage. The current ablations demonstrate that individual components contribute to the final performance, but do not sufficiently distinguish the proposed mechanisms from closely related alternatives.
-
Although ReSight-SMC consistently improves aggregate accuracy over Power-SMC, the absolute gains are relatively modest, ranging from approximately 1.0 to 1.7 pp across the four evaluated backbones. Meanwhile, the reported inference latency increases from 7.85s for Power-SMC to 10.37s for ReSight-SMC. Since both methods use the same number of particles but incur different computational costs, matching the particle budget alone does not necessarily constitute a fair efficiency comparison. It would be useful to evaluate Power-SMC with a larger particle budget or other compute-matched configurations to determine whether the additional complexity of ReSight-SMC is justified.
-
The effectiveness of the visual scouting mechanism could be better supported by more direct analysis. The paper argues that prefix-conditioned visual scouts encourage exploration of distinct visual evidence and mitigate the declining influence of image tokens during long reasoning trajectories. However, most of the supporting experiments focus on downstream accuracy rather than directly measuring whether the selected regions contain relevant evidence or whether the resulting trajectories exhibit better visual grounding. In particular, a comparison with random region assignment would help clarify how much of the improvement comes from the proposed attention-based routing strategy rather than the attention intervention itself. Moreover, visual scouting is only activated after a fixed decoding checkpoint and does not contribute to shorter responses, which limits its applicability to some of the evaluated tasks.
[1] Paying More Attention to Images: A Training-Free Method for Alleviating Hallucination in LVLMs. ECCV 2024 [2] Self-Consistency Improves Chain of Thought Reasoning in Language Models. ICLR 2023
Questions for authors
See weakness.
Reminder: Please Respond to Author Rebuttals
Dear Reviewers,
As the discussion period is coming to an end, please review the authors’ responses and provide a brief follow-up on whether your concerns have been addressed.
Thank you.