- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the physical reasoning in Vision-Language Models (VLMs). It proposes a test-time method that uses imagined futures generated by external generative models as supplementary input. Experiments on three physics benchmarks show the effectiveness of the proposed mental simulation idea.
Critical strengths
- This paper is well written and easy to follow.
- The experiments are extensive, with comparisons covering both open-source and advanced commercial models.
Critical weaknesses
- Using predicted visual observations to improve reasoning has been extensively validated across many scenarios [1][2][3], and the performance gains from additional input information are hardly surprising. This paper is more of an incremental verification of existing conclusions, lacking innovative insights.
- The proposed method directly feeds predicted images as input to VLMs. Although intuitive, this incurs excessive computational overhead. In fact, multiple future predictions inevitably contain redundant information, e.g., background regions. It is suggested to further compress the input information, e.g., keyframes and textual descriptions, which would greatly enhance the practicality of the method.
- Lack of analytical experiments on computational overhead. Compared with the baselines, the authors should report how much additional time and GPU hours are incurred by using LVP, as well as the inference overhead introduced by the additional visual input.
[1] Video Language Planning. ICLR 2024.
[2] Genex: Generating an explorable world. ICLR 2025.
[3] Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm. CVPR 2026.
Questions for authors
Please refer to the issues raised in the Weaknesses section.
2 comments
Thank you for the detailed response. Compared to prior work that uses predicted visual observations for reasoning, the main novelty lies in the new application rather than in the methodology. I will therefore maintain my score.
Response to Reviewer brj1
We thank the reviewer for the thoughtful suggestions and recognizing the clarity and breadth of our evaluation.
1. Contribution and novelty.
Our work investigates how well VLMs can reason about future physical events, and whether explicit video simulation can improve this ability beyond language-based reasoning. Prior works address related but different problems: GenEx focuses on spatial exploration, Video Language Planning on robotic planning, and Thinking with Video on the reasoning capabilities of video generation models themselves. In contrast, we study how generated future videos can help VLMs reason about physical and dynamic events beyond the observed video.
Beyond introducing a simulate-then-reason framework, we systematically evaluate this approach across diverse VLMs and physical scenarios. Our experiments demonstrate the value of explicit future visual evidence beyond language reasoning, while revealing how generation quality and the VLM's ability to interpret and integrate multiple futures affect performance.
2. Temporal redundancy and alternative representations.
We evaluate alternative approaches to future reasoning, including written future predictions, point tracks, and motion summaries (Table 2). The following results are evaluated on Physion and CLEVRER subsets:
These results suggest that generated future videos provide useful information beyond the tested language- and motion-based reasoning approaches. The written predictions and motion representations are derived from the observed video, rather than compressed versions of the generated futures.
Our method already reduces visual input through temporal subsampling, rather than feeding all generated frames to the VLM. We agree that further compression of generated futures through selected keyframes or textual descriptions could be valuable for improving efficiency.
3. Compute cost and language-reasoning controls
To evaluate whether additional language-space reasoning can improve physical prediction, we include Structured prompting, which asks VLMs to reason about objects, motions, and interactions, and Future prompting, which asks them to anticipate how the scene will evolve. We also evaluate their vote@3 variants, matching the three downstream VLM calls used by Visual Independent (K=3). For example, on CLEVRER:
These results show that explicitly simulating future dynamics in visual space provides benefits beyond prompting VLMs to reason about the future in language space, even with repeated inference and across capable VLMs.
Regarding computational cost, LVP-14B takes approximately 210 seconds of sampling per 49-frame rollout on a single H100 GPU. Generated videos are cached and reused across VLM evaluations. While video generation introduces additional latency, its computational cost is not directly comparable to VLM inference, which has different model sizes, hardware requirements, and inference characteristics. While generation adds computational cost, our study focuses on understanding the value of explicit future simulation for physical reasoning.