- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Ψ-0.6, which is a unified vision-language world model that reasons through streams-of-thought. Streams-of-thought are sequences that interleave images and text with grounded and interpretable abstractions, including camera pose, depth, optical flow, and point tracks. Ψ-0.6 enables compositional reasoning over these capabilities. It also uses reinforcement learning (RL) to learn adaptive streams-of-thought that select visual representations for each task. Experiments on challenging spatial reasoning benchmarks like MindCube show strong zero-shot performance. It also shows better generalization than Qwen model on FlowBench-Real. Finally, Ψ-0.6 also demonstrates transfer to unseen benchmarks.
Critical strengths
-
Unifying vision-language understanding and world modeling with different representations as intermediate reasoning steps is novel. The demonstration of compositional reasoning shows strong generalizability. This is also aligned with human visual reasoning, which selects different representations for different tasks at hand. The part on using reinforcement learning to select representations is particularly interesting. Training an adaptive reasoning model using RL that operates at the level of representations is crucial to efficient and flexible visual reasoning.
-
The paper's figures are well-made and helpful for understanding the paper's core methodology and results. Readers can grasp the paper's idea, method, and results before reading it in detail.
Critical weaknesses
- The reinforcement learning part for training the policy to select the representation, despite being interesting, has limited performance gain compared to random selection. In Figure 5, most of the policy results are on par with random selection. Best-of-16 performs much better, but you should also compare it with random best-of-16. Also, this will have a much higher average inference cost.
Questions for authors
- In Figure 3, GeoThinker-8B has the highest performance, better than all of your model variants. Could you explain why it performs so well? Since both models are 8B, it is a fair comparison at the model-size level.
2 comments
Thanks for the rebuttal. I maintain my original positive evaluation of the paper.
Response to Reviewer XgZr
We thank the reviewer for the careful assessment and are glad that they found the unified design "novel", the RL-based selection of representations "particularly interesting", and the figures "well-made and helpful". Their main concern was that learned selection gains little over random selection in Fig. 5, and that policy best-of-16 should be compared with random best-of-16. As requested, we added random best-of-16 to Fig. 5 and best-of-k for every k from 1 to 16 to the appendix (W1). We also explain GeoThinker's result (Q1).
Weaknesses
W1. Learned vs random selection. The reviewer asks for random best-of-16 next to the policy's best-of-16, and notes that best-of-16 has a much higher inference cost.
Learned selection stays ahead of random selection in pooled accuracy at every k from 1 to 16, and its lead is clearest at a single rollout, which is how the policy is used.
Best-of-16 is an analysis of headroom, not the inference procedure we propose.
Questions
Q1. GeoThinker. The reviewer asks why GeoThinker-8B (83.0) outperforms Ψ-0.6 (76.3) in Fig. 3, given that both models are 8B.
GeoThinker-8B is a specialized model for MindCube-like tasks:
As discussed in the general response, GeoThinker also builds on a production VLM, while Ψ-0.6 is trained from scratch with far more limited resources.