- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a workflow that can enhance the capability of a frozen VLM to predict eight projected image-space corners for a cuboid-like object. The workflow maintains revisable spatial hypotheses across iterations and generates numerical cuboids only at the final readout. The experiments compare the method in this paper with a method that repeatedly regenerates coordinates, examine the effects of memory, numerical feedback, and observation order, and assess the workflow across different frozen VLM backbones.
Critical strengths
S1. The proposed pipeline improves geometric prediction and reduces false positives.
This method continuously maintains and revises structured spatial hypotheses and offers a viable approach to improving geometric prediction with frozen VLMs. Compared with the Raw configuration that repeatedly generates coordinates, the proposed pipeline raises the F1 score from 51.5% to 69.0% and reduces the number of false positives per image from 3.11 to 0.90. These results support the practical value of the pipeline in the present task.
S2. Simple and training-free design.
The method uses a frozen VLM without requiring task-specific fine-tuning or additional geometry-specific networks. Its key idea is to separate spatial hypothesis refinement from numerical coordinate prediction: instead of repeatedly regenerating cuboid coordinates, the model maintains and revises structured spatial hypotheses, including object shape, camera viewpoint, and uncertainty, across iterations, and produces the final coordinates only at the last step. This design is intuitive and easy to implement, allowing existing VLMs to perform more structured geometric reasoning without modifying their architectures or training additional models.
Critical weaknesses
W1. The main comparisons do not match token budgets.
The main experiments match the number of model calls, but the proposed pipeline uses substantially more tokens than the compared baselines. Although the authors acknowledge this limitation, a comparison under comparable token budgets would help clarify the trade-off between performance and token cost. This makes it difficult to separate the benefits of the workflow design from those of additional inference resources.
W2. The methodological novelty over existing spatial-representation and iterative-refinement approaches remains unclear.
Although the paper discusses related work, including Thinking in Space, Theory of Space, and Self-Refine, the distinction between the proposed persistent belief refinement and existing approaches to maintaining explicit spatial representations or iteratively revising model outputs remains insufficiently validated. In particular, it is unclear whether the performance gains arise specifically from separating the recurrent state from the final numerical output, or primarily from structured memory and object-persistence rules. Stronger controlled comparisons would help establish the method's distinct contribution.
W3. Limited scope of geometric reasoning.
Despite being framed as geometric reasoning, the task is restricted to predicting projected cuboid corners for objects in a single image. This is closer to image-space geometric localization than general 3D reasoning, as the predicted 2D corners do not uniquely determine metric 3D positions, dimensions, or orientations. Consequently, the experiments provide limited evidence that the proposed persistent belief refinement generalizes beyond this specific prediction task. It remains unclear whether the proposed approach offers similar benefits for standard 3D object detection or more general geometric reasoning problems.
Questions for authors
1)Are there any additional results comparing the proposed pipeline with the coordinate-regeneration baselines under comparable token budgets? The proposed method uses substantially more tokens than the coordinate-regeneration baselines despite using the same number of logical model calls. This difference in inference budget may contribute to the observed performance gains, making it difficult to isolate the benefits of the proposed workflow itself. A comparison under comparable token budgets would help clarify whether persistent belief refinement remains advantageous when inference resources are controlled.
2)How should the scope of the geometric reasoning claim be interpreted? The evaluation focuses on predicting projected cuboid corners from a single image, which does not uniquely determine metric 3D geometry. Do the authors intend the proposed method as a task-specific protocol for projective cuboid prediction or as a more general geometric reasoning framework? What evidence in the current results supports the latter interpretation?
3)The workflow uses one state initialization, four state updates, and a terminal numerical readout. Have fewer or more state updates been evaluated while keeping the initialization and readout procedures unchanged? Why were four updates chosen, and do they offer the best trade-off between prediction performance and token cost?