- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes a methodology for addressing the problem of spatial context prediction, which can be formulated as as identifying vacant regions within a scene by analyzing the relative spatial relationships between objects. This task requires both the ability to ground vacant spaces and the capacity for spatial reasoning. To this end, the paper introduces a Spatial-TRM adopting recursive reasoning mechanism. As a compact recursive model, it utilizes a relatively small number of trainable parameters (11.2M in total model). Through this approach, the Spatial-TRM achieve superior performance compared to existing methods on the RoboSpatial-Home benchmark dataset.
Critical strengths
- To address the problem of spatial context prediction, this study effectively combines several existing approaches including representation learning (w/ DINOv3 ViT-L/16) and recursive refinement (Tiny Recursive Model; TRM. Therefore, the proposed method contributes to the achievement of superior performance compared to open-weight models and other previous studies.
- By training only a very small fraction (11.2M) of the total model size, we achieved spatial context prediction performance that surpasses that of open-weight models.
Critical weaknesses
- In the manuscript, there are some sentences including "dino.txt" in lines 151, 157, and 783. Although the authors stated that they used generative AI to improve language editing, clarity, and readability, this appears to have actually hindered readability.
- Table 2 should include information on the encoder used for each model, so as to clearly demonstrate which part of the model contributed to the performance improvements.
- Some tables mentioned in the paper are not actually provide. For example, Table 19 (referenced at line 376) and Table 4 (referenced at line 375). Please correct this if I have simply overlooked them.
- In Table 2, the number of parameters are not marked on some of open-weight and commercial models. This prohibits the clear comparison between other models provided in Table 1.
- Contrary to other mathematical notations, the pixel indicator p is not italic in line 222.
Questions for authors
- In Figure 1, the explanation regarding the information intended to be conveyed to the reader through the mask on the right is insufficient. While the caption briefly refers to these as "target points," it appears that the white areas in the figure do not actually correspond to "vacant regions." Further clarification on this point is required.
- In line 258, what is the ACT? Please provide the full name of ACT.
2 comments
Thank you for the detailed response and revisions. The authors’ responses have addressed most of my concerns, and the additional encoder table and ablation studies help clarify the model comparisons.
I appreciate the authors’ efforts to improve the manuscript and will raise my score accordingly.
Response to Reviewer zukn
Thank you for these detailed comments. We have clarified the terminology, comparison tables and figure explanation.
W1: Meaning of
dino.txtThe notation was unclear.
dino.txtis the name of the text-aligned DINO model introduced in DINOv2 Meets Text (Jose et al., 2025). We now typeset it in monospace and explain in Section 4.1 that we use its frozen text tower with DINOv3 image features.W2: Encoder details and their contribution
We added a compact encoder table in Appendix E, Table 5, with links to released configurations and model cards. The main comparison, now Table 3, points to this appendix.
Encoder labels alone cannot attribute differences between models, because training data, language backbones and inference procedures also differ. Table 4 therefore provides an encoder ablation within Spatial-TRM, keeping the remaining architecture and training configuration fixed:
The CLIP configuration reduces total parameters by 50.1%, at a cost of 3.28 percentage points. Separately, the recursion ablation holds the frozen encoders and trainable parameter count fixed, distinguishing the refinement gain from a change in encoder.
W3: References to Tables 19 and 4
These refer to tables in external sources. We now identify them explicitly as Table 19 of the Gemini Robotics 1.5 report and Table 4 of the RoboSpatial paper, so they cannot be mistaken for missing tables in our manuscript.
W4: Parameter counts
Every open-weight model in Table 3 now has a parameter count. Spatial-TRM has 877.8M total parameters: 866.6M frozen and 11.2M trainable. The caption distinguishes this full-system count from the baselines’ nominal model sizes and notes that the SpaceTools count excludes its external tools. A dash denotes an undisclosed proprietary-model size.
W5: Pixel notation
The pixel variable p is now italicized consistently in the mathematical notation.
Q1: Interpretation of Figure 1
We corrected the image crop and clarified the caption. The white area is the convex hull of the annotated target points for this query. It is a supervision target, rather than a model prediction or a complete map of vacant space. The query asks for space to the bed’s left in the object’s reference frame.
Section 3 now explains that hulls constructed from sparse points can omit valid space and span occupied areas. The mask should therefore not be interpreted as a guarantee that every white pixel is physically vacant.
Q2: ACT
ACT stands for Adaptive Computation Time. It is defined at its first use in Section 4.2, and the revision also spells it out in Section 4.4.1.