- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies spatial generalization in mobile manipulation using a prior environment walkthrough video. A high-level VLM predicts subtasks and robot-relative navigation hints, which are executed by a low-level π0.5 policy. The authors compare implicit spatial learning, geometric supervision, geometry-feature fusion, and a Qwen-3D-style representation. On controlled multi-room extensions of RoboCasa365, the estimated-geometry Q3D system improves Unseen-Hard placement rate from 10.9% to 24.8%. Additional analyses examine room selection, dependence on tour content, and sensitivity to geometry quality.
Critical strengths
- The navigation improvement is good, and supported by behavioral evidence. Beyond placement rate, estimated-geometry Q3D improves correct first-room selection from 41.6% to 73.5%, conditional on leaving the kitchen, and reduces decoy-room entry from 63.0% to 25.5% (Table 9). Shared executors among tour-conditioned planners and identical evaluation states strengthen this comparison.
- The diagnostic experiments are informative. Tour replacement, target masking, adaptation-strategy comparisons, and geometry-source ablations provide useful evidence about what the models exploit and where the pipeline fails. The finding that target masking barely changes bearing accuracy is particularly valuable for interpreting spatial benchmark performance.
Critical weaknesses
- The contribution of explicit 3D encoding is unclear. Q3D receives extra geometry and localization inputs, and the training settings also differ. The results show that the full pipeline works, but do not isolate the benefit of the 3D representation.
- The generalization setting is narrow. The tours highlight the destination and skip the decoy room, while the test layouts modify familiar kitchens. It is unclear whether the gains hold with tours that cover all rooms without highlighting the target.
Questions for authors
- What geometry and odometry information does each planner receive? Does Q3D retain its advantage with matched inputs and training budgets?
- Do the gains hold when tours include the decoy room and do not highlight the destination?
- Please report full-task success, per-task results, and paired uncertainty, especially for Q3D versus V3R.
4 comments
Dear reviewer, as the rebuttal period draws to a close, we wanted to ask whether our responses and additional experiments have addressed your concerns. If so, would you consider raising your score in light of the new results? We are happy to clarify any remaining questions. Thank you again for your time and constructive feedback!
Thanks for your rebuttal and your additional experiment. As you acknowledge W1, please update your submission. Other experiments mostly convince me. I remain my rating as a positive score.
Dear reviewer, thank you very much for your response and for acknowledging that our supplemental experiments have addressed your criticisms. We've uploaded a new version of the draft which fully acknowledges W1. The abstract now attributes the transfer result to the full Qwen3D recipe, and Section 7.1 explains why our comparisons leave the independent effect of explicit 3D encoding open. Appendix D.2 details the geometry and localization inputs available to each planner. If the revision fully addresses your concerns with the paper, we'd greatly appreciate if you consider increasing your rating.
Thanks again for taking time to review and help improve our work.
Reviewer widm responses
Thank you for the careful review and for highlighting the navigation improvements and informative diagnostic experiments. We have added tour ablations, full-task and statistical reporting, and an evaluation with a second executor.
Yes, the first-frame-only variant in Table 19 (originally table 10) still uses simulator odometry after its initial geometry estimate. It removes subsequent visual relocalization, rather than removing odometry. We have clarified this in Appendix D.2. Estimated-geometry Q3D uses Depth Anything 3 for tour depth and camera poses, together with camera-to-base calibration and simulator odometry for registration. The GT variant receives ground-truth tour geometry. Alternative planners do not receive equivalent registered geometric inputs.
We agree that this prevents attributing the full advantage to explicit 3D encoding alone. We revised the claims to describe the performance of the complete Q3D recipe. As you note, fully finetuned Q3D does not outperform fully finetuned CP on Hard bearing prediction, Table 2 therefore demonstrates that adaptation strategy matters, rather than establishing an architecture-only advantage.
The empirical transfer finding remains: the recipe with stronger held-out midtraining-domain performance need not transfer better to robot environments. For example, CP achieves 70.5% bearing accuracy on held-out MolmoSpaces houses versus 46.7% for Q3D, while their ordering reverses on RoboCasa Unseen-Hard (43.1% versus 56.5%). The common backbone and training-data mix, followed by shared downstream optimization and executor, make this recipe-level comparison informative. They do not substitute for a matched-geometry and matched-tuning study, which we now identify as a remaining limitation (Section 7.1).
Thanks for the great question. We added tour ablations using XR-1 as the shared executor. One removes explicit dining-table framing and another extends the Unseen-Hard tours to include the decoy room. The original two-room and new three-room tours contain 48 and 72 stored frames, respectively, but both provide 16 selected views to the planner. Comparisons use the same executor and original-tour baseline.
We report these results in Appendix E.4, Tables 16–17. We also clarify that the benchmark tests controlled room-layout changes while retaining training object splits. These shifts are deliberately structured to probe whether the policy knows where to go when familiar spatial relationships change. The first-room and decoy-entry results you highlighted provide direct evidence about this capability, beyond the aggregate placement metric. We have made this specific generalization claim clearer without extending it to arbitrary unseen environments.
We added the requested full-task success rates and 95% confidence intervals (Tables 9–10), per-task results (Tables 13–15), and paired permutation tests accounting for shared layouts (Table 22).
For the original π₀.₅ evaluation, the Unseen-Hard results are:
The point estimates favor Q3D, but these tests do not establish a statistically significant difference.
To test whether the planner comparison extends beyond π₀.₅, we additionally evaluated the same VLM planners with XR-1, trained on the same RoboCasa/MolmoSpaces data mixture and shared across planners:
This second-executor experiment provides stronger evidence that the spatial guidance supplied by the Q3D pipeline improves downstream performance. The improvement appears in both placement and full-task completion, addressing whether the navigation gains translate into completing the manipulation objective (Appendix E.2, Tables 11–12).
These additions support a stronger system-level result while preserving the distinction between that result and the architectural attribution discussed above. Thank you for prompting the additional analyses. We would like to ask whether our responses addressed your concerns in full, and we are happy to continue this discussion through the rebuttal.