- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Perceive–Imagine–Verify (PIV), a generalist navigation framework that integrates specialist foundation models as external tools. The framework employs Qwen3-VL as a shared navigation decision model, while leveraging pretrained models for depth estimation, panoramic reconstruction, future observation prediction, and goal verification. The authors demonstrate competitive performance across multiple navigation benchmarks, including VLN, ObjectNav, and OVON, while supporting different sensor configurations with a single decision model.
Critical strengths
Clear and practical motivation. Leveraging specialist foundation models as external tools is a reasonable approach to improving the modularity and flexibility of generalist navigation systems.
Strong experimental results. PIV achieves competitive performance across several navigation benchmarks, demonstrating the effectiveness of integrating specialized capabilities into a shared navigation framework.
Good generalization across tasks and sensor configurations. The ability to support different navigation tasks and RGB/RGB-D configurations with a single decision model is a valuable aspect of this work.
Critical weaknesses
Limited architectural novelty. PIV primarily integrates existing specialist models through a predefined harness. While the resulting performance improvements are reasonable and valuable, they are also somewhat expected. Could the authors further clarify the key architectural novelty compared to conventional tool-augmented navigation pipelines?
Tool replaceability. The paper emphasizes that specialist tools can be replaced without retraining the navigation model. However, the foresight outputs are already incorporated into the training of Qwen3-VL. Have the authors experimented with replacing OmniRoam or other specialist models while keeping the decision model frozen?
Questions for authors
The current ablation studies of the foresight and verification modules are mainly conducted using the Stage 1 checkpoint. Could the authors clarify whether these tools provide similar improvements with the final Stage 2 model?
3 comments
Sincere Thanks and Follow-up to Reviewer ZZPY
Dear Reviewer ZZPY,
Thank you again for taking the time to review our manuscript and share your feedback. We have responded to your comments and revised the manuscript accordingly. We hope that our responses and revisions address your concerns. If any questions or concerns remain, we would be happy to address them during the discussion period.
Best regards,
The Authors
Reminder to reply
Dear Reviewer ZZPY,
Thank you again for your careful and thorough review. As the discussion deadline approaches, we would appreciate your feedback on whether our revisions and additional evidence have addressed the concerns you raised.
Thank you for your time and consideration.
Best regards,
The Authors
Thank you for your insightful feedback and for recognizing the practical motivation and strong results. Below, we provide replacement experiments and more ablations.
A1. Clarify the architectural novelty beyond conventional modular navigation
PIV is the first to demonstrate both Generalist Learning and Modular Extensibility in a unified navigation architecture: a learned decision policy shared across VLN and ObjectNav that can benefit from independently upgraded specialist foundation models without retraining.
Conventional task-specific modular methods, such as SemExp, VLFM, and LM-Nav, tie their decision logic to predefined perception pipelines rather than independently learning a shared policy across navigation tasks. Their task-specific representations and sensing assumptions can therefore limit direct reuse across tasks and sensor configurations.
Q2. Add ablation of independent specialist upgrades without policy retraining.
Four completed substitutions use the same final Stage 2 checkpoint with zero additional decision-model training. Foresight swaps disable verification; grounding swaps disable foresight.
Table S1. Foresight backend replacement; verification disabled.
Table S2. Verification backend replacement; foresight disabled.
Geometric foresight gives results close to OmniRoam on both benchmarks, while GPT-6 Astra grounding increases measured SR by 1.7 points on R2R-CE and 1.8 points on OVON. MVSplat360 and Grounding DINO also run through the corresponding interfaces, with different accuracy trade-offs. The results demonstrate compatibility for the tested substitutions without policy retraining, rather than identical accuracy across backends.
For foresight tool,we clarify the distinction between training and evaluation. Policy training used simulator-rendered candidate views, while closed-loop evaluation uses candidate views generated online by the foresight tool. No ground-truth future views are supplied to the policy during evaluation. We will make this distinction explicit in §3.5, Appendix B.3, and the corresponding limitation statement.
Q3. Add specialist models ablation with the final Stage 2 checkpoint.
We repeated the complete ablation with the final checkpoint fixed.
Table S1. Foresight and Verification ablations with the final Stage 2 checkpoint.
Foresight improves R2R-CE SR by 1.7 points, while verification improves OVON SR by 1.6 points. This fits their complementary roles: VLN provides intermediate landmarks for comparing future views, whereas ObjectNav explicitly names a target for Stop verification. Task dependence is useful in PIV because tools can be configured independently without retraining the policy.
Reference
[1] VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation. ICRA 2024.
[2] MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Views. NeurIPS 2024.
[3] Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection. ECCV 2024.
We hope our responses address your concerns. If you have any further questions, please feel free to contact us. Thank you again for the constructive suggestions.