- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Existing VLN methods does not provide a stable enough robot base pose for downstream manipulation. This paper proposes a co-evolution system with a navigation model called NAV4MANIP-N and a manipulation model called NAV4MANIP-M. The navigation and manipulation policy are first trained with a combined dataset generated within this paper. The manipulation policy is then fixed while the navigation policy is finetuned with RFT and RLAIF to further improve the end-to-end performance. The method is evaluated on the built benchmark and in real-wolrd, and demonstrates strong end-to-end performance on navigation-manipulation tasks.
Critical strengths
- The problem is well-motivated.
- The method extends navigation-manipulation policy to navigation-dexterous-manipulation policy with multi-fingers end-effector. And the reported results are promising.
Critical weaknesses
- This method highly relies on simulator. Both two finetuning process rely on resetting the environment to specific state and obtain different trajectories.
- The paper emphasize on bidirectional training. However, the manipulation policy is fixed after the first stage training. Only the navigation policy is improved with a frozen manipulation policy.
Questions for authors
- The presentation is bad. Figure 2 and figure 3 are purely AI-generated without any further polishment. Please at least make sure the letters in each word are equally spacing. The names for some modules are not consistent, such as Nav-N-Manip/NAV-N-MANIP.
- The experiments section lacks of lots of details. The benchmark details, the training and evaluation setting are all very coarse.
2 comments
Thank you so much for your reply and new experiments. The reply clarifies my misunderstanding and improves the presentation. I would like to increase the score.
Thank you for your time and helpful feedback on our method, figures, and experimental details. We have revised the manuscript and conducted additional experiments to address your comments below.
Q1: "1. This method highly relies on simulator."
A1: Following standard VLN training paradigms (Uni-NaVid [1], NavFoM [2], InternVLA-N1 [3]), training in simulation enables safe, large-scale exploration with strong foundational generalization. To ensure our method does not rely on a single simulator, we implemented three designs:
Real-world deployment demos are also shown at https://nav4manip.github.io/. All real-world policies were trained strictly in simulation without overfitting to the real test environment, achieving high end-to-end success rates on physical hardware.
Q2: "Both two finetuning process rely on resetting the environment to specific state and obtain different trajectories."
A2: We apologize for the inaccurate phrasing in our original manuscript (specifically "We then reset the simulator to the same task initialization..." in Section 3.5, as well as the descriptions in Section 3.4 and Algorithm 1), which caused this confusion. In our actual implementation, neither RFT nor RLAIF requires resetting the environment to specific states to obtain different trajectories. Both stages rely purely on clean on-policy trajectories without state resets. Compared to SFT on static offline data, training and RL fine-tuning on reset-free on-policy data allow the policy to build an intrinsic understanding of the environment without state priors, addressing counterfactual inference and distribution shift more effectively. We have corrected these descriptions in Sections 3.4, 3.5, and Algorithm 1 of the revised manuscript.
Q3: "2. The paper emphasize on bidirectional training. However, the manipulation policy is fixed after the first stage training. Only the navigation policy is improved with a frozen manipulation policy."
A3: To complete the bidirectional loop, after VLN training we ran inference with the trained VLN policy in both simulation and real-world scenes, used the resulting navigation endpoints to re-collect WAM training data, and conducted a second round of post-training on the WAM:
As shown in the table and the simulation/real-world videos at https://nav4manip.github.io/, fine-tuning the WAM on rollouts from the updated VLN endpoints increases end-to-end success rates from 30% to 52% in simulation and from 17% to 30% in the real world, completing the bidirectional training loop.
Q4: "1. The presentation is bad. Figure 2 and figure 3 are purely AI-generated without any further polishment. Please at least make sure the letters in each word are equally spacing. The names for some modules are not consistent, such as Nav-N-Manip/NAV-N-MANIP."
A4: We have redrawn and replaced Figure 2 and Figure 3 to fix the character spacing issues, and standardized all module names and notations across the main text in the revised manuscript.
Q5: "2. The experiments section lacks of lots of details. The benchmark details, the training and evaluation setting are all very coarse."
A5: We have added explicit pointers in Section 4.1 and the Reproducibility Statement, and expanded the appendix with full experimental details:
References
[1] Zhang et al., "Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Tasks," RSS, 2025.
[2] Zhang et al., "Embodied Navigation Foundation Model," ICLR, 2026.
[3] InternVLA-N1 Team, "InternVLA-N1: An Open Dual-System Navigation Foundation Model with Learned Latent Plans," CoRR, 2025.