- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
In this paper, the authors present NAVIVLA, a framework for social/crowd navigation via VLA and RL finetuning. Specifically, they adopt a Qwen3.5-9B as the backbone, a flow matching module as the action generator, and performed two-stage RL finetuning. The first stage of RL finetuning targets at transforming general models to function in the context of crowd navigation, following the finetuning strategy of Pi 0.6, and the second stage uses LoRA and DPO, targeting directly at the metrics regarding social norms. The effectiveness of the pipeline is evaluated in an end-to-end manner, using the metrics like success rate (for safety), social score (for social awareness), uncomfortable rate (for social awareness), and navigation time (for efficiency). The authors also present a new crowd navigation simulator using Isaac Sim.
Critical strengths
The paper set up a new simulator for crowd navigation using Isaac Sim, which could be potentially beneficial for enabling more photorealistic and sensor-integrated simulations. The methodology used in this paper is also quite complicated and combined modern techniques. The training details are provided in the appendix including the prompts.
Critical weaknesses
While the paper presents a framework that takes multi-modality data as input, the task the authors present is still crowd-only navigation (Figure 5) without complex buildings or static objects as background, which makes the problem relatively well solved in existing work. In the same level of complexity of about 20 humans with dense interactions, MPC-based, CrowdNav++ (arXiv:2203.01821), and GenSafeNav (arXiv:2508.05634) could potentially reach 90%+ in success rate, but the authors did not include these methods in the evaluation table. The authors also need to show the semantic expressiveness of their method brought by the 9B model rather than only using common metrics, otherwise it does not make a lot of sense to use a 9B model for this task while a simple RL policy with millions of parameters could easily solve it.
Also, while the authors claim they are using Isaac Sim to enable a new powerful benchmark, the experiments shown in this paper do not show the benefits it brings. Although in Figure 2 and 3, the authors show the scenarios of real-life and photorealistic rendering, the actual setup used in this paper is quite simple (Figure 5). The VLA policy trained in human-only simulations can hardly generalize to real-world deployment. The real-world validation shown in Figure 4 is also weak with interactions with a single human.
Overall, if the authors want to validate the effectiveness of NAVIVLA, I genuinely suggest developing and validating the algorithms in real-life and cluttered environment to prove the worth brought by the large model and extra computation overhead, and include comprehensive baselines to perform fair and persuasive evaluations.
Questions for authors
- For figure 3, are the pictures in "Social Navigation Scenario" and "Camera Images" rendered from simulations?
- Different robots have different kinematics, how are the actions generated by the flow matching action expert converted to the actual executing of robots? Since in B.2.1 the generated action is defined as a velocity command [vx, vy, ωz], in simulations, does this command applied directly to different robots or applied as a target for the controllers to follow?
- After fine-tuning the 9B model, how can we evaluate the expressiveness of the Qwen backbone to rule out the possibility that the model has simply overfitted to the crowd navigation task and lost its general capabilities?