- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Hydra, a multimodal world action model for navigation that uses a single latent space for multimodal information, unifies the future predictions and policy planner in latent rollouts instead of separate modules. Then, the planning is formulated as search on discrete latent space which guided by a multi-objective Kinematic-Perceptual Cost. Experiments show the performance of Hydra and the comparison to navigation policy baselines.
Critical strengths
The author provides physical evaluations, which give more useful evidence than the offline benchmarks. The hardware deployment and experimental design are actually helpful for understanding the effectiveness of the system design than the visual metrics. The appendix also discusses the misalignment between the actual physical evaluation results and the benchmarks. Also, the results show the strong performance of Hydra, achieving a high success rate in planning scenarios.
Critical weaknesses
- The ablation is not a sufficiently controlled study, the Hydra-NoVQ removes the discretization but also uses different cost terms and search configurations. Thus, this is not enough to claim that the VQ discretization is an improvement in the system design.
- In the experiments, VertiFormer and Hydra-NoVQ only get the geometric goal and image goal, without an obstacle term, so the low performance in obstacle scenes is expected.
Questions for authors
- Do the NWM 0% results come from the performance (quality) or from the latency?
- Can the author add a more controlled ablation study for Hydra-NoVQ?