- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
To address the high cost of collecting robot demonstrations and the difficulty of leveraging human videos without robot action labels, the paper proposes Nexus-VLA, an end-to-end framework for joint training on unpaired human and robot demonstrations. Four types of semantic supervision—intent, spatial, motion, and interaction—shape a shared semantic latent within a Qwen2.5-VL-3B-Instruct backbone. A flow-matching action model is jointly trained using human wrist-motion supervision and robot wrist-motion and joint-action supervision. At inference time, the policy generates action chunks conditioned on visual-language features, the semantic latent, and the robot’s proprioceptive state, and executes the robot joint-action component without requiring the offline annotation tools or the four semantic prediction heads.
Critical strengths
The paper addresses an important problem of broad interest: robot demonstrations are costly to collect, while human manipulation videos are abundant but typically lack robot action labels(lines 33-42).
The finding(Table 3) that a unified latent representation outperforms separate latents for the four semantic levels is interesting, suggesting that part of the performance gain comes from the unified representation itself.
Critical weaknesses
The idea of bridging human and robot experiences through four types of information—intent, spatial, motion, and interaction—is reasonable. However, these semantic factors have already been explored to varying degrees in prior cross-embodiment learning research. Therefore, the novelty of this work primarily depends on how these factors are jointly organized, rather than on the four types of information themselves.
The paper adopts Qwen2.5-VL-3B-Instruct as its vision-language backbone but does not sufficiently justify this choice. Although the newer, similarly sized Qwen3-VL-4B-Instruct had been publicly available for a considerable period before submission, the proposed method is evaluated on only a single backbone. Controlled experiments with a newer backbone would help determine whether the reported gains depend on the specific backbone and whether they persist with a stronger foundation model.
Questions for authors
Why does the paper use Qwen2.5-VL-3B-Instruct as its vision-language backbone rather than Qwen3-VL-4B-Instruct?