- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents NAVA-WAM, which introduces native action-prior learning by directly pretraining the action policy from observation-only videos. NAVA-WAM first pretrains on observation-only videos, where future-video flow-matching supervision over visual transitions is propagated through transition-structured joint attention to optimize the Action-DiT and learn action-relevant priors. Then, NAVA-WAM uses action-labeled demonstrations to post-train the Action-DiT for robot control through joint video–action flow matching. Experiments cover LIBERO, LIBERO-Plus, RoboTwin 2.0, and real-robot results.
Critical strengths
- The ablation studies demonstrate the effectiveness of the pretraining process. The experimental results show that pretraining improves performance and sample efficiency, confirming the effectiveness of the proposed pretraining method.
- The experimental evaluation covers a relatively broad range, including two simulation environments, LIBERO and RoboTwin 2.0, evaluation on LIBERO-Plus with perturbations, and three real-robot tasks. This broad task evaluation demonstrates the wide applicability of the proposed method.
Critical weaknesses
-
In contrast to methods that learn visual representations or latent actions, this paper proposes a third approach: learning native action priors directly from observation-only videos. Although the paper cites UWM, it neither distinguishes its approach from UWM nor provides a comparison with it. UWM already integrates action and video diffusion processes within a unified Transformer architecture and supports pretraining on action-free videos. It therefore remains unclear what advantages NAVA-WAM’s approach of freezing the Video-DiT and optimizing only the Action-DiT through joint attention offers over UWM. The paper also lacks relevant ablation studies or variant experiments demonstrating the necessity of these design choices.
-
When the Video-DiT is frozen and the Action-DiT is optimized through joint attention using only future-video flow-matching supervision, what information does the resulting native action prior actually encode, and why does it benefit downstream policy learning?
Questions for authors
-
How does the third approach proposed by NAVA-WAM differ from UWM, and what evidence demonstrates the additional benefits of this distinction? Could the authors compare against UWM in settings where a fair comparison is feasible, and provide ablation studies or variant experiments demonstrating the necessity of design choices such as freezing the Video-DiT and optimizing the Action-DiT solely through joint attention?
-
Could the authors clarify what knowledge is transferred to the Action-DiT by pretraining on observation-only videos through joint attention alone? What exactly does “native action prior” refer to? Furthermore, please explain why this prior facilitates downstream policy learning.
-
Please specify what video data are used for the action-free target-domain cold start.
If the authors satisfactorily address these concerns, I would be willing to raise my score.