- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
WAVE-VLA combines native G1 demonstrations from Humanoid Everyday with retargeted Nymeria human video-motion in a common 93D body/root representation. A shared vision-motion RVQ vocabulary and a separate body-conditioned hand stream produce synchronized 16-frame references from current RGB, state, and language. A scene-conditioned residual expert refines the decoded body reference before SONIC tracking. Human data supplies body supervision, while hand supervision comes from robot data. The paper evaluates reconstruction, current-only code selection, offline refinement, and six real-G1 tasks, reporting 39/60 successes for joint training versus 27/60 for HE-only training.
Critical strengths
-
The system addresses a useful and concrete transfer setting: combining independently collected human and humanoid data without matched task pairs. The common robot-space interface, explicit handling of missing hand labels, and body-conditioned hand decoding form a coherent executable pipeline. The real-robot comparison provides encouraging evidence of added repertoire: the jointly trained policy succeeds in 14/20 trials on the two Nymeria-covered tasks, versus 0/20 for HE-only, while obtaining 25/40 versus 27/40 on HE-covered tasks (Table 1). This demonstrates a practical capability beyond motion reconstruction alone.
-
The offline controls help separate several stages of the pipeline. On matched examples, the residual expert reduces decoder-reference FK error by 21.1%/15.2% on HE/Nymeria (Table 2). The separately trained full direct-action comparator in Table 3 is also useful evidence that decoding the trajectory improves motion prediction in this implementation. The paper carefully distinguishes current-only deployment from oracle future inputs, and explicitly avoids treating zero-residual identities as safety guarantees or the small HE success difference as an equivalence result.
Critical weaknesses
-
The central control-interface novelty is insufficiently distinguished from the closest prior art. VQ-BeT already decodes predicted RVQ codes into an action chunk and adds an observation-conditioned continuous offset (Lee et al., 2024, Section 3.3, Eqs. 5-6). Zero offset also recovers its decoded action. WAVE-VLA adds meaningful implementation differences, including a physical-space objective and a reference-conditioned expert, but the broad contrast between optional code conditioning and decoded-plan residual control does not establish these additions' contribution. Joint visual-action cross-reconstruction is also already present in UniT, as the paper acknowledges. A matched action-only RVQ-plus-offset comparison is missing, so it remains unclear how much the particular vision-motion vocabulary and refinement design add beyond established components.
-
The evidence for the proposed architecture's deployment advantage remains limited. Table 1 changes the training data, whereas the direct-action and decoder-only architecture controls are evaluated only offline. Thus, the robot results do not establish that the new architecture improves task success over a simpler jointly trained policy. Transfer is tested on only two human-covered tasks: 10 of the 14 successes are dance trials judged by qualitative resemblance, and kicking achieves 4/10 under a foot-contact criterion. The authors acknowledge this scope, but it still limits the demonstrated significance. The main offline comparisons use different development cohorts, with unclear separation from model selection; the q0-only three-seed diagnostic does not quantify variability of the final body-hand policy. Missing details such as the frozen Action Expert's initialization, loss/source weights, and executed prefix length further hinder assessment of the claimed matched comparison.
Overall, I lean toward weak rejection. The integration and initial results are promising, but the specific advance over existing decoded-action-plus-correction methods and its closed-loop benefit are not yet convincingly established.
Questions for authors
-
What is the precise technical advance of the residual control interface over VQ-BeT's decoded RVQ action plus continuous offset? Is there a comparison using the same converted HE/Nymeria data, policy capacity, and training budget, or an ablation separating visual cross-reconstruction from the physical refinement objective? This would materially affect my assessment of the method's contribution.
-
Do the Table 3 direct-action policy and the decoder-only policy have real-G1 results under the Table 1 protocol? Such evidence would connect the offline improvements to the claimed deployment benefit. Please also specify the scene/initial-state variation and the reproducible judging rubric for the dance trials; the reported qualitative criterion makes that substantial part of the transfer result difficult to assess.
-
Which evaluation cohorts were kept untouched during architecture/checkpoint selection, and how many independently trained final policies were evaluated? Please identify the frozen Action Expert checkpoint and provide the optimization schedule, loss/source weights, and deployed K_exec. These details are needed to assess the matching and reproducibility of the main comparisons.