- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how future-prediction representations and video-action fusion affect world-action models. It first compares six fusion designs within VAE-WAM, with random and LingBot-Video initialization, finding the highest final success with hidden-state fusion. A separate comparison fixes MoT-joint fusion and the action-expert initialization while predicting pixels, Wan2.1 VAE latents, DINOv2 features, or V-JEPA 2.1 features. On 1,204 LIBERO-Plus variants, V-JEPA achieves 55.15% success versus 45.43% for VAE, 45.68% for DINOv2, and 37.21% for pixels. ABC-130K pretraining raises V-JEPA success to 62.96%. Additional experiments examine clean/randomized RoboTwin and compare the selected model with π0.5 and DreamZero on three physical dual-arm tasks.
Critical strengths
-
Meaningful control of the policy-side comparison. Q2 keeps the action architecture and initial parameter state, trunk architecture, temporal slots, token budget, data, and fusion design fixed. The paper explicitly characterizes complete representation variants rather than an encoder-only intervention and discloses the distinct Pixel-WAM flow recipe. Appendix A also addresses future leakage by constructing V-JEPA’s conditioning slot from a clip repeating only the first frame. These choices make the representation comparison informative and reduce several important control-side confounds.
-
Useful closed-loop evidence with transparent limiting results. The paired LIBERO-Plus comparisons show a substantial V-JEPA advantage under MoT-joint fusion. The DINOv2–VAE tie, insignificant pixel bottleneck improvement, and failure of all evaluated variants under RoboTwin randomization are reported rather than suppressed. The fusion study also demonstrates that access to a video prior depends substantially on how it is connected to the action expert. These findings provide useful practical guidance while avoiding a blanket claim that all semantic representations outperform reconstruction latents.
Critical weaknesses
-
The general representation recommendation and mechanism exceed the demonstrated scope. Q1 identifies hidden-state fusion as strongest within VAE-WAM, but Q2 fixes MoT-joint. Figure 5’s hidden-state LIBERO-Plus points appear to rank VAE slightly above V-JEPA, yet their exact values and matched training conditions are not given. Equal four-frame aggregation does not isolate temporal predictive structure because encoder pretraining, architecture, feature dimensions, normalization, and temporal construction also differ. The codec probe does not explain the V-JEPA–VAE gap, as the authors acknowledge. These results support a particular representation configuration more securely than a fusion-independent preference or the proposed mechanism. This distinction is consequential because the paper’s main contribution is a general design principle for choosing prediction spaces.
-
The additional validation and implementation are insufficiently specified. Appendix Table 2 does not explain how the 64-channel V-JEPA features are constructed or how semantic representations are decoded for Figure 5’s PSNR/SSIM/LPIPS measurements. A complete training and xDoF pretraining recipe is not provided. The real-robot section and Appendix B omit trial counts, completion criteria, ID/OOD definitions, error-bar meanings, and baseline adaptation data and budgets. Consequently, the fairness and uncertainty of the real-robot advantage cannot be assessed. The LIBERO statistics establish fixed-model evaluation differences, but not training-seed stability; the paper appropriately acknowledges this limitation without resolving it. These omissions limit both reproducibility and the strength of the claimed transfer evidence.
Questions for authors
-
Representation–fusion interaction: Please provide exact values and initialization/training protocols for all Setting A models in Figure 5. Does the apparent VAE–V-JEPA reversal under hidden-state fusion persist under matched conditions, and how does it affect the representation recommendation?
-
Mechanism and implementation: How are the 64-channel V-JEPA features and semantic decoders constructed, and what are the complete training/xDoF recipes? What controlled evidence separates temporal predictive structure from other encoder and interface differences, and how stable is the central ranking across training seeds?
-
Real-robot validation: What are the trial counts, completion criteria, ID/OOD changes, and error-bar definitions? Which checkpoints, observations, demonstrations, and adaptation budgets were used for each baseline?
Dear Reviewers,
This is a friendly reminder that the rebuttal discussion period is approaching its deadline.
Please take some time to review the authors' rebuttal and actively participate in the discussion. If you have any remaining questions or concerns, please raise them and share your feedback with the authors and other reviewers.
As the discussion period is about to close, we kindly ask you to complete your discussion and provide your updated assessment before the deadline.
Thank you for your time and effort.
Best regards,
Area Chair