- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a dedicated policy architecture for loco-manipulation with bimanual arm and a moving base. The policy has careful attention mechanism design, and VGGT feature alignment learning for spatial understanding. The policy is verified on a variety of benchmarks such as LIBERO, robocasa, ebench, libero-plus and real world tasks.
Critical strengths
Even though similar technical concepts such as x-prediction, attention masking for different experts, feature alignments, have been explored by previous work, this work demonstrate sufficient technical strength with a policy that outperforms many well-established sota.
The supplementary video shows very cool robot rollouts and reinforce my confidence.
Critical weaknesses
The x-prediction analysis on figure 2 is not clear to me at the plots, axis labels, the caption text and paragraph as well. I am not convinced why x-pred can be better than v-pred in this case after reading.
The attention mask design (at figure 1) is very interesting, especially the separation for steps 1-32 and 33-64. I believe this corresponds to the initial motivation that "manipulation over a workspace that the policy itself reconfigures". I would appreciate more in-depth explanation about this design intuition and how the two sub chunks of both loco and manips are used in deployment, and some ablation studies on this if possible.
Questions for authors
See Weakness
We thank the reviewer for the encouraging assessment and helpful questions. We have clarified Figure 2 and Sec. 3.5, expanded the explanation of near–far attention, and added corresponding ablations (Table 5; Appendix H).
W1 / Q1: Why can clean-action prediction outperform velocity prediction?
The intuition is that predicting a clean action and predicting how to remove noise can have different learning difficulties, despite being mathematically equivalent for an ideal predictor.
Valid arm–base trajectories are highly structured, even in a high-dimensional action space. An x-head directly predicts this clean structure, whereas a v-head predicts v=x−ϵ, which also contains random noise across all action dimensions. Recovering the same clean action therefore requires the v-head to represent and cancel these noise components. This can be harder for our finite-capacity decoder, which has no direct noisy-input skip connection.
To examine this, we constructed a synthetic two-stream task with a known low-dimensional action structure and Bayes-optimal denoiser. Both variants share the same architecture, training loss, and sampling procedure. Figure 2 measures four aspects, with detailed definitions in Appendix C:
These findings suggest that x-prediction is easier to approximate in our setting, particularly near the high-noise start of sampling. The full-policy experiments support this trend: x-prediction improves RoboCasa365 success from 29.2% to 32.8% from scratch and 57.8% to 61.2% after full pretraining and post-training (Tables 4–5).
W2 / Q2: Motivation and deployment of near–far attention.
We aim for one model to learn both immediate actions and how they develop into a longer plan. For example, later reaching actions should account for earlier base repositioning. During 64-step pretraining, the far segment (steps 33–64) attends to the near segment (steps 1–32), allowing future predictions to build on earlier planned actions and provide additional supervision to near-action representations.