- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper adapts Pairformer to diffusion-policy observation encoders, MPC latent dynamics models, and the action expert of π0.5. By explicitly maintaining and updating pairwise representations, it aims to improve relational reasoning in embodied learning. Simulation results show consistent gains on low-data manipulation and atomic interaction tasks.
Critical strengths
- Pairformer is evaluated in diagnostic tasks, behavior cloning, model-based planning, and pretrained VLA adaptation rather than in a single setting.
- It improves all seven BC tasks and all seven MPC tasks over the corresponding Transformer baselines, with particularly meaningful gains on contact-rich tasks.
- The paper documents data splits, seeds, model sizes, evaluation episodes, and computational costs unusually well.
Critical weaknesses
- The comparisons are not parameter- or compute-matched,Pairformer also changes geometric pair inputs, gating, and transition operators, so the source of improvement is unclear.
- Attention–contact alignment is measured on only one post-hoc-selected billiards layout and therefore provides limited explanatory evidence.
- Pairformer has substantial computational cost: MPC world-model training rises from 122.0 to 371.6 GPU-hours, and pair operations have unfavorable scaling.
- All robot experiments are conducted in simulation, and improvements on compositional VLA tasks are small.
Questions for authors
- Pairformer has more parameters than the Transformer baseline. How can the authors rule out that the gains mainly result from increased model capacity? Please include a parameter-matched Transformer baseline
- Why does Pairformer provide almost no improvement on compositional tasks? Can you provide a failure-case analysis?
- The attention–collision correlation is measured on only one billiards layout. Can the authors evaluate this correlation across more layouts to support the interpretability claim?
- Can the authors provide real-robot experiments to verify whether the improvements observed in simulation transfer to physical manipulation settings?
Response to Reviewer heVR
W1 / Q1. Model capacity and architectural attribution. Pairformer improves the original seven-task BC result from 61.1% to 68.0% (+6.90 pp) and MPC from 64.79% to 67.64% (+2.85 pp). In the focused Ex1/Ex4 results, Pairformer lowers Billiards RMSE at all three horizons; BC/MPC gains are larger in Ex1 than Ex4.
Mean±sample SD over three seeds; BC/MPC use 200 episodes/seed and Billiards selection uses 2,000. The original complete RGB-DP configurations contain 74.138M Transformer and 75.643M Pairformer parameters (+2.03%). The original MPC world models contain 3.594M and 5.098M parameters (+41.86%). The no-triangle ablation retains pair states but removes triangle operations without width compensation; it is not a capacity-matched pair-local control. Ex1 and Ex4 are the parameter- and compute-budget controls, respectively. Across the original seven tasks, Pairformer improves all seven BC and all seven MPC task means (two-sided exact sign test p=.016 for each).
W2 / Q3. Attention–contact alignment. Attention–contact correlations are 0.531 for Transformer and 0.747 for Pairformer on one post-hoc-selected held-out layout. This is a single-layout diagnostic. In the primary 300k-trajectory BilliardsRelay evaluation, RMSE at horizons 16/32/64 decreases from 0.270/0.890/2.960 cm to 0.180/0.510/1.380 cm, and selection success increases from 79.27% to 85.45%. These results support the prediction comparison, not cross-layout attention alignment.
W3. Computational cost. A Pairformer world-model step takes 4.907 ms versus 0.870 ms for Transformer (5.64×); training takes 371.6 versus 122.0 GPU-hours (3.05×). Mean full decision-cycle latency rises from 32.27 s to 35.44 s (+9.8%; P95: 32.38 s to 35.61 s). The current configuration does not demonstrate high-frequency control.
W4 / Q2. Composite VLA performance. The gain is concentrated on atomic-seen tasks: 37.88% to 42.11% (+4.23 pp; 18 tasks). Composite-seen changes from 10.00% to 10.25%, and composite-unseen from 1.00% to 1.25%. Both composite groups have near-floor success rates, so these +0.25 pp differences provide little useful evidence about compositional generalization. The pair branch receives noisy action-token projections and relative action-time features; visual-language context enters through the retained single stream. Evaluation uses three training seeds and 50 episodes/task/seed.
W4 / Q4. Simulation-to-real transfer. All manipulation experiments are simulated; physical-robot transfer has not been evaluated.