- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PAIR, which learns an intermediate representation (Bridge Tokens) bridging perception and action through a masked action autoencoder and an alignment loss, and injects it at the entrance of the Action Expert. Improvements are reported on LIBERO, LIBERO-Plus, CALVIN, and real-world tasks with OpenVLA-based models.
Critical strengths
- Easy to read: the paper is clearly written and well organized.
- Clear motivation: the perception–action representation gap is well articulated, and the method design is coherent.
- Careful validation: linear probes, layerwise decoding, and RSA/CKA analyses support that the intermediate representation carries both task and action information, and the ablations cover the key design choices.
Critical weaknesses
- Limited novelty: the method combines known components (action tokenization and latent action representations, query-based bottleneck tokens, cosine alignment to frozen targets, gated residual injection), differing from many closely related works such as LARA, LAPA, and UniVLA mainly in the aligned object and the injection position; it is an engineering combination rather than a new principle.
- Small gains without statistical support: +1.1 on LIBERO (a near-saturated benchmark) and +0.11/0.12 on CALVIN; no variance is reported for the baselines and no significance tests are conducted.
- Selective baselines in Table 2: under the same protocol, the official LIBERO-Plus benchmark evaluated OpenVLA-OFT (Total 70.0) and π0-FAST (64.2), yet Table 2 omits both, keeps only weaker baselines, and bolds +PAIR's 64.2 as the best; the actual improvement is thus limited.
- Model selection: the two backbones come from the same family (both small OpenVLA-derived models); parameter counts, latency, and the two-stage training overhead are unreported, and there is no comparison with intermediate-representation methods such as LARA under the same backbone.
- Incomplete ablations: λalign is tested only over {0, 0.01, 0.1}, where the largest value happens to be the base optimum and no larger values are tested; moreover, the base setting is the best in every ablation table, weakening the evidential value.
Questions for authors
- What is the baseline selection criterion for Table 2? Please add the LIBERO-Plus results of OpenVLA-OFT and π0-FAST; is +PAIR still the best under comparable settings?
- Please provide multi-seed variance and significance tests for the gains in Tables 1/3 and the ablations in Table 5.
- What are the results for larger λalign values (e.g., 0.5, 1.0)?
- What gains does +PAIR achieve on different backbones such as π0 or π0-FAST?
Note: the score may be raised if the authors, in the rebuttal, add comparisons against SOTA models and additional backbones, conduct detailed comparisons, and demonstrate statistically significant gains.
Author Response to Reviewer DVVg
We thank the reviewer for the detailed assessment and constructive suggestions. We further clarify PAIR's methodological contribution and provide additional evidence on stronger VLA backbones, challenging benchmarks, and representation learning.
W1. Methodological Contribution
PAIR establishes an explicitly supervised perception-to-action interface, where Bridge Tokens jointly capture task-relevant perception information and learned action structure before entering the Action Expert.
Unlike approaches centered on latent action tokenization or visual-dynamics modeling, PAIR learns action structure from expert trajectories and uses it to supervise perception-conditioned Bridge Tokens. Through cross-attention and action-latent supervision, these tokens integrate task-relevant visual-language information with action structure, providing a task-conditioned, action-informed initialization that facilitates the transition from perception to action.
The injection-position and alignment-target ablations further validate this design, demonstrating the benefits of early integration and learned action representations for downstream action generation.
W2. Generalization to π0.5 and RoboTwin 2.0
We further extend PAIR to π0.5 on RoboTwin 2.0, covering 50 bimanual manipulation tasks. Following the official co-training protocol, we jointly train on 2,500 Clean demonstrations and evaluate 5,000 episodes each under Clean and Random settings.
PAIR achieves a +5.25 pp average improvement over the official π0.5 baseline, with gains of +4.42 pp on Clean and +6.08 pp on Random evaluation. Notably, the larger Random improvement is achieved using exclusively Clean demonstrations for training.
Together with the existing LIBERO, LIBERO-Plus, CALVIN, and real-world evaluations, these results further demonstrate PAIR's effectiveness across different manipulation settings and VLA architectures.
W3. Controlled Baseline Comparisons
Table 2 focuses on controlled comparisons under the same backbone and training protocol, directly isolating PAIR's contribution. On LIBERO-Plus, PAIR improves VLA-Adapter from 59.1% to 64.2% (+5.1 pp).
This controlled evaluation directly demonstrates the benefit of PAIR as an enhancement to an existing VLA backbone. The additional π0.5 results further establish its applicability to a stronger model and a distinct benchmark.
W4. Backbone Generality and Efficiency
PAIR is evaluated with OpenVLA-OFT (7B), VLA-Adapter (0.5B), and π0.5, demonstrating compatibility across different backbone scales and architectures.
The Action Autoencoder serves as a training-time teacher and is removed during inference. Only the Bridge and gated injection remain, without introducing additional autoregressive generation steps.
This design provides action-informed guidance at the entrance of the Action Expert while preserving the original action-generation process.
W5. Contribution of Action-Latent Supervision
The alignment-weight ablation in Table 5 demonstrates the contribution of learned action-latent supervision:
Increasing the alignment weight from 0 to 0.1 improves performance by +1.2 pp, demonstrating the effectiveness of explicitly supervising Bridge Tokens with learned Action Latents.
The remaining ablations examine complementary design choices, including injection position, supervision target, injection strength, and Action Autoencoder corruption. Together, these results support the effectiveness of PAIR's explicitly supervised perception-to-action transition.