- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Pelican-VLA 0.5, which uses a set of K=32 learnable Bottleneck Tokens (BotTokens) within a unified Qwen3-VL 4B backbone to connect perception (vision-language + Cosmos latent tokens) with action generation. The authors set up this bottleneck using curriculum attention masking, orthogonality regularization, and token-gated generation. They argue that restricting the architecture this way brings about "attention-level generalization," where manipulation-centric attention patterns show up during pre-training without direct supervision and generalize across various objects, scenes, and robot embodiments. After fine-tuning, the model reaches 98.6% on LIBERO, 91%+ on RoboTwin, and performs on par with π0.5 on three real-world robots. Finally, the paper notes an "attention-to-action gap," showing that having the right attention does not always lead to successful execution, particularly for zero-shot precise manipulation.
Critical strengths
- The paper proposes a new, well-motivated VLA architecture that achieves state-of-the-art results on the reported simulation benchmarks. It includes several architectural and training design choices, supported by a broad set of ablation studies and downstream evaluations.
- The paper is clearly written and easy to follow, and it presents several insightful observations.
Critical weaknesses
- Pelican-VLA 0.5 produces more focused, manipulation-relevant attention, but its connection to downstream performance remains insufficiently established. Table 2 provides some supporting evidence, and the paper acknowledges an attention-to-action gap. However, the component ablations mainly examine attention patterns rather than task success, leaving their practical contributions unclear. I would consider raising my score if the authors provide convincing evidence of a strong correlation between better attention alignment and downstream task performance.
- The choice of 32 BotTokens is not supported by a token-count ablation or a scaling experiment. It remains unclear how bottleneck capacity affects performance and whether this setting remains sufficient for more complex tasks or larger backbones.
Questions for authors
- Could the fixed bottleneck discard task-relevant information and limit performance? How would varying the number of BotTokens affect task success and inference cost?
- Beyond Table 2, could the authors report end-to-end task success for the configurations in Section 5.2, in simulation or on real robots? Reporting attention alignment alongside success rates would help clarify whether attention improvements correspond to better task performance.
Response
We really appreciate the reviewer for the detailed and constructive feedback.
Q1. Bottleneck capacity and inference cost.
We compared our model against strong baseline models without an information bottleneck in the RoboTwin, LIBERO, and RoboDojo simulation environments. Detailed results are provided in our response to Q2. Using a fixed bottleneck preserves model performance while also enabling generalization at the attention level.
We randomly selected 10 tasks from RoboTwin and conducted ablations on this subset.
On the evaluated 10-task RoboTwin subset, K=32 achieves the highest average success rate, exceeding the configuration without BotTokens by 2.1 percentage points. K=8 performs slightly worse than the model without the bottleneck. These results support the choice of a moderate interface capacity and suggest that an overly narrow interface can indeed limit manipulation performance.
We also measured inference latency in a real-world setting. Under this measurement setting, adding BotTokens reduces the mean latency by 13.7 ms, approximately 6.1%.
Q2. End-to-end task success and its relationship to attention alignment.
In simulation benchmarks, Table 1 reports comparisons between Pelican-VLA 0.5 and baselines on RoboTwin, while Table 5 reports comparisons on the LIBERO simulation benchmark. Pelican-VLA 0.5 achieves 98.6% success on LIBERO, 91.4% on RoboTwin Clean, and 91.0% on RoboTwin Randomized. To further demonstrate the effectiveness of Pelican-VLA, we also evaluated it on the more challenging RoboDojo simulation benchmark.
Figure 3 reports Pelican-VLA's real-world success rates. Overall, Pelican-VLA 0.5 achieves an average success rate of 63.6% in the original setting, compared with 61.8% for π0.5, indicating similar overall performance. In the perturbed setting, the average success rates are 52.0% and 40.9%, respectively. Both methods degrade under scene perturbations, with an average decrease of 11.6 percentage points for Pelican-VLA 0.5 and 20.9 points for π0.5.
To further examine the behavioral relevance of manipulation-centric attention, we deployed the scaled-up pretrained policy on six real-world tabletop tasks involving unseen objects, without task-specific fine-tuning. The original attention analyses show that the model attends to instruction-relevant objects and manipulation regions before task adaptation. These additional experiments evaluate whether the pretrained policy can translate such object grounding into actual object manipulation. We used the TienKung embodiment included in pretraining and conducted 20 trials per task.
The policy successfully completes 53 of 120 trials, achieving an average success rate of 44.2%. These behavioral results complement the object-directed attention observed in the original manuscript: the pretrained model exhibits manipulation-relevant visual grounding and can successfully act on unseen objects without task-specific fine-tuning.
We hope that these responses address the reviewer's concerns, and we are happy to answer any further questions.