- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper argues that the performance of multi-task manipulation policies depends more on visual representations than on model size or generative priors. To investigate this, the authors introduce CoRP, a compact policy consisting of a representation extractor (for visual observation, proprioceptive state, and language instruction) and a lightweight flow-matching action generator. This is trained with a flow-matching loss on action chunks and an auxiliary task-classification loss. Keeping the action generator architecture fixed, they study several factors affecting policy performance on LIBERO, including pretrained versus randomly initialized encoders, encoder architecture, frozen versus fine-tuned encoders, language conditioning, and token compression. The paper evaluates the proposed method on LIBERO and RoboTwin 2.0. The results suggest that compact policies can perform well when they use pretrained, task-adapted, and compressed visual representations, while language conditioning helps primarily when the goal is ambiguous from the scene alone.
Critical strengths
-
Clean experimental design: CoRP has few interacting components, and the ablations in Sections 4.3-4.6 keep the action generator fixed while varying one property of the representation extractor at a time. The action probe (NMAE, R^2) and task-head accuracy provide complementary diagnostics beyond success rate. The gap between task identification and task execution is also a useful observation: for example, the pretrained ResNet achieves 100% task-head accuracy but only 37.0% success on Goal (Table 3).
-
A compact policy that matches much larger VLA systems on closed-set benchmarks: The 48.9M-parameter CoRP reaches 97.0% on LIBERO, on par with pi-0.5 (3.3B) and OpenVLA-OFT (7B), and 75.8%/73.4% on RoboTwin 2.0, above X-VLA and pi-0.5 (Tables 1-2), while running at about 7ms per chunk. The design consists entirely of standard components, which makes it a cheap and reproducible testbed and a practical reference point for small policies.
Critical weaknesses
-
The main findings are largely known, and the closest prior study is not cited: The three properties emphasized in this paper have already been established in prior work: pretrained visual features benefit manipulation (e.g., R3M, VC-1, and the studies cited by the authors), fine-tuning outperforms freezing, and Perceiver-style resamplers can improve performance. In particular, RoboVLMs [1] already reports that vision-language pretraining is essential, that frozen pretrained encoders perform substantially worse than fine-tuned ones, and that adding a Perceiver resampler to reduce the number of visual tokens yields substantial gains. These findings are demonstrated across eight backbones, four formulations, and real-robot generalization settings. The current manuscript does not cite RoboVLMs, and its conclusion that "parameter scale and generative priors are largely incidental" runs counter to RoboVLMs’ conclusions.
-
The main claim is not tested in the regime where it matters: The abstract argues that performance depends primarily on visual representations, while model scale and generative priors play a minor role. However, all quantitative evaluations are conducted on closed-set, in-distribution tasks, and the authors acknowledge in Sec. 5 that they do not evaluate the open-world semantic and physical generalization that VLAs and WAMs are designed to support. RoboVLMs, by contrast, finds that vision-language pretraining is particularly important for such generalization. RoboVLM, by contrast, finds that vision-language pretraining is particularly important for such generalization. Moreover, Table 2 shows that CoRP remains about 13 points below the video-pretrained WAMs on RoboTwin 2.0, and that removing video pretraining from Motus costs 10-11 points. This directly suggests that generative priors do matter, yet the paper does not explain how this finding aligns with its central claim. The claim should therefore be scoped to VLM priors on closed-set benchmarks, where it is much weaker.
-
The conclusion that "pretraining helps" (Sec. 4.3) is not supported by the results: Pretraining improves performance with the ViT by 18.9 points but reduces performance with the ResNet (74.5% with pretrained initialization vs. 82.1% with random initialization, Table 3).The evidence therefore supports the narrower conclusion that DINOv2 initialization benefits the ViT, rather than the broader claim in the abstract that "pretrained initialization is decisive". The experimental design cannot disentangle the effects of pretraining type (self-supervised vs. supervised) from those of architecture (ViT vs. ResNet), and the two architectures also provide different numbers of tokens to the resampler. Although the authors acknowledge the missing supervised-ViT control, they still draw a general conclusion about the benefits of pretraining.
Minor Weaknesses:
- The task-classification loss is introduced but not ablated: Sec. 3.2 introduces this loss to preserve task-relevant information. However, the paper’s own results suggest that accurate task identification does not necessarily imply that the representation retains task-relevant details (Tables 3 and 7), yet no result with is reported. Moreover, this loss is the only non-standard component of the method, but it is excluded from the ablation study.
- Benefits of pretraining are measured only at full data and a fixed training budget: The paper does not test data efficiency (reduced demonstrations) or convergence speed, which are the main practical reasons to prefer a pretrained encoder. Without this, the 18.9-point gap between pretrained and random ViT (Table 3) could partly reflect under-training of the random variant under the shared training schedule rather than a representational advantage.
- Inconsistent bolding in tables: Multiple entries in the same column are bolded, some of the best results are not highlighted (e.g., GigaWorld-Policy in Table 2), and the "Ours" are bolded even when they do not achieve the best results. Please bold only the best result in each column or clearly state the bolding convention.
[1] Li, Xinghang, et al. "What matters in building vision–language–action models for generalist robots." Nature Machine Intelligence 8.2 (2026): 158-172.
Questions for authors
Please address the weaknesses.
3 comments
Official comment by Reviewer
Thank you for your response. After reading the response and the updated manuscript, I still have concerns about the position of the paper’s claims. In particular, the abstract and conclusion has not been sufficiently narrowed. The new LIBERO-Plus results suggest that the compact policy’s competitiveness with larger systems is limited to in-distribution settings, which further reinforces my concern. Therefore, I will maintain my initial score.
Thank you for the follow-up. We agree, and we have made the following concrete revisions to the manuscript.
Abstract revision. We replaced "enable compact policies to match approaches using large VLMs or generative priors at lower cost" with "enable compact policies to approach the performance of much larger systems on closed-set manipulation benchmarks, without a VLM or video-generative prior." This removes the unqualified "match" claim.
Conclusion revision. We replaced "CoRP is competitive with systems up to 163× larger" with "CoRP substantially narrows the gap to systems up to 163× larger on the closed-set benchmarks studied." We also added an explicit sentence acknowledging that under distribution shift (LIBERO-Plus), a gap to the strongest systems remains.
On the LIBERO-Plus results. We agree they reinforce the concern: CoRP reaches while OpenVLA-OFT reaches — an 18-point gap that was not visible in-distribution. We do not claim OOD parity. What the results do show is that representation design still matters under distribution shift: CoRP at outperforms OpenVLA (), NORA (), WorldVLA (), and UniVLA (), and approaches (), which benefits from large-scale robot pretraining. The gap to OpenVLA-OFT () and RIPT-VLA () is real, and we now state it explicitly.
Revised claim scope. Our contribution is to show which representation design choices support strong performance under a compact model budget, and to quantify the effect of each choice. The paper does not claim that scale and generative priors are unnecessary in general — only that, on the closed-set benchmarks studied, they are not strictly required to narrow the gap substantially.
We hope these targeted revisions address your concern about the positioning of the claims.
Thank you for your careful reading and constructive feedback. Please see our responses below; changes in the revised PDF are marked in blue.
(W1): Thank you for highlighting the connection to prior work. We agree that the importance of vision–language pretraining for robot-policy generalization has already been established and that our claims are overstrong.
However, our goal is to split the contribution of vision and language to the policy. First, when tasks can be distinguished from visual observations, language provides limited additional benefit. In our RoboTwin setting, removing language does not substantially change success (77.28% vs. 74.57%). Second, when visual observations alone are insufficient to identify the task, a small language encoder provides effective task-conditioning information within the evaluated closed task set. This does not imply that it matches a large VLM in open-vocabulary understanding, compositional generalization, or reasoning.
We also agree that our original statement that performance depends primarily on visual representations, with model scale and generative priors playing a limited role, was too broad. We will therefore narrow our conclusion: Under the benchmarks and training conditions studied, strong pretrained visual representations enable a compact policy to achieve competitive performance at relatively low cost. We hope this conclusion does not mislead readers to think that larger models or stronger generative priors are unnecessary.
(W2): We added LIBERO-Plus OOD experiments. Full results with per-perturbation breakdowns are in Table 12 (page 21, Appendix A.3).
This evaluation extends the evidence beyond the original in-distribution experiments. We will limit the resulting robustness claims to the perturbations and evaluation protocol covered by LIBERO-Plus.
Training with the official LIBERO-Plus training data. Separately, our policy achieves 72.62% success after training with the official LIBERO-Plus training data.
(W3): We added supervised-pretrained DeiT-III ViT-S baselines of similar size to DINOv2 ViT-S/14. The results are presented in Table 3 (page 7, Section 4.3) of the revised manuscript, and reproduced below for convenience.
We conclude that pretrained visual representations benefit both DINOv2 and DeiT-III, though not ResNet-34. DINOv2 achieves the highest success among all encoders tested. Due to differences in pretraining data, recipe, and patch size, this comparison does not isolate the effect of supervised vs. self-supervised pretraining, which is outside our scope.
We also address the token-count discrepancy: under a fair 49-token comparison, DINOv2 achieves 97.15% and ResNet-34 achieves 74.5%, confirming the gap is not explained by the extra patch token.
(Q1): Lambda sweep with/without language across three seeds, in Table 8 (page 18, Appendix A.3).
A small weight (λ=0.01) gives a modest gain over λ=0 (+2.8 points with language), and larger weights degrade success monotonically, so the loss is a small auxiliary regularizer.
(Q2): Data efficiency results are in Table 10 (page 21, Appendix A.3). The pretrained encoder improves substantially with more data (62.37%→96.45%), while the random-initialized encoder plateaus near 77%.
The random-initialized encoder needs 2× more steps and still underperforms at matched loss (72.67% vs. 96.45%). See Figure 10 (page 23, Appendix A.3) for convergence curves.
(Q3): The bolding error in Table 2 has been corrected; all tables bold only the best result within each track.
Thank you again for your time and thoughtful review. We hope our narrowed claims, new experiments, and corrections address your concerns. If so, we would be grateful if you would consider revising your score.