- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies whether gains from test-time computation can be retained in VLAs without repeatedly using a verifier. The authors propose a test-time adaptation framework that fine-tunes the VLA using aggregated actions from successful episodes, with action candidates scored by a pre-trained verifier. On the LIBERO benchmark, the distilled policy improves single-candidate success over the base policy, and reapplying candidate aggregation yields further gains with the 5k checkpoint. The additional gain from aggregation is smaller with the 10k checkpoint and under distribution shift, as evaluated on LIBERO-Plus.
Critical strengths
None
Critical weaknesses
- My main concern is that the paper has limited methodological novelty. Test-time adaptation is a promising approach for VLAs; however, simply fine-tuning a policy on verifier-guided actions from successful episodes seems too straightforward and is already a common approach in other domains. The verifier training also largely follows RoboMonkey. Moreover, the authors do not provide a clear reason for choosing weighted-average execution over selecting the highest-scoring candidate, i.e., simple Best-of-N selection, in the proposed Act stage.
- I think the paper’s empirical evaluation and presentation are incomplete. First, the method’s effectiveness beyond the evaluated SmolVLA and LIBERO setups remains unclear. On LIBERO-plus, the additional gain from applying aggregation to the distilled policy over Agg-8 is small, making the evidence for this combined effect narrow. Comparisons with prior test-time adaptation works are also limited: N-GRPO in main Table 1 is the authors’ own implementation, which I do not find convincing as the main baseline. Second, the presentation makes the paper really difficult to follow. Implementation details are mixed into the method section, and some important ablation studies (Table 5) are placed in the appendix rather than the main text.
Questions for authors
Q1. Why do the authors use N-GRPO as the main baseline in Table 1? It applies GRPO in noise space, whereas applying GRPO to update the VLA policy itself seems like a more direct comparison with the proposed method. Can the authors provide results for such a baseline under the same experimental setup as Table 1?
Q2. For the Table 1 experiment, Distill + Agg-8 improves 24 tasks but performs worse on 10 tasks relative to Agg-8. Can the authors provide any explanation or hypothesis for these results? I think the results are directly relevant to the method’s effectiveness.
Q3. Can the authors provide any experimental results showing that the proposed method works with base policies other than SmolVLA or on simulation benchmarks beyond LIBERO?
Q4. Can the authors provide a sensitivity analysis of the proposed test-time adaptation method to verifier quality? The method seems to rely heavily on the verifier because it guides action aggregation, which affects rollout success and, in turn, which episodes enter the success-filtered fine-tuning buffer.