- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes ShareVLA, a share-then-specialize training strategy for multi-task VLA policies. It first trains a shared action-expert trunk on all skills, freezes it, and then trains lightweight skill-specific heads together with a router. The goal is to avoid the incompatibility of independently trained experts and the need for post-hoc model merging. On LIBERO, ShareVLA achieves 91.7% average success compared with 90.2% for MergeVLA-TIES, and the paper reports a claimed 44% training-compute cost relative to merge-based training. It also evaluates robustness on LIBERO-Plus.
Critical strengths
-
The proposed share-then-specialize pipeline is simple and practically appealing. Sharing most of the action expert and specializing only lightweight heads produces a compact single policy and avoids explicit post-hoc merging of the action experts.
-
The method achieves strong in-distribution performance on LIBERO. ShareVLA reaches 91.7% average success and performs competitively with the strongest reported merging baseline.
Critical weaknesses
-
The claimed 44% training-compute advantage is based on asymmetric accounting. ShareVLA reports 88k gradient steps versus 200k for merge-based training, but this count only includes the steps performed by ShareVLA itself. Its Stage-1 backbone is constructed by TIES-merging publicly released single-task backbones, whose training cost is excluded.
This comparison is not symmetric. If existing single-task checkpoints are treated as free for ShareVLA, then a merging method should also be allowed to start from existing experts without paying their training cost. Conversely, if the comparison is intended to measure the end-to-end cost of obtaining the final multi-task policy, then the cost of producing the single-task checkpoints used by ShareVLA should also be included. This is particularly important because the paper’s own ablation shows that the adapted/merged backbone is essential: using the original pretrained backbone gives 65.8%, compared with 89.3% using the merged backbone. Therefore, the excluded component is not incidental to the final performance. -
The experimental validation is too narrow, and the robustness result substantially favors the baselines. The main evaluation is only on LIBERO. ShareVLA obtains only a 1.5-point improvement. On LIBERO-Plus, however, ShareVLA drops a lot, substantially below both the same-architecture multi-task baseline MergeVLA-TIES.
There is no second benchmark, no different embodiment, and no real-robot evaluation. The paper itself acknowledges that evaluation is limited to simulation, a single embodiment, and a single 0.5B backbone. Given the small in-distribution gain and the much worse OOD robustness, I do not think the evidence is sufficient to support the broad conclusion that share-then-specialize is generally preferable to expert merging.
Questions for authors
-
Under a symmetric compute-accounting convention, what is the actual training-cost comparison between ShareVLA and merging? Please report either end-to-end cost from the same pretrained checkpoint, or incremental cost assuming the same single-task checkpoints are already available to both methods.
-
Can the authors provide results on an additional benchmark, embodiment, or real robot? Given the small gain on LIBERO and the substantially worse LIBERO-Plus result, this would materially affect my assessment.