- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PrimitiveVLA splits demonstrations into reusable motion primitives, trains a VLA on them, and assembles them for new tasks. Experiments cover LIBERO, RLBench, and a real robot.
Critical strengths
-
The gains on new task compositions are large across three backbones. For example, OpenVLA improves from 9.25% to 45.50% on LIBERO-90-Novel (Table 2).
-
Real-robot results and component ablations support the approach. And the approach is quite reasonable to me.
-
the writing is clear and easy to follow.
Critical weaknesses
-
The long-horizon tests reset the arm between subtasks, so they do not establish perforemance on uninterrupted execution.
-
The data-efficiency claim is less convincing: the half-data OpenVLA gain is only 0.57 percentage points, without training-seed uncertainty. Changed sampling also makes the source of the gains unclear.
-
There are so many model used in the pipeline: Qwen3-VL,DeepSeek-V3,Qwen2.5-VL-72B + SAM + Cutie... Is this necessary? Why choose a different model?
Questions for authors
- How does the method perform without arm reset between subtasks?
- So Do the data-efficiency gains hold across seeds and with matched primitive/frame sampling?
- Why use Qwen3.5-Omni-Plus for direct segmentation rather than the same Qwen3-VL used in your pipeline(Do you use audio input)? A comparison using the same model and equivalent inputs would better isolate the benefit of program-based segmentation.
7 comments
Response to W1 and Q1 (2/2)
W1 and Q1 (continued). Learned reset for uninterrupted execution
To test whether reset supervision reduces the arm-state mismatch between subtasks, we keep all original demonstrations and randomly select roughly one quarter of demonstrations per task for attempted augmentation, retaining only validated arm-return segments planned offline by a motion planner from task success to the initial arm pose. In total, 818 demonstrations received a validated return segment, each yielding one appended reset primitive episode. Both methods train on the same original trajectories and added reset frames: standard fine-tuning uses complete augmented trajectories with the full-task instruction, while PrimitiveVLA segments them and labels each return as reset. This primitive is exclusive to the supplementary experiment; the original method retains its fixed set of 11.
The reset-augmented comparison uses π0.5 with the paper's fine-tuning step count and total execution budget. Both data settings are evaluated without external arm resets on the same tasks and initial states. After each nonfinal subtask, PrimitiveVLA switches to the learned reset primitive, and the VLA generates actions that return the arm toward its initial pose. The causal switching program advances to the next subtask when changes in the observed end-effector pose remain below the stopping thresholds for several consecutive steps, even if the arm has not fully returned to its initial pose. Every arm action during task execution comes from the VLA, and reset actions count toward the same budget.
| Method | LIBERO-Long (original data) | LIBERO-Long (reset-augmented data) |
|---|---|---|
| Standard fine-tuning | 1.25% | 14.25% |
| PrimitiveVLA | 20.50% | 78.50% |
With π0.5 and no external arm resets, adding the same reset trajectories raises success from 1.25% to 14.25% for standard fine-tuning and from 20.50% to 78.50% for PrimitiveVLA, with the same number of fine-tuning steps. PrimitiveVLA generates the return actions through a learned reset primitive, reaching 78.50%, only 1.75 percentage points below the original checkpoint's 80.25% under external resets. The drop in success without external resets and the recovery after reset training indicate that the mismatch between arm states at subtask transitions and the starting states in the short-horizon demonstrations is a major contributor to failures in uninterrupted execution in this π0.5 evaluation; external resets or training with the learned reset primitive can alleviate this mismatch.
External resets align the arm with the next subtask's starting state, which the original short-horizon demonstrations do not teach the policy to reach. Removing this alignment lowers success; reset-augmented training lets π0.5 PrimitiveVLA generate the return actions itself. In the revision, we will label the execution protocol for each set of LIBERO-Long results and report the additional evaluations of execution without external arm resets.
Response to W2 and Q2
W2 and Q2. Data-efficiency gains across seeds and matched sampling
Updated to include the third OpenVLA training seed; the results below now summarize three seeds.
In the repeated OpenVLA comparison, PrimitiveVLA with 50% of the demonstrations remains comparable to standard fine-tuning with 100% across three training seeds. Both use the unchanged official frame-level sampler, and we add no primitive-level sampling weights.
For OpenVLA, Table 3 compares PrimitiveVLA trained on 50% of the demonstrations with standard fine-tuning on 100%. The original single-run difference is small, and the paper did not quantify variation across training seeds. We reassess this comparison with a three-seed result.
In this three-seed OpenVLA data-efficiency comparison, standard fine-tuning and PrimitiveVLA use the official frame-level RLDS sampler without modifying its sampling logic or adding primitive-level weights. OpenVLA flattens trajectories into single-step samples before shuffling and predicts one action per frame. For a fixed set of demonstrations, primitive segmentation does not introduce episode-level reweighting or change one-step action targets. The three-seed results therefore compare the methods under the same sampling rule while retaining the intended 100% versus 50% data difference.
We repeated the 50%-data PrimitiveVLA and 100%-data standard fine-tuning runs with the original seed and two additional seeds fixed before fine-tuning, independently of the results. Both methods followed the corresponding data selection, training settings, and evaluation protocol described in the paper. The table reports the mean and sample standard deviation across the three seeds.
| Method | Data Scale | LIBERO-Object | LIBERO-Spatial | LIBERO-Goal | LIBERO-90 | Mean |
|---|---|---|---|---|---|---|
| Standard fine-tuning | 100% | 87.20% ± 0.35% | 84.00% ± 3.47% | 75.20% ± 2.80% | 69.66% ± 1.15% | 79.02% ± 0.44% |
| PrimitiveVLA | 50% | 84.93% ± 2.32% | 85.80% ± 1.31% | 74.53% ± 1.17% | 71.27% ± 1.43% | 79.13% ± 0.84% |
For each training seed, we first average the success rates across the four suites and then calculate the mean and standard deviation across seeds. Across the three training seeds, PrimitiveVLA with 50% of the data achieved a four-suite mean success rate of 79.13%, comparable to 79.02% for standard fine-tuning with 100% of the data.
Appendix D.7 attributes more sampling opportunities for short primitives to splitting demonstrations into episodes. This explanation is imprecise for the official samplers used in our experiments. We use the official training samplers for OpenVLA, OpenVLA-OFT, and π0.5 without modifying their sampling logic or adding primitive-level weights. All three use frame-indexed sampling, so increasing the episode count alone does not increase the sampling weight of short primitives. At segment boundaries, OpenVLA-OFT can lose valid action-window starts, while π0.5 retains frame-indexed starts but can change future-action targets. OpenVLA predicts one action per frame, so these action-window boundary effects do not apply to it. We will revise Appendix D.7 to describe these backbone-specific sampling effects.
Response to W1 and Q1 (1/2)
We appreciate the reviewer's comments on compositional generalization, the real-robot results, and the ablation experiments. We address the concerns about uninterrupted execution, data efficiency, and model choice in separate responses.
W1 and Q1. Performance without external arm resets
The submitted LIBERO-Long results with external resets do not establish uninterrupted execution with the original checkpoints. Without those resets, the original OpenVLA checkpoints achieve 0.00% and π0.5 + PrimitiveVLA achieves 20.50%. In a separate evaluation using reset-augmented training data, π0.5 + PrimitiveVLA reaches 78.50% without external resets.
The LIBERO-Long results in the paper use a protocol that resets the arm between subtasks while preserving object states. The baselines use the primitive completion checks in the causal switching program to detect when an arm reset is needed and apply the same reset conditions. The program only triggers arm resets for the baselines; their action policies receive the full long-horizon task instruction.
Using the existing checkpoints fine-tuned for the paper, we completed the evaluation without external arm resets on the LIBERO-Long tasks reported in the paper. For each task, we used the same 50 initial states, success criteria, and total execution budget as in the paper. The with-reset results in the table are from Table 2 of the submitted paper.
Without external arm resets, success falls sharply in all four settings. With π0.5, PrimitiveVLA remains higher than standard fine-tuning (20.50% vs. 1.25%), though absolute success is low; both OpenVLA methods score 0.00%.