- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
VLA-Δ proposes to improve vision-language-action policies through explicit supervision of task-relevant state changes. Learnable transition queries are jointly trained with structured state/transition slots, dense optical flow, future-state difference text, and action prediction. The authors curate and annotate approximately 484 hours of demonstrations from DROID, MolmoAct, and RH20T, initializing the VLM from ZR-0base. Downstream fine-tuning uses only action supervision, and auxiliary outputs are not decoded at deployment. Evaluation covers LIBERO, LIBERO-Plus, RoboTwin 2.0, and five real-robot tasks. The paper reports 98.4% on LIBERO, 90.06%/89.74% on RoboTwin Clean/Random, and 68.0% average real-robot success.
Critical strengths
- The paper includes a meaningful action-only pretraining control. Table 3 reports an improvement from 96.45% with query-based action-only pretraining to 98.40% with the full supervision package. This is stronger evidence than comparison with unrelated architectures alone, and supports a benefit beyond simply adding pretraining data.
- The design is practically motivated and evaluated beyond a single benchmark. Auxiliary supervision is used during pretraining without requiring intermediate text or flow decoding at deployment. Results across simulation and real-robot tasks provide evidence that the overall training recipe has practical value.
Critical weaknesses
- The methodological novelty beyond existing predictive-supervision approaches is unclear.
The paper follows an established approach: learn intermediate query representations through auxiliary prediction objectives and use these representations to condition action generation. Relative to approaches such as DreamVLA, the identifiable changes are primarily the selection of supervision targets—structured state/transition slots, difference text, and optical flow—and their organization within the query interface. However, the paper does not clearly establish why these changes constitute a substantive methodological advance. In particular, the distinction between “physical state-transition learning” and future-state representation learning is asserted more strongly than it is demonstrated. The proposed combination may be useful, but its specific contribution beyond an alternative auxiliary-supervision recipe remains insufficiently established.
- The ablations do not isolate the claimed advantages of the proposed targets or their integration.
Table 3 shows that adding each supervision type to the query-based action-only baseline improves performance, and that the full combination performs best. However, these experiments do not establish whether all three targets are necessary, since the corresponding leave-one-out combinations are missing. More importantly, they do not distinguish the benefit of transition-specific supervision from current-state or future-feature supervision, nor compare alternative integration mechanisms while holding the supervision fixed. The comparison with DreamVLA does not resolve this issue: the models use different backbone scales, initializations, and training recipes, so the performance gap cannot be attributed to the proposed target design. Consequently, the experiments support the effectiveness of the overall recipe, but provide limited evidence for the particular methodological claims used to motivate it.
Questions for authors
- Contribution clarification: What is the precise methodological advance over future-aware query representations trained with auxiliary prediction objectives? Which aspect of the proposed transition formulation cannot be adequately captured by existing future-state or motion-supervised approaches?
- Evidence for the claimed contribution: Can the authors provide controlled comparisons using the same backbone, initialization, data, and training budget to distinguish the proposed transition targets from current-state/future-feature targets? Please also clarify whether leave-one-out target ablations or comparisons of alternative integration mechanisms are available.
7 comments
Thanks & Initial Response to Reviewer YuV2 (W2 & Q2)
[W2 & Q2 - Controlled Comparisons of Supervision Targets and Ablations of Auxiliary Objectives]
Thank you for the suggestions. We have added three control conditions using current-state supervision, future-state/feature supervision, and DreamVLA supervision targets within the same architecture, along with three leave-one-out variants.
1. Controlled comparisons: separating target design from model differences.
You noted that the benefits of transition supervision over current-state/future-feature supervision have not been distinguished and that the comparison with DreamVLA is affected by differences in backbone, initialization, and training recipe. To address these concerns, we compare different auxiliary supervision combinations under a common policy architecture and training procedure.
All conditions use the same backbone, initialization before continued pretraining, source demonstration data, and optimization update budget. We also keep the number of Queries, action interface, downstream fine-tuning protocol, and evaluation protocol identical.
| Supervision Setting | Auxiliary Supervision Targets during Continued Pretraining | LIBERO-Plus Average Success Rate (%) |
|---|---|---|
| Current-state | Current-state descriptions, current-state fields, and frozen visual features of the current image | 73.13 |
| Future-state | Future-state descriptions, future-state fields, and frozen visual features of the future image | 74.89 |
| DreamVLA supervision targets (VLA-Δ architecture) | Reconstruction of future dynamic regions, prediction of future depth, and prediction of future semantic features | 69.73 |
| VLA-Δ | Difference text and structured state-transition fields describing changes from current to future states, together with optical flow | 76.62 |
(1) Distinguishing transition supervision from current-state/future-feature supervision.
Compared with current-state supervision and future-state/feature supervision, VLA-Δ improves the average LIBERO-Plus success rate by 3.49 and 1.73 percentage points, respectively. This controlled comparison adds the previously missing evaluation of supervision targets under the same architecture and shows that under the tested architecture and training conditions, explicitly modeling task-relevant changes from current to future states can yield higher downstream task success rates than current-state or future-state/feature supervision.
(2) Controlling for differences in architecture, initialization, and training recipe in the comparison with DreamVLA.
We agree that the performance gap between the two complete models in the original submission cannot, by itself, establish the contribution of the supervision target design. We have therefore added the “DreamVLA supervision targets (VLA-Δ architecture)” control, which uses DreamVLA’s auxiliary prediction targets to supervise Query representations within the common VLA-Δ policy architecture and training procedure.
This variant using DreamVLA’s targets achieves an average success rate of 69.73%, while VLA-Δ achieves 76.62%, an improvement of 6.89 percentage points. This result shows that, with the backbone, initialization, data, and optimization update budget held fixed, the proposed supervision combination still achieves a higher downstream success rate.
2. Leave-one-out ablations: conditional contributions of individual objectives.
To address your concern about the missing experiments that remove individual objectives from their combinations, we have added three leave-one-out variants that individually remove difference text, structured slots, or optical flow supervision from the full model. For each leave-one-out variant, we remove only the corresponding auxiliary training objective and keep the remaining loss weights unchanged.
| Pretraining Variant | LIBERO Average Success Rate (%) | Full Model − Variant (Percentage Points) |
|---|---|---|
| Action only | 96.45 | 1.95 |
| Action + Difference Text | 97.2 | 1.2 |
| Action + Structured Slots | 96.9 | 1.5 |
| Action + Optical Flow | 97.35 | 1.05 |
| Action + Structured Slots + Optical Flow (without Difference Text) | 97.7 | 0.7 |
| Action + Difference Text + Optical Flow (without Structured Slots) | 97.5 | 0.9 |
| Action + Difference Text + Structured Slots (without Optical Flow) | 98 | 0.4 |
| Full model | 98.4 | 0 |
The additional experiments show that individually removing difference text, structured slots, and optical flow from the full model reduces the success rate by 0.70, 0.90, and 0.40 percentage points, respectively. This indicates that all three supervision targets make positive contributions to downstream performance. Even when the other two types of supervision are already present, each provides additional gains, and using all three together achieves the best performance.
Follow-Up — Seeking Further Feedback (Discussion Deadline Approaching)
Dear Reviewer YuV2,
Thank you for your careful review of our work and your constructive suggestions. In response to your concerns, we have provided additional experimental results and analyses and further clarified our methodological contributions and experimental settings. We would like to follow up to ask whether these responses have addressed your main concerns and whether any points require further clarification.
We would appreciate it if you could review our responses and share any further feedback before the discussion period ends. If any concerns remain, we would be happy to provide further explanations, continue the discussion, and improve our manuscript accordingly.
Thank you again for the time and effort you have devoted to reviewing and discussing our work. We look forward to hearing from you.
Best regards,
The Authors
Thanks & Initial Response to Reviewer YuV2 (W1 & Q1)
[W1 & Q1 - Contributions and Relation to Predictive Supervision]Thank you for the feedback. We clarify our contribution through continued pretraining, supervision design, and experimental evidence.
1. Methodological contribution: continued pretraining with task-relevant physical changes.
Our core contribution lies in continued pretraining, where we explicitly train VLAs to learn the object motion, contact transitions, and task progress associated with actions and transfer this knowledge to downstream policy learning. Downstream fine-tuning uses only action supervision and still benefits from the change supervision provided during pretraining.
To the best of our knowledge, we are the first to achieve this goal in VLA continued pretraining through joint supervision using difference text, structured physical variables, and visual motion.
2. Future-state and motion supervision: explicitly supervising task-relevant changes.
(1) Physical transitions versus future-state representations.
DreamVLA’s approach to learning action-relevant representations through predictive supervision, as mentioned in your review, has inspired our research. We have cited and discussed this work in the paper. DreamVLA provides future information for action generation by reconstructing future dynamic regions and predicting depth and semantic features. VLA-Δ further uses difference text and structured state-transition fields to explicitly supervise changes from current to future states and their task-related meaning, together with optical flow for dense motion supervision.
(2) What can future-state or motion representations capture?
We acknowledge that future-state or motion representations can, in principle, encode this information. We emphasize the difference in supervision requirements. Endpoint feature matching or motion prediction does not directly specify which task-relevant state changes the model must predict. We explicitly formulate these changes as text and structured fields and include them in the optimization objective. Thus, our claim is that for a given dataset and training budget, directly supervising task-relevant changes can more effectively support downstream action learning.
(3) Controlling confounds in the comparison with DreamVLA.
We report an overall benchmark comparison with DreamVLA.
To control for the effects of differences in backbone, initialization, and training procedure, we have added the “DreamVLA supervision targets (VLA-Δ architecture)” control in
W2 & Q2, which uses DreamVLA’s auxiliary prediction targets to supervise Query representations within the common architecture.This variant using DreamVLA’s targets achieves an average LIBERO-Plus success rate of 69.73%, while VLA-Δ achieves 76.62%, an improvement of 6.89 percentage points. These controlled results provide more direct evidence of the benefits of explicit change supervision.
3. Continued pretraining gains: controlled ablations and cross-backbone validation.
(1) Gains beyond additional action training.
Table 3in the original submission compares no continued pretraining, action-only continued pretraining, and VLA-Δ under the same Query architecture and downstream fine-tuning protocol.Continued pretraining with action supervision alone improves the success rate by 0.20 percentage points. Using the same continued pretraining data, VLA-Δ achieves a further gain of 1.95 percentage points over the action-only control.
This result shows that explicit change supervision enables the same additional demonstration data to produce greater downstream gains and improves task performance after standard fine-tuning with action supervision.
(2) Applicability across backbones.
We further apply this training scheme to two base policies, ZR-0 and π0.5. The table below reports average success rates. Values in parentheses indicate improvements over the corresponding base policy in percentage points.
VLA-Δ improves average success on both benchmarks for both backbones, supporting its applicability. See Appendix C.1 for LIBERO-Plus details.