- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Devol-ONE, a Mixture-of-Transformers architecture integrating a vision-language stream, a V-JEPA latent dynamics stream, and a continuous action expert. The streams retain separate parameters and communicate through layerwise directed attention: the dynamics stream accesses vision-language context, while the action stream accesses both vision-language and dynamics context. The model autoregressively forecasts future latent states and conditions action-chunk generation on these predictions. The authors also introduce Autoregressive Latent Rollout Training (ALRT), which switches from a teacher-forced warm-up to self-generated latent rollouts to reduce the training–inference distribution mismatch.
Critical strengths
Using predictive latent states for action generation without synthesizing future video pixels is a reasonable direction for incorporating predictive information into deployable robotic policies.
Maintaining specialized streams for semantic processing, latent prediction
Experiments are well-performed. The paper is well-written.
Critical weaknesses
I find that in the paper ALRT is presented as a major contribution, but Tables 5, 6, and 10 test conditioning sources, fusion mechanisms, or prediction horizon—not teacher forcing versus ALRT. Consequently, the current evidence does not establish how much of the improvement comes from training on self-generated latent trajectories.
The claim that ALRT benefits not only the predictor but also the policy conditioned on its rollouts remains untested.
Page 2, lines 106–107, reports Clean and Randomized success rates of 61.1% and 63.7% on 34 evaluated tasks. In contrast, Table 8 and its accompanying discussion report results on all 50 tasks, with averages of 58.0% and 62.2%, and an overall average of 60.1%, below GigaBrain-0.7’s 67.4%. Recomputing the averages from the 50 rows of Table 8 yields approximately 58.02% and 62.16%, consistent with the appendix.
Questions for authors
What is the precise difference from VLA-JEPA? Please specify the action heads’ training and inference conditioning in both methods, explain the claimed propagation of exposure bias to the action head, and clarify the LIBERO-Plus baseline selection and averaging convention.
We hereby genuinely be grateful for your careful review.
Q1 (RoboTwin). Thank you for pointing this out. We were trying to release the full RoboTwin results in time, but the full 50-task run finished very late, right before the deadline. That is why the Introduction still has the 34-task average (61.1% / 63.7%), while Table 8 has the full 50-task result (58.0% Clean / 62.2% Randomized). The 34-task number is only the average over the tasks finished at that time, and the 50-task number is the final one. The full details were too long for the main paper, so we put them in the appendix. In the camera-ready version we will make the numbers consistent, put the 50-task summary in the main text, and explain how the four tasks in the main paper were chosen. We also agree that single-task fine-tuning for ours and co-training for the baselines is not the same protocol, so we will reword the RoboTwin claims and not use them as direct evidence for the architecture itself.
Q2 Yes, the dynamics prediction should be understood as a task-conditioned forecast, not a prediction of candidate-action consequences. We do not feed actions into the JEPA flow predictor and we do not use action latents as supervision for it. The predictor only predicts future V-JEPA 2 latents from the current observation and the language instruction. So it cannot tell what would happen under different candidate actions.
The forecast is meant to tell the policy what the scene is expected to look like as the task progresses. The action expert reads it at every layer through directed attention, so the action chunk is generated given the anticipated future, not the future derived from the action. We keep the dependency directed (VL → dynamics → action) because the predictor is only trained to output the future latent distribution of V-JEPA 2, and at deployment only the current frame and the instruction are available, so the forecast has to be computed without knowing the action. Table 5 shows this information is useful: JEPA-only conditioning beats VL-only (96.9 vs. 96.0 average, 94.2 vs. 92.5 on LIBERO-Long), and layerwise fusion is the best (98.4 average, 97.0 on LIBERO-Long).
In the revision we will change the motivation, abstract and contributions to "task-conditioned latent forecasting", add a paragraph in the Method section explaining the information flow, and list action-conditioned dynamics as a limitation and future work.
Q3 (teacher forcing vs. ALRT). We will add a direct comparison between teacher forcing and ALRT in the camera-ready version, on LIBERO and zero-shot LIBERO-Plus, with the same architecture, data and training budget.
For the comparison, student forcing (ALRT) means the predictor runs on its own outputs for the whole rollout. Teacher forcing means we directly use the ground-truth output of the V-JEPA 2 encoder, since the predictor's goal is just to predict future latents from the V-JEPA 2 output distribution. Inference is the same for both, because a VLA only sees the current frame at deployment. Our expectation is that if the predictor itself is good enough, teacher forcing is not necessary. It may give some improvement, but it relies on ground-truth future frames that do not exist in real use.