- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates how training samples should be allocated between direct action prediction and auxiliary objectives in VLA learning. A two-stream MMDiT with sample-level routing enables comparisons of three latent-action (LA) targets and three future-vision (FV) targets under fixed policy-update and sample-exposure budgets. Experiments on LIBERO, CALVIN, and four real-robot tasks show that suitable auxiliary supervision can improve policy performance even when direct action prediction receives half or fewer training samples. FV generally performs better among the tested configurations, while the strongest LA target remains competitive on CALVIN.
Critical strengths
- The paper addresses a useful training-design question with substantial controlled evidence. The source-matched FV controls and allocation–budget sweeps strengthen the finding that direct action prediction need not dominate training. For example, V-JEPA 2 at P25 on CALVIN exceeds both its matched P100 control and the shared action-only baseline; Table 6 reports an SR-5 of 80.5% versus 71.6% for the latter. This provides a concrete and practically relevant finding about how predictive supervision can benefit action execution.
- The experimental coverage is extensive and the conclusions are appropriately qualified. The study compares six target configurations across two simulation benchmarks and four real-robot tasks, with additional loss-weight ablations and representation analyses. It also reports settings where auxiliary supervision hurts and where LA remains competitive with FV. This breadth makes the comparison informative beyond a single favorable configuration.
Critical weaknesses
- Training-level variability remains unclear. Table 6 reports multiple evaluation seeds, but independent training-seed results are not reported. Some source-matched LIBERO improvements are relatively small, and fine-grained target rankings vary across checkpoints or evaluation seeds. Repeating a small subset of the key comparisons would strengthen confidence in the reported rankings and preferred allocations.
- The real-robot results do not fully isolate the contribution of FV supervision. Unlike the simulation experiments, Table 15 does not include source-matched FV P100 controls. Since FV configurations also receive additional current-frame features, the real-robot gains over the shared baseline may reflect both improved visual inputs and auxiliary supervision. This limits the attribution of those gains, although the matched simulation comparisons provide direct evidence for the supervision effect.
Questions for authors
- Were the key comparisons repeated with independent training seeds? If available, please report training-level variability for V-JEPA 2 P25 on CALVIN and the strongest P50 FV configurations on LIBERO.
- Are source-matched FV P100 results available for the real-robot tasks? These would help determine how much of the improvement comes from auxiliary supervision beyond the additional current-frame features.