- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Pivot, a framework where a policy, dynamics model, and value function operate in a shared representation space from a frozen V-JEPA 2 encoder. The authors use instruction-dependent spatial weighting for dynamics prediction and combine TD learning with LIV-based semantic supervision for value estimation. They then use imagined rollouts and value-based binary labels to refine a flow-matching policy. The method improves average sequence length on CALVIN from 3.946 to 4.294, and on a five-stage real-robot task from 1.6 to 4.3.
Critical strengths
- The paper shows meaningful improvements over its own imitation baseline, particularly on the real-robot task, where average completed stages increase from 1.6 to 4.3. While the evaluation is limited to a single task with 10 trials, the improvement is encouraging.
- The value-learning ablations are useful. In particular, combining TD and semantic supervision improves ranking accuracy on imagined successors from 66.9% with TD alone to 80.3%. This provides some evidence that the proposed supervision helps evaluate predicted action outcomes.
Critical weaknesses
- My main concern is the choice of representation. The paper motivates using V-JEPA as a shared state space, but it is unclear how much of the improvement comes from the pretrained representation itself versus the task-aware supervision that is not sufficiently aligned with manipulation. All ablations keep the encoder fixed. I also find the related work on latent-action and motion-centric representations underdeveloped. Works like UniVLA [1] and ViPRA [2] explicitly learn task-relevant motion representations from video, with ViPRA using optical-flow supervision for fine-grained motion. These are not necessarily direct replacements for a full visual state, but are relevant alternatives worth discussing. Some comparison with other visual or motion-centric representations would help establish the contribution.
- I have some concerns with the experimental comparisons. The reported VPP baseline (4.261) is below its originally published 4.33 [3]. The authors do mention re-evaluating the checkpoint, but the difference matters given Pivot's small margin over VPP. DreamVLA [4], which reports 4.44 on CALVIN, is also missing from the comparison despite being cited. More importantly, the adapted WMPO baseline only uses a static camera while Pivot uses both static and wrist views, making this comparison difficult to interpret. This seems particularly relevant since VPP [3] (Appendix C) reports a substantial performance drop when using only the static camera (4.33 to 3.58). Multi-view and OpenVLA-OFT results on CALVIN have already been reported [5].
- I would also like to see more evidence for the recursive imagination component. The dynamics model is trained on demonstrations with relatively short rollout horizons, but is later used to evaluate policy-generated actions in imagined states. The paper does not analyze how prediction errors or value-ranking accuracy change with imagination depth, which seems important for the main claim.
Questions for authors
- Have the authors considered comparing different pretrained representations while keeping the proposed task-aware losses fixed? This would help clarify whether V-JEPA itself is important to the results.
- What is the imagination rollout length used during policy refinement? How does dynamics accuracy and value-ranking performance change with rollout depth, especially for actions outside the demonstration distribution?
- Why is WMPO evaluated with only a static camera? Could the authors provide a comparison with matched visual inputs? Also, what explains the difference between the re-evaluated VPP checkpoint and its originally reported performance?
References
[1] Bu et al., UniVLA: Learning to Act Anywhere with Task-centric Latent Actions, RSS 2025.
[2] Routray et al., ViPRA: Video Prediction for Robot Actions, ICLR 2026.
[3] Hu et al., Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representations, ICML 2025.
[4] Zhang et al., DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge, NeurIPS 2025.
[5] Lin et al., HiF-VLA: Hindsight, Insight and Foresight through Motion Representation for Vision-Language-Action Models, CVPR 2026.