- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
DexForesight trains a π0.5-based dexterous VLA with two training-only future signals: an alignment loss that pushes learnable VLM query tokens toward the future latent predicted by an action-conditioned V-JEPA 2 predictor, and a residual adapter distilled from the velocity difference between a privileged forward pass (future object state plus future visual features) and a causal one. On the 11 DexJoCo tasks, the method raises average success from 52.5% to 62.6% under rand-obj, with no extra inputs at deployment.
Critical strengths
The paper separates two ways a demonstrated future can supervise a causal policy: predicted futures shaping the representation, and realized futures shaping action generation.
All privileged inputs, the predictive modules, and the query tokens are removed at deployment. Inference overhead is below 1%, so the method drops into existing π0.5 pipelines easily.
Gains are consistent across rand-obj, rand-full, and multi-task settings. The path and privileged-modality ablations help show where the improvements come from.
Critical weaknesses
The flow-distillation target has no information the causal policy cannot already learn. At the flow-matching optimum, v_base(x_τ, τ | o_t) is the conditional expectation of v_priv given the causal inputs, so E[r_flow | x_τ, τ, o_t] = 0, and an adapter that sees only causal features can only regress toward that zero mean. Any gain must therefore come from v_base being under-fit, meaning the adapter acts as extra capacity or extra training signal rather than distilled foresight; capacity-matched adapters and longer base training are needed to rule this out.
The alignment target is a stack of approximations whose value is not justified. The query tokens regress a frozen predictor’s output, which is conditioned on ground-truth future actions, which in turn is defined in a space trained to mimic pretrained future-frame features. Because the Action Expert is masked from the queries, the loss acts only as an indirect regularizer on shared VLM weights, and there is no ablation against simpler targets such as E_dex(I_{t+Δ}) or direct auxiliary action or state prediction.
The empirical evidence does not support the novelty claim. The action path closely follows PFD and the alignment path resembles FLARE and FutureVLA, yet none of these are compared, and the rand-full and multi-task baselines are copied from the DexJoCo paper rather than reproduced.
Author should do real machine experiments to test model performance
Questions for authors
See Weakness