- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Evo-World is a lightweight vision-language-action model that learns predictive motion representations using optical flow supervision. The model contains a compact branch that predicts the embedding of future image-plane motion based on current observations and language instructions. The current embedding and the predicted embedding are used to modulate the policy through bounded FiLM modulation. The SIGReg mechanism is used to suppress representation collapse, while gradient detachment separates the motion representation learning from the action optimization process. At the inference stage, the model neither needs to perform optical flow estimation nor reconstruct future images. This paper evaluates the method on Meta-World MT50, RoboTwin, and real-world manipulation tasks, and conducts ablation experiments on the prediction targets, modulation features, fusion mechanisms, and optimization components.
Critical strengths
The results clearly show that adding motion information helps the policy. The model uses optical flow only to construct the training objective and makes predictions in the latent space at the deployment stage. Its total parameter count is 870 million (0.87B), an attractive design point: it gains motion prediction without running an optical flow estimator or reconstructing future observations during action generation.
Critical weaknesses
The related methods discussed in Section 2.3 are not compared with the method in this paper, so the empirical advantage of this approach over them has not been established. At minimum, controlled comparisons with the closest feasible methods, while reporting both task performance and computational cost, would make the empirical claims much more convincing.
The motivation for choosing optical flow is not very strong. Adding intermediate visual information in the middle of the VLA is a common practice. Comparing against other task-related approaches would give a stronger case for optical flow.
Questions for authors
Does "representation diversity" refer to preventing representation collapse and maintaining the differences between observations, or does it refer to semantic or motion-pattern diversity in a broader sense? The results of the SIGReg ablation experiment and Appendix C support the former.
The paper cites FiLM, but can it further explain the sources and rationale of the other design choices in the conditioning interface, especially the constrained modulation and zero initialization? Which of these are inherited implementation choices, and which are the novel contributions of this paper?
3 comments
Thank you for the clarification and for adding the FrameDiff experiments. This comparison largely alleviates my concern about the optical-flow choice; moreover, the explanation regarding representation diversity and the choice of FiLM implementation address my remaining doubts. I now have one main concern left: the comparison with closely related motion-supervised methods. Could you try selecting a representative existing method and evaluating it under the same lightweight backbone and a comparable training budget?
Response to Reviewer FSS6: Comparison with ATM
Thank you for the specific suggestion. We have added a comparison with ATM (Any-point Trajectory Modeling for Policy Learning), a representative open-source method that uses predicted point trajectories to guide policy learning, by adapting it to the same lightweight Evo-1 backbone.
Following ATM's trajectory-guided policy learning paradigm, we independently pretrain a trajectory predictor on Meta-World and keep it frozen during subsequent policy adaptation. Specifically, we initialize Evo-1 + ATM from an Evo-1 model trained for 100k steps, incorporate the ATM trajectory predictor, and perform an additional 10k steps of policy adaptation. This gives a cumulative policy-training budget of 110k steps, matching Evo-World’s budget in terms of policy optimization steps.
Our adaptation preserves ATM’s early- and late-conditioning design. Predicted trajectory tokens condition the action features before the action Transformer, while predicted trajectory coordinates additionally condition the final action MLP. These interfaces are adapted to Evo-1’s architecture, retaining its VLM backbone and flow-matching objective. The trajectory predictor remains frozen throughout policy adaptation.
We evaluate the adapted policy on all 50 Meta-World tasks, with 10 episodes per task, using the same evaluation protocol and tier-averaged success metric as in our paper.
The results are summarized below:
| Method | Easy (%) | Medium (%) | Hard (%) | Very Hard (%) | Tier-averaged SR (%) |
|---|---|---|---|---|---|
| Evo-1 | 89.2 | 76.8 | 77.2 | 79.2 | 80.6 |
| Evo-1 + ATM | 93.2 | 78.2 | 78.3 | 88.0 | 84.4 |
| Evo-World | 93.2 | 89.1 | 88.3 | 94.0 | 91.1 |
The ATM-adapted baseline improves upon Evo-1 by 3.8 percentage points, confirming that predicted trajectory guidance can benefit the lightweight policy. Nevertheless, Evo-World’s score is numerically 6.7 percentage points above the ATM aggregate.
This additional comparison broadens our evaluation to a representative trajectory-guided alternative on the same lightweight backbone and provides supplementary empirical support for Evo-World’s effectiveness. We will incorporate this additional comparison with ATM into the final version of our paper.
Response to Reviewer FSS6
We thank you very much for the constructive suggestions.