- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
EAct addresses ambiguity in world-action models, where similar visual transitions can correspond to different execution trajectories. It decomposes the transition representation into a geometry-regularized effect latent and an effect-conditioned action latent. The paper reports 99.0% average success on LIBERO and 93.04% on RoboTwin clean settings.
Critical strengths
- The paper provides detailed construction of the objectives for neighborhood alignment, and the representation analysis shows that the regularization improves the desired alignment property.
- The learning efficiency and the transfer experiments are interesting and it shows the potential of the method to quickly adapt to new tasks.
Critical weaknesses
- The geometry regularization is not well justified. The paper doesn't report the ablation of . Section 4.4 only shows that does improves the neighbor alignment, but it can't be considered as an evidence to prove that the geometry regularization does improve the performance of the model in the downstream tasks.
- The author uses "the map from transition to execution is one-to-many" as the motivation of the action latent. But flow-matching is able to learn one-to-many mapping, and the paper doesn't provide any explanation why the flow-matching is not enough to solve the problem.
- EAct only reports a 0.4% gain on LIBERO and 0.4% on RoboTwin compared to LaWAM. Since laWAM drops from 98.6% to 98.2% after 25k more steps of fine-tuning, it is unclear whether the gain is due to the proposed method or just a result of random seed noise. Additionally, the lack of real-world experiments makes it difficult to evaluate the generalization to real-world scenarios.
- Some ablation results are odd. For example, the method is supposed to perform equivalently well as LaWAM after removing the action latent, but it is actually worse than LaWAM. Also it is unclear why removing the whole action latent is better than only removing the residual conditioning.
Questions for authors
see above.