- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes PEWAM, a World-Action Model based on object effect representations. The method converts demonstrations into an Effect Program—comprising object keypoint trajectories, contact points, and final states—to decouple task objectives from embodiment-specific execution actions. Using multi-stream Flow Matching, the model jointly learns object state transitions and robot actions, enabling program editing and closed-loop replanning. Evaluations across LIBERO, Meta-World, RLBench, diverse robotic arms, and real-world setups demonstrate its capabilities in single-demonstration task execution, cross-embodiment transfer, and disturbance recovery.
Critical strengths
-
The task representation is innovative. Decoupling object manipulation goals from robot actions via the Effect Program enables direct editing of target positions and grasp methods, providing both flexibility and interpretability.
-
The lightweight model demonstrates practical potential. With only 71.5M parameters, PEWAM achieves high success rates on real robots and exhibits closed-loop disturbance recovery, highlighting its practical value.
Critical weaknesses
-
Cross-embodiment generalization is limited. While the Effect Program is decoupled from the robot embodiment, cross-arm transfer still relies on kinematic mapping and unified control interfaces, failing to demonstrate generalization across structurally distinct robots.
-
Experimental validation is insufficient, and the core design's necessity is questionable. The paper lacks systematic evaluations on public benchmarks using standard protocols, and baseline comparisons are inadequate. Furthermore, the full Effect Program underperforms compared to using only final goal states in LIBERO-Goal experiments, failing to justify the necessity and consistent advantage of this complex task representation.
Questions for authors
-
Current cross-arm transfer relies on Panda joint space mapping and unified operational space control. Could you provide direct execution experiments on unseen robots with significantly different kinematics or action spaces, and compare them with existing adaptation methods? This would verify that the generalization stems from the model itself rather than rule-based kinematic adaptations.
-
Why are results not reported under the full standard evaluation protocols of public benchmarks like LIBERO and RLBench? Please provide the performance and statistical results for the complete task sets.
-
Could you compare the method against recent competitive Diffusion Policy, VLA/WAM, and object-centric manipulation approaches under unified training data and evaluation protocols?
-
Why does the full Effect Program underperform compared to using only final goal states on LIBERO-Goal? Please provide rigorous ablations demonstrating that object trajectories and contact points offer stable and irreplaceable benefits.