- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Next-WAM, an any-to-any world-action model for robotic manipulation that unifies language reasoning, future visual prediction, and continuous action generation. The model uses three Transformer experts for understanding, generation, and action, with structured joint attention for cross-modal information exchange. A key design choice is to use future-image prediction as training supervision while masking future-image latents from the action stream, so future images do not need to be generated during policy inference. The model also introduces Reason/Act control tokens to support online subtask reasoning. Experiments are conducted on LIBERO, LIBERO-Plus, and two real-robot reasoning tasks.
Critical strengths
The overall design is clean and practical. In particular, using future visual prediction as training supervision without requiring future generation during action inference is a sensible choice. The comparison against the IDM-style variant also provides some evidence that explicit future generation is not necessary for action prediction.
The real-robot tasks are reasonably well designed for testing reasoning. Conditional object grasping and Coke restocking test logical instruction following and task-progress tracking rather than only low-level manipulation success.
Critical weaknesses
-
The main architectural claim is not sufficiently isolated experimentally. The paper motivates the three-expert MoT design as a way to reduce interference between language reasoning, visual prediction, and action learning, but does not compare it against a similarly sized shared-backbone model or other parameter-sharing variants. As a result, it is difficult to attribute the observed gains specifically to expert separation.
-
The LIBERO-Plus comparison is not sufficiently comprehensive with respect to stronger recent baselines. The reported 70.5% result is strong relative to the selected methods in Table 3, but the comparison does not reflect the strongest currently reported results on LIBERO-Plus. This makes the robustness claim less convincing and makes it harder to judge the method against the current state of the art.
-
The contributions of future prediction and explicit text reasoning are not clearly disentangled. The paper reduces the image loss weight, but does not show a complete removal of future-image supervision, nor an ablation without explicit text reasoning. These experiments are important because the paper’s main contribution is the combination of reasoning, world prediction, and action generation.
Questions for authors
-
Can the authors provide a comparison between the proposed three-expert architecture and a shared Transformer with a comparable parameter count? This would help verify whether expert separation itself is responsible for the improvement.
-
Can the authors clarify the selection of LIBERO-Plus baselines and compare against stronger recent methods, or explain why those results are not directly comparable?
-
What is the performance when the future-image loss is completely removed rather than only down-weighted? Similarly, what happens when explicit text reasoning is removed? These ablations would help separate the contribution of each component.
-
The paper shows that conditioning action prediction on generated futures slightly hurts LIBERO performance. Does the same trend hold on the real-robot tasks, especially the longer-horizon Coke-restocking task?