- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an agentic framework for WAMs comprising two components: the Agentic Reason Brain and the World Action Brain. An auxiliary system supports WAM execution, and the two components are jointly trained to improve performance.
Critical strengths
- The work proposes an agentic method to support the WAM’s generation process, incorporating a harness tailored to the WAM’s characteristics to improve overall performance.
- The experimental results show substantial improvements over the baselines.
- The entire pipeline is jointly trained, with both systems trained together to achieve the final results.
Critical weaknesses
- Agentic design is a common and broadly applicable approach, and in most cases, VLAs and WAMs do not differ within this paradigm. The experiments do not compare the proposed agentic design with existing agentic designs in terms of either design differences or empirical performance.
- The component designed around the WAM’s ability to imagine future states exploits a distinctive advantage of WAMs. However, there is insufficient experimental evidence and visualization to demonstrate its effectiveness. This capability should also be a key distinction between harnesses designed for WAMs and those designed for VLAs.
- The agent design is not evaluated using different models for the Agentic Reasoning Brain, particularly more powerful closed-source models. This makes it difficult to disentangle the gains from the agentic design itself from those attributable to the underlying model’s capabilities.
- The real-world robot experiments lack complete video comparisons and more extensive results.
Questions for authors
- Compare the proposed approach with other agentic designs, highlighting the effectiveness and intermediate processes of the components specifically designed for WAMs.
- Provide additional visualizations showing how the WAM’s imagined futures are refined.
- Compare results using other language models as the Agentic Reasoning Brain, particularly powerful closed-source models.
- Provide more extensive demonstrations and quantitative results from real-world robot experiments.
4 comments
Response to Reviewer Wycz
Q3. How sensitive is AWAM to the reasoning backbone, and how are backbone gains distinguished from those of the agentic design?
R3. We have added the BiCoord results for AWAM-Pro (DeepSeek-v4.1-flash) to Table 2 of the revised manuscript. A core contribution of AWAM is its Task–Skill–Primitive hierarchy for long-horizon bimanual manipulation. The LLM decomposes tasks, composes primitives, and coordinates the two arms, while the World–Action Brain focuses on learning basic operations and their local dynamics. This division allows a stronger reasoning backbone to improve how AWAM combines learned operations across tasks.
To assess sensitivity to the reasoning backbone, we compared both full configurations under the same BiCoord evaluation protocol. AWAM-Pro achieved 49.2% SR and 60.5% SSR, compared with 38.2% SR and 53.8% SSR for AWAM (Full) with Qwen3.5-27B. The DeepSeek configuration thus improved SR by 11.0 percentage points and SSR by 6.7 percentage points.
Table 3 of the revised manuscript evaluates the contributions of individual agentic components with Qwen3.5-27B held fixed. Adding experience memory increased SR and SSR by 2.5 percentage points each. Adding physical feedback yielded further gains of 1.5 percentage points in SR and 2.5 percentage points in SSR. We have not yet evaluated a GPT backbone because repeated API calls during online training and evaluation would incur substantial costs.
Table2 BiCoord performance of full AWAM with different reasoning backbones
| Reasoning backbone | SR (%) ↑ | SSR (%) ↑ | TL (steps) ↓ |
|---|---|---|---|
| Qwen3.5-27B | 38.2 | 53.8 | 491 |
| DeepSeek-v4.1-flash | 49.2 | 60.5 | 408 |
Q4. Can the authors provide more real-world demonstrations, complete videos, and quantitative comparisons?
R4. We have expanded the real-world evaluation from two tasks to five by adding Arithmetic and Logic, Chessboard Setup, and Letter Formation to the original Block Stacking and Number Sorting tasks. Table 5 of the revised manuscript compares AWAM and on each task and reports their mean success rates across all five tasks. The supplementary material includes uninterrupted videos of AWAM performing each task. We have included uninterrupted videos of AWAM performing all five tasks in the supplementary material, with playback at 1.5× speed throughout.
Table 3. Success rates (%) on five real-world manipulation tasks
| Method | Block Stacking (%) | Number Sorting (%) | Arithmetic and Logic (%) | Chessboard Setup (%) | Letter Formation (%) | Avg. (%) |
|---|---|---|---|---|---|---|
| (22/30) 73.3 | (18/30) 60.0 | (13/30) 43.3 | (21/30) 70.0 | (18/30) 60.0 | 61.3 | |
| AWAM | (25/30) 83.3 | (23/30) 76.7 | (26/30) 86.7 | (25/30) 83.3 | (23/30) 76.7 | 81.3 |
Dear Reviewer,
Thank you for the time and care you have devoted to reviewing our work. As the discussion period draws to a close, we would be grateful if you could take another look at our responses and revised manuscript when your schedule permits. Your feedback has helped us improve the paper, and we would welcome any further questions or concerns.
We appreciate your time and consideration.
Best regards, The Authors
Dear Reviewer,
With the discussion period closing in a few hours, we would be sincerely grateful if you could revisit our responses and revised manuscript, if your schedule permits, and consider whether they address your concerns and warrant an updated assessment.
We appreciate the time and care you have devoted to reviewing our work. Your feedback has helped us improve the paper, and we would be happy to clarify any remaining questions.
Thank you again for your thoughtful consideration.
Best regards,
The Authors
Response to Reviewer Wycz
Thank you for carefully reviewing our manuscript. We appreciate your feedback and respond to each comment below.
Q1. How does AWAM compare with existing agentic approaches in design and performance, and what distinguishes its WAM-specific harness?
R1. Thank you for the question. AWAM builds on the complementary strengths of LLMs, VLAs, and WAMs. A pretrained LLM can interpret new tasks and compose familiar operations but struggles with fine-grained contact control. VLAs and WAMs can learn precise manipulation from demonstrations, but generalizing to unfamiliar combinations of skills in long-horizon tasks remains challenging. Two contemporaneous approaches, HarnessVLA and HarnessWAM, focus on coordinating existing execution capabilities. HarnessVLA combines a frozen VLA with analytic primitives, while HarnessWAM maps plans to WAM-supported skills and uses execution feedback to revise those plans.
Inspired by how people combine familiar movements to accomplish new tasks, we introduce a Task–Skill–Primitive hierarchy for long-horizon bimanual manipulation. The LLM decomposes tasks into skills, selects primitives for each arm, and determines which operations can proceed in parallel and which must wait for the other arm to complete a step. Primitive-level annotations align the operations invoked by the planner with the demonstration segments used to train the WAM. This division allows the WAM to focus on learning basic manipulation operations and their local dynamics. For a new task, the LLM can recombine these primitives while the WAM reuses the operations it has learned. This may reduce reliance on large datasets of whole-task bimanual demonstrations.
The distinguishing feature of AWAM’s WAM-specific harness is bidirectional physical feedback through the primitive interface. Given a primitive intent from the LLM, the WAM predicts a future representation that guides action generation. The Physical Head uses the same representation to predict manipulation outcomes, interaction states, and collision risks. After execution, AWAM records these predictions alongside the observed outcomes in experience memory. The LLM can then use discrepancies between expected and observed outcomes when selecting or revising subsequent primitives.
Because we could not locate an official HarnessWAM implementation at the time of evaluation, we constructed Harness+WAM by retaining the HarnessVLA agent and replacing its VLA policy with Fast-WAM. With DeepSeek-v4.1-flash as the reasoning backbone for both systems, AWAM-Pro outperforms Harness+WAM on BiCoord by 24.8 percentage points in SR and 19.8 percentage points in SSR. Mean trajectory length on successful trials decreases from 616 to 408 steps. Table 1 reports this system-level comparison, which we have also added to Table 2 of the revised manuscript.
Table 1. Performance of agent-augmented methods on BiCoord.
With Qwen3.5-27B held fixed, full AWAM outperforms Agent + WAM by 6.2 percentage points in SR and 7.3 percentage points in SSR. These gains reflect the combined contributions of experience memory, physical feedback, and reinforcement learning. Table 3 of the revised manuscript quantifies the incremental contribution of physical feedback. With reasoning and experience memory already enabled, adding physical feedback raises SR from 34.5% to 36.0% and SSR from 49.0% to 51.5%.
Q2. What experimental and visual evidence shows how AWAM uses predicted futures to guide decisions?
R2. Figure 6 in the revised manuscript shows two block manipulation examples, one per row. Each panel contains two consecutive frames. Panels (a) and (b) show the WAM’s predictions for the original and revised primitives, respectively. Panel (c) shows the robot executing the revised primitive.
In the top row, the WAM predicts from the gripper’s position relative to the middle block that the gripper will knock the block out of place. The planner raises the gripper’s target pose, and the updated prediction shows the gripper clearing the block. During execution, the block remains in place. In the bottom row, the original prediction includes an extra block that is absent from the scene. After the planner revises the primitive, the updated prediction shows the correct number of blocks, with the light blue block aligned directly above the purple block. The execution frames confirm this alignment.