- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper decouples video representation updates from action execution in world action models. AHA-WAM uses a low-frequency video DiT to maintain historical K/V memory and reusable layer-wise context, while a high-frequency action DiT predicts short action chunks from current observations and proprioception. Its main mechanism OVCR compresses current visual observations into queries and adapts cached video K/V through layer-wise retrieval and gated residual updates. Training also includes action-start phase randomization and rolling historical memory. AHA-WAM reports 92.80% average success across 50 RoboTwin 2.0 tasks and 78.33% across four real-world tasks, with component ablations, environmental-change evaluations, and deployment analyses. The optimized full model achieves 41.37 ms action-chunk inference latency. The distilled two-step AHA-WAM-Flash reduces latency to 17.56 ms while retaining 90.20% average success on RoboTwin.
Critical strengths
- Low latency with strong manipulation performance is the main practical contribution. The full model achieves 41.37 ms action-chunk latency and 92.80% average success on 50 RoboTwin tasks. The Flash version reduces latency to 17.56 ms while retaining 90.20% success, making large-video-model policies more attractive for deployment.
- OVCR is an effective cache adaptation mechanism and the main methodological contribution. It updates reused video K/V layer by layer using current observations, without rerunning the video DiT. Success drops from 92.80% to 88.71% without current observations and to 89.27% without layer-wise routing; direct asynchronous reuse achieves 88.60%.
- The complete system delivers practically valuable manipulation results. AHA-WAM achieves 78.33% across four real-world tasks involving deformable objects, tidying, tool use, and bimanual manipulation.
- Phase randomization is a simple, effective training improvement. It exposes the action model to misalignment between video windows and action chunks, helping it handle phase shifts during deployment.
Critical weaknesses
- The efficiency gain is not clearly attributable to asynchronous modeling. Fast-WAM’s official 190 ms latency is compared with AHA-WAM’s heavily optimized 41.37 ms on an RTX 5090D, while AHA-WAM’s eager latency is 415.77 ms.
- OVCR’s benefits are confounded by added capacity and visual representation. The new modules add 1.22B parameters, exceeding the 1.02B action DiT, without capacity-matched visual-conditioning or cross-attention controls.
- Generalization evidence is limited, and demo selection raises cherry-picking concerns. Baseline successes are omitted despite π0.5/Fast-WAM achieving 76.67%/68.33% in original conditions and π0.5 outperforming AHA-WAM overall on OOD tasks. Selection criteria and failure mechanisms need clarification.
- Typo issue. The text accompanying Tables 13 and 14 should be updated to match the current results reported in the tables.
Questions for authors
Could the author explain why video is preferred over semantic representations, memory, or future images for guiding actions?
Thank you for the detailed response and additional experiments. My main concerns have been adequately addressed, and I am inclined to revise my rating upward to Weak Accept.