- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes ElasticWAM, a controller for allocating future-video computation in a frozen world-action model. An action-supervised refinement-demand field determines which video tokens to refresh, how far to advance denoising, and when to commit the world representation and finish action generation. Unrefreshed tokens retain cached representations, allowing active queries to access the full logical context. The evaluation covers LIBERO, LIBERO-Plus, LIBERO-Pro, RoboCasa-GR1, and a four-stage real-robot tea-preparation task. The main reported efficiency result is a 32.2% latency reduction relative to Joint-WAM on RoboCasa-GR1, with success increasing from 55.0% to 57.4%.
Critical strengths
-
The treatment of sparse refinement is well motivated. The method separates the decision to recompute a region from the decision to retain it as conditioning context. Keeping inactive regions available through the cache is a useful design choice for manipulation, where a region that does not need another update may still matter to the action. Training the allocation decisions using action errors also gives the controller a task-relevant objective.
-
The ablations provide meaningful evidence beyond an overall comparison with dense inference. On RoboCasa-GR1, learned selection at the same 96-token budget reaches 57.42%, compared with 53.83% for random selection. The First-KV comparison also tests the value of refreshing cached context. On LIBERO-Plus, adding adaptive progression and commitment improves over the spatial-only variant. Together with the measured latency reduction, these results make selective refinement a promising direction rather than merely a reduction in nominal token count.
Critical weaknesses
-
The controller's training procedure is not specified well enough to reproduce or fully assess the central contribution. Section 3.3 describes converting counterfactual errors into a soft target for the Beta progression, but does not define this conversion or the temperature T(s). The soft mask used in Eq. (12) and several losses in Eq. (14) are also left unspecified. These choices determine how the proposed inference policy is actually learned; they are more consequential than ordinary implementation details. Appendix A mostly describes evaluation and does not fill these gaps or provide the controller architecture and training hyperparameters.
-
The evidence for the headline gains needs clearer experimental accounting. Appendix A reports ElasticWAM on a 1,506-episode LIBERO-Plus subset while quoting baseline results from Faster-WAM. It is not clear whether the quoted baselines use the same subset and category weights, so the 73.7% versus 66.3% comparison is difficult to interpret confidently. The latency table also lacks the hardware and timing protocol needed to assess the 32.2% saving. Finally, the real-robot evaluation does not state the number of trials, and the reported success-rate differences have no uncertainty estimates. The favorable trends are encouraging, but these omissions limit how strongly they support the conclusions. I currently lean toward weak rejection, principally because the learning procedure and the main comparisons need this additional evidence.
Questions for authors
-
Could the authors provide the exact Beta-target construction, T(s), soft-mask relaxation, and losses in Eq. (14), together with the controller architecture, training settings, and the frozen WAM checkpoint used? These details would materially affect my assessment of reproducibility.
-
How was the 1,506-episode LIBERO-Plus subset selected, and what are the episode counts per category? Were the quoted Joint-WAM and Fast-WAM results evaluated on exactly this subset with the same aggregation? If not, a comparison on matched episodes would help establish the robustness gain.
-
What hardware and timing procedure produced Table 4, and does the reported latency include controller evaluation, mask selection, and cache management under the same conditions for all methods? Please also give the real-robot trial counts and uncertainty estimates for the main success-rate comparisons. This would clarify the practical size and reliability of the improvements.