- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Faster-WAM connects a pretrained video backbone to a single-layer action expert through learned fusion of cached keys and values, with world-model-only conditioning and aligned positional encodings. It retains competitive manipulation performance while reporting approximately 3.7–3.8× faster inference than Fast-WAM and improved LIBERO-Plus generalization.
Critical strengths
- Lite KV-Fusion exposes all video layers to a shallow action expert using only 720 learned mixing logits.
- Matched 32-action, ten-denoising-step comparisons show approximately 3.7–3.8× speedups over Fast-WAM while retaining competitive control.
- LIBERO-Plus gains, LTX-backbone transfer, and four physical tasks provide complementary evidence beyond standard LIBERO success.
Critical weaknesses
- No depth sweep holds fusion, conditioning, and RoPE fixed, limiting attribution of the gains specifically to a shallower action expert.
- Learned fusion is compared with final-layer readout, but not uniform averaging; Figure 4’s weights remain close to uniform.
- Reported deviations cover evaluation runs, while the training configuration uses one seed; small ablation gains lack training-level uncertainty.
Questions for authors
- Can you compare 1-, 2-, 4-, and deeper-layer experts with identical fusion, conditioning, and RoPE, reporting success, OOD performance, and latency?
- Can you compare learned per-head fusion against fixed uniform averaging and shared-across-head mixing to isolate the benefit of learned weights?
- Can you repeat the key conditioning and RoPE ablations across independent training seeds and report confidence intervals for their performance differences?
3 comments
W3 + Q3. Training-level uncertainty
We agree that evaluations across multiple seeds and independent training runs capture different sources of uncertainty. Our reported means and standard deviations are computed over three action-noise seeds for each fixed checkpoint. These quantify evaluation variability, while independent training runs are needed to assess training variability.
Obtaining confidence intervals that account for training randomness requires independently training and evaluating each ablation configuration multiple times, which entails substantial time and computation for large WAM/VLA models. Given the limited time and computational resources available during the rebuttal period, we may not be able to complete a full study of the conditioning and RoPE ablations across multiple independent training seeds. We will make every effort to complete additional training runs and their evaluations, and aim to include the results and confidence intervals for the corresponding performance differences in a subsequent revision.
For context, the LIBERO results in Fast-WAM (Table 2) and the LIBERO-Long results in Motus (Table 9) are reported as point estimates without accompanying standard deviations or confidence intervals. By additionally reporting means and standard deviations across repeated evaluations, we make evaluation variability explicit and provide a more informative basis for comparison than point estimates alone. The relatively small deviations observed in our evaluations provide useful evidence of the repeatability of the evaluated checkpoints.
Thanks for the authors' response. I will keep my positive score. Please be sure to include the discussion into your final version (if accepted).
W1 + Q1. Action-depth comparison
To better understand the effect of action depth, we trained additional 2-, 4-, and 8-layer action experts while retaining learned KV fusion, world-model-only conditioning, and retracted 1D-RoPE.
On LIBERO-Plus, increasing depth does not consistently improve performance. In particular, the 8-layer expert achieves lower mean success than the 2- and 4-layer experts. These results are consistent with a possible OOD generalization benefit from a lightweight action expert.
It is worth mentioning that all variants achieve near-ceiling success on standard LIBERO, leaving limited room for further improvement. This may partly explain the small differences in in-domain performance across depths. On more challenging tasks, a modest increase in action depth might improve in-domain performance.
We use a single-layer action expert as the main configuration to demonstrate that DoT enables WAMs to perform well even with an extremely lightweight action module. This choice is not intended to establish one layer as the optimal depth.
We also measured the 2-, 4-, and 8-layer variants on the same consumer-grade GPU using the original timing protocol. The single-layer Faster-WAM and Fast-WAM rows report the original paper benchmarks.
Among the Faster-WAM variants, additional action depth increases inference cost without a consistent improvement in OOD performance.
W2 + Q2. Uniform and shared-across-head fusion
We trained two additional variants of Lite KV-Fusion: fixed uniform fusion, which assigns a weight of 1/30 to each video layer, and learned head-shared fusion, which learns one set of layer weights shared across all attention heads. Faster-WAM instead learns a separate set of layer weights for each head. All other architectural choices follow the final Faster-WAM model.
Fixed uniform fusion yields lower mean success rates on both benchmarks, with a small difference on LIBERO and a larger gap on LIBERO-Plus. Although the learned weights are close to uniform, their numerical proximity alone does not determine their effect on the fused representations. Differences in key norms and amplification through subsequent computation may contribute to this effect.
Learned head-shared fusion achieves similar standard LIBERO performance to per-head fusion, while its LIBERO-Plus success rate lies between fixed uniform and learned per-head fusion. This ordering is consistent with OOD benefits from both learning the layer weights and allowing them to vary across attention heads. As noted above, all three fusion variants achieve near-ceiling success on standard LIBERO, leaving limited room for further improvement.
Learning head-specific fusion weights allows the readout to adapt to the video backbone and dataset. Both uniform and head-shared fusion are special cases of this parameterization, which retains these options without imposing either in advance.