- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Decoupled-WAM, which replaces the layer-by-layer aligned MoT/KV-cache exchange between the Video and Action Expert in WAMs with a shared, fixed-shape dense planning feature. This idea supports varying action-side depth, early exit after the deepest tap, and replacing the Video Expert via interface distillation with the Action Expert frozen. Experiments show that the action side can be compressed aggressively at little accuracy cost, while Video Expert replacement through the interface preserves most in-distribution behavior (94.7%) but degrades sharply out of distribution (74.9% to 38.1% on LIBERO-Plus).
Critical strengths
S1. The motivation is good: current WAMs wire the Action Expert layer by layer into a specific video model, which makes changing the video side hard; asking for a shared feature interface instead is a useful starting point.
S2. A one-layer Action Expert still reaches 98.2% on LIBERO at 40.5 ms and 24.7 queries/s, which shows that the action side can be made much smaller without losing much accuracy.
Critical weaknesses
W1. The 5-layer student retains 94.7% on LIBERO but drops from about 74.9% to 38.1% on LIBERO-Plus. This shows that this method does not equal behavior preservation. The paper notes this, but the “practical route” phrasing in the conclusion still reads somewhat optimistic; more cautious wording is advisable.
W2. Several comparisons have very small gaps, e.g., 98.5% vs 98.2% and 91.9% vs 91.8%, but no random seeds, confidence intervals, or multi-run variance are reported.
W3. Table 4 packs two experiments into one structure with a duplicated row, which hurts readability.
Questions for authors
For the very small performance gaps (e.g., 98.5% vs. 98.2% and 91.9% vs. 91.8%), could the authors report results over multiple random seeds with mean±std?
Response to Reviewer ZEuE
Thank you for the careful review. Our video-replacement experiment shows that interface-only distillation retains 94.7% LIBERO success with the entire trained Action Expert frozen.
Student robustness (W1)
A five-layer Video Expert learns to match the teacher’s planning interface using no action loss or video-generation objective. It achieves 94.7% LIBERO success at 30.2 ms per query. This demonstrates that the shared interface offers a practical target for replacing the video provider while retaining the trained consumer.
Appendix D reports the paired results.
Core-1000 is a diagnostic LIBERO-Plus subset. Its larger decline shows that robustness is harder to retain through interface matching alone, as already acknowledged in the abstract and conclusion. The experiment establishes provider replacement on standard LIBERO and identifies robustness retention as the main challenge for extending this capability. We will make the subset label explicit in the main text.
Random seeds and small gaps (W2, Q1)
Appendix E explicitly reports the single-seed setting. Repeating full training runs exceeds our rebuttal compute and time budget. We treat the small success-rate gaps as point estimates. Our main conclusions draw on the measured efficiency gains and experiments that hold one module fixed while adapting the other.
Table 4 (W3)
We will separate action-depth variation from video replacement and label each reference run. Appendix D explains that the A1 depth result is 98.2%, while its paired distillation result is 98.5%, using the same checkpoint with different evaluation backends and rollout batches. We will use the paired teacher in the replacement panel and align the main-text references.