- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes DirectWAM, which converts pretrained diffusion-based video and action experts into deterministic single-step predictors while retaining an explicit future-to-action cascade. The authors first train a single-step action model using demonstrated future representations, then freeze it and train the future predictor by backpropagating demonstration-action error through the action model. An optional reconstruction loss anchors the predicted future representations. Experiments on LIBERO, RoboTwin 2.0, and three real-robot tasks demonstrate substantial improvements over naive step reduction and favorable performance against Flash-WAM, with a reported 28× reduction in model-side inference latency relative to the full iterative teacher.
Critical strengths
1.The method addresses a practically important efficiency problem and achieves a useful performance–latency trade-off. Iterative inference in both video and action streams makes cascade WAMs expensive to deploy. DirectWAM reduces each stream to one evaluation while preserving explicit future conditioning. On RoboTwin, it achieves 85.4% average success, compared with 54.9% for naive single-step inference and 78.2% for Flash-WAM. Simulation and real-robot results support its ability to recover much of the control performance lost through step reduction while substantially reducing inference cost.
2.Controlled representation interventions provide meaningful evidence for action-oriented future learning. The selective-replacement experiments hold the action model fixed and modify only the future representation supplied to it. Transferring a small, locally action-sensitive component recovers a substantial portion of the action-error improvement and closed-loop performance gain. This provides stronger support than visualization alone for the claim that representation-error magnitude is an incomplete measure of control relevance. The visual-quality evaluation also indicates that action supervision preserves decodable visual structure in the evaluated configurations.
Critical weaknesses
1.The methodological contribution is relatively incremental, and the benefits of the specific training design and retained future pathway are insufficiently isolated. The central mechanism is demonstration-action regression through a differentiable cascade initialized from pretrained experts. The comparison with visual-only supervision supports the usefulness of action supervision, but does not establish the individual importance of the two-stage schedule, freezing the action expert, or the reconstruction anchor. Matched comparisons with joint single-step fine-tuning and anchor-strength ablations would better substantiate these choices. Furthermore, the paper lacks an action-only baseline trained with comparable pretrained components, data, and optimization resources. FastWAM and FasterWAM provide context, but their architectural differences prevent a controlled assessment of the intermediate future’s value. Consequently, the control benefit of retaining this additional prediction pathway remains insufficiently quantified.
2.The scope and uncertainty of the experiments limit the strength of the broader conclusions. The offline stochasticity analysis uses a learned single-step action model, so its attenuation of video variation may partly reflect that particular readout. Closed-loop interventions provide complementary evidence, but remain limited to one WAM instantiation and the evaluated task distributions. They do not establish when deterministic conversion remains appropriate for tasks with genuinely distinct valid strategies or substantial uncertainty. In addition, the main policy results do not report variability across independent training runs, real-robot evaluation uses only 20 trials per task, and the Flash-WAM LIBERO results are quoted rather than obtained through a matched reproduction. DirectWAM also remains below the full teacher on RoboTwin, at 85.4% versus 90.7%. The evidence therefore supports a strong efficiency–performance trade-off more clearly than broadly lossless preservation of teacher capabilities.
Questions for authors
1.How important are the two-stage schedule and the frozen action expert? Do you have matched comparisons with joint single-step fine-tuning and an anchor-strength ablation that isolate the benefits of these design choices?
2.How does DirectWAM compare with an action-only student trained using comparable pretrained components, data, and optimization resources? This would help quantify the control benefit and computational cost of retaining explicit future prediction.
3.Does the attenuation of video-sampling variation persist when the offline analysis uses the teacher’s native iterative action model? Do any evaluated tasks involve distinct valid action strategies for the same context, and how does the deterministic student behave in those cases?
4.How stable are the principal improvements across independent training runs? Additional uncertainty estimates would strengthen the simulation comparisons, particularly where performance is close to or slightly above that of the teacher.
2 comments
Official Response to Reviewer 9J5A (2/2)
Q4. Variability across independent training runs
Appendix B.4, Table 10 reports three independent 6,500-step Stage-2 training runs from the same 8,000-step Stage-1 checkpoint. Each seed is evaluated on 50 tasks with 50 episodes per task per split (2500 episodes per split), the seed means therefore summarize a separate evaluation. The limited variation across seeds supports the stability of this Stage-2 recipe under the evaluated settings.
Scope of the evidence. The revised Table 2 replaces quoted Flash-WAM LIBERO scores with our own trained reproduction, with protocols described in Appendix B.5.
Official Response to Reviewer 9J5A (1/2)
We thank the reviewer for the careful assessment and constructive questions.
Q1. Training design ablations
LIBERO models are trained jointly across all four suites with an effective batch size of 16 and 1,000 total steps, allocated as 600 Stage-1 + 400 Stage-2 steps for staged training. The 1,000-step joint run is the budget-matched comparison; additional joint runs at 400 and 1,600 steps examine the effect of training duration. LIBERO-Long is the evaluation suite for the reported ablations. RoboTwin uses 8,000 Stage-1 + 6,500 Stage-2 steps, with a budget-matched 14,500-step joint run. Staged versus joint training. Appendix B.2, Table 7 shows that staging gives more consistent performance across the tested LIBERO-Long checkpoints, while joint training reaches comparable performance on RoboTwin at the same total step budget. Action-expert freezing and reconstruction weight. Appendix B.3, Tables 8–9 support freezing as a practical choice in the evaluated settings and show that reconstruction strength should be selected per benchmark: anchoring helps on RoboTwin, while LIBERO-Long works well without it. These are empirical, potentially task-dependent implementation choices; our central argument concerns learning predicted futures through their downstream action consequences, rather than establishing a universally optimal training configuration.
Q2. Action-only comparison and the role of explicit futures
Our research scope is efficient conversion of pretrained cascade WAMs while preserving their future-to-action interface. Establishing whether explicit futures are generally preferable to action-only policies requires a broader architectural study. Fig. 4(a) provides comparisons with Fast-WAM and FasterWAM, with numerical Fast-WAM results in Appendix B.6, Table 11. In an additional LIBERO-Plus Long evaluation, DirectWAM achieves 69.4%, versus 40.2% for Fast-WAM and 67.3% for FasterWAM. We leave this additional benchmark outside the main paper to maintain its focus on cascade conversion. Architectural and training differences limit these results to contextual comparisons; we do not have an action-only student matched in pretrained components, data, and optimization resources that would isolate the control benefit of retaining the future pathway. The retained, decodable visual future also supports monitoring and debugging. Our LIBERO visualizations remain decodable even without reconstruction anchoring, and Appendix C directly tests the effects of changing future representations on downstream actions. Preserving this inspectable and intervenable interface is a practical objective of our cascade conversion.
Q3. Native-teacher attenuation and distinct strategies
Appendix A.1, Table 4 (lower panel) reports the offline attenuation analysis using the teacher's native 50-step action model, holding the future samples and contexts fixed and using common action noise across video samples. On RoboTwin (256 contexts × 32 samples), attenuation remains 70.4× pooled / 25.4× per-context RMS. On LIBERO (64 contexts × 16 samples), it is 5.5× / 2.9×. Thus, attenuation persists under the native iterative readout and is not solely an artifact of the learned single-step action model; its magnitude varies across benchmarks. Distinct-strategy diagnostics. On RoboTwin, Appendix A.4, Table 6 reports calibrated multimodality tests on 237 clean contexts across 47 tasks, with 32 teacher samples per context. The tests detected no contexts in the 8-dimensional PCA analysis and one in the 16-dimensional analysis; the latter's visual clusters did not induce distinct action clusters (Appendix A.2). Appendix A.3 and Fig. 2(b) report 8 teacher rollouts for each of 30 task–initial-state pairs (240 episodes), holding scene, instruction, and action noise fixed while varying video noise. We did not observe separate successful strategy branches: successful trajectories remained concentrated around the same path. These diagnostics characterize the evaluated teacher and task distribution. We have not established the deterministic student's behavior on tasks deliberately constructed to require choosing between distinct valid strategies, and will state this limitation explicitly.