- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CausalWAM addresses action neglect in joint video-action models. It combines clean-action-conditioned video prediction with joint video-action generation, gradually shifting the training emphasis toward the latter. Failed and suboptimal trajectories are used for dynamics learning without treating their actions as imitation targets. The method is evaluated on RoboTwin and real-world instruction-following, long-horizon, and out-of-distribution tasks.
Critical strengths
-
The use of suboptimal trajectories is well motivated. An unsuccessful action can still provide valid transition supervision, even when it is unsuitable as an imitation target. Assigning these trajectories to dynamics learning is a practical way to use otherwise discarded data.
-
The combined objectives improve downstream control. Joint training reaches 75% success, compared with 71% for WAM-only and 59% for AC-WM-only. The real-world evaluations also go beyond short, in-distribution tasks and provide evidence of practical benefit.
Critical weaknesses
-
The paper does not directly show that CausalWAM fixes causal neglect. Figure 1 illustrates weak action sensitivity, but there is no systematic comparison against the actual outcomes of different actions from the same state. Better policy performance alone does not verify the proposed mechanism.
-
The novelty lies mainly in the training recipe, since the MoT architecture and attention mask follow prior work. However, the key schedule ablation is confounded: the fixed AC-WM ratio is 0.25, whereas the cosine schedule averages approximately 0.5. The gain may therefore come from more AC-WM training rather than the progressive schedule.
-
The real-world success metric is unclear. The text-following score of 0.89 measures partial completion across four stages, rather than full-task success. Table 3 averages this score with binary success rates, making the aggregate result difficult to interpret. Tables 1 and 4 also disagree on randomized Scan Object for CausalWAM and randomized Turn Switch for FastWAM.
-
The contribution beyond existing unified training frameworks remains unclear. UWM[1] and Motus[2] already combine conditional dynamics modeling and action generation. The main additions here appear to be the curriculum and quality-aware data routing. The former is confounded by the mixing ratio, while the latter improves success from 73% to 75% without clearly establishing matched data exposure.
References
[1]. Bi, H., Tan, H., Xie, S., Wang, Z., Huang, S., Liu, H., Zhao, R., Feng, Y., Xiang, C., Rong, Y., Zhao, H., Liu, H., Su, Z., Ma, L., Su, H., & Zhu, J. (2026). Motus: A unified latent action world model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 35101–35113).
[2]. Zhu, C., Yu, R., Feng, S., Burchfiel, B., Shah, P., & Gupta, A. (2025). Unified world models: Coupling video and action diffusion for pretraining on large robotic datasets. In Robotics: Science and Systems XXI.
Questions for authors
- Does the progressive schedule outperform a fixed AC-WM ratio of 0.5 under matched total updates and data exposure?
- Can you quantify whether action changes produce the correct changes in predicted outcomes, rather than merely increasing action sensitivity?
- Does the suboptimal-data ablation hold total data exposure constant? What proportion of training data is suboptimal, and do the baselines have access to the same data?
- Were the latency baselines evaluated with the same caching, compilation, precision, and deployment optimizations?
5 comments
Response to Reviewer mvvB (2/2)
W4&Q1&Q3: Progressive Schedule and Quality-Aware Data Routing. As described in our response to W2&Q1, the exposure-matched fixed- control supports the benefit of the progressive schedule beyond average objective exposure. To clarify the data exposure in the quality-aware data-routing ablation, we included approximately 26.9 robot-hours of suboptimal data (about 1% of the pretraining data by duration) and kept the total number of training steps identical. As described in Appendix A.3, these trajectories arise from failed or unrecoverable executions during data collection. Because the suboptimal data are used during pretraining, and the other baselines lack a mechanism for learning from failed trajectories without treating their actions as imitation targets, we did not expose these data to the baselines.
Q4: Runtime Optimization and Deployment Efficiency. The baselines were evaluated using their released inference implementations rather than being retrofitted with an identical optimization stack. For example, FastWAM already incorporates video KV caching, whereas graph compilation and C++ deployment are additional optimizations applied to CausalWAM. We use these latency comparisons to show that CausalWAM achieves competitive latency among WAMs. With additional engineering optimizations, its latency becomes comparable to that of the evaluated VLA baseline, highlighting the potential of WAMs for responsive real-world deployment.
Response to Reviewer mvvB
Thank you again for your time and thoughtful review. As the discussion period draws to a close, we would appreciate hearing whether our responses and revisions have addressed your main concerns. If any questions remain, we would be happy to provide further clarification before the discussion closes.
Thank you for considering our responses.
Best regards,
The Authors
Response to Reviewer mvvB (1/2)
W1&Q2: Quantitative Validation of Causal Neglect. We conducted a controlled counterfactual experiment to directly evaluate whether predicted changes agree with the observed consequences of different actions from the same state. For each of Open Microwave and Turn Switch in RoboTwin, we evaluated 50 matched no-op/expert trajectory pairs, with each pair starting from the same initial state. CausalWAM, WAM-only, and FastWAM were evaluated at the shared horizons t={12,24} using four diffusion sampling seeds per state, with identical initial noise for the paired no-op and expert predictions within each model.
To isolate action-induced changes from the static background, we subtract the predicted no-op video from the predicted expert-action video and perform the same subtraction on the corresponding observed videos. We compare the predicted and observed differences using Normalized Effect Error (NEE) and Effect Cosine Similarity (ECS). As shown in the table bew, CausalWAM achieves lower mean NEE and higher mean ECS than WAM-only and FastWAM on both tasks. This directly shows that its predicted action-induced changes agree more closely with the observed outcomes, rather than merely producing different videos when the action changes.
These results provide quantitative evidence that CausalWAM mitigates causal neglect on the evaluated tasks. In the revised manuscript, we provide systematic visualizations of the observed outcomes and the predictions from CausalWAM, WAM-only, and FastWAM, together with the complete experimental protocol and quantitative analysis in Section 4.4.
W2&Q1: Exposure-Matched Schedule Control. To separate the effect of the progressive schedule from total AC-WM exposure, we added a fixed-ρAC=0.5 control under the same training setup as the cosine 1-to-0 schedule. The two settings use the same total number of updates and have matched expected AC-WM/WAM exposure. The fixed-0.5 control achieves a 60% average binary success rate, compared with 72% for the cosine schedule, indicating that the improvement cannot be explained solely by greater AC-WM exposure and supporting the benefit of progressively shifting the training emphasis from AC-WM to WAM.
W3: Real-World Metric Clarification. We agree that labeling the original aggregate as “SR” was imprecise. In the revised table, we additionally report the strict full-task success rate for Text-following, while retaining the stage-completion score in parentheses as a secondary metric. We also recompute all aggregate results using the macro-average binary success rate across the three real-world task categories: Text-following, Long-horizon, and OOD.
W3: Table Consistency. The values in Table 4 are correct: the randomized success rates are 96% for CausalWAM on Scan Object and 59% for FastWAM on Turn Switch. The corresponding entries in Table 1 are transcription errors. We thank the reviewer for identifying these inconsistencies. The 50-task averages were computed using the correct per-task values in Table 4; therefore, correcting the two entries in Table 1 does not change the reported averages or numerical rankings. We will correct both entries in Table 1 and rigorously cross-check all reported values in the revised manuscript.
W4: Distinction from Existing Unified Training Frameworks. We agree that UWM and Motus already unify visual dynamics modeling and action generation, and we do not claim the MoT backbone, attention-mask structure, or unified video-action formulation as our novelty. Our contribution specifically targets causal neglect in action-centered WAM training. We introduce a training recipe that combines clean-action-conditioned future prediction with standard joint WAM training and progressively shifts the training emphasis from the former to the latter. This design is intended to first establish action-dependent visual dynamics and then integrate this dependence into the action-generation pathway.