- Rating
- 4(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
World–action models learn from video prediction and robot-action demonstrations. Predicting future images encourages these models to retain details such as background, texture, and lighting, even when those details are irrelevant to the robot’s actions. The authors propose CausalWAM, which trains the representation used for action prediction to recognize the same physical state across appearance changes. They render identical robot–object configurations with different backgrounds and textures, then use contrastive learning to bring their representations together while separating different physical states. A small attention module extracts the resulting features and supplies them to the action predictor, improving robustness to visual changes.
Critical strengths
-
CausalWAM-Joint substantially improves robustness to visual changes, increasing success from 51.5% to 79.4% on LIBERO-Plus and from 15.6% to 46.7% in real-robot experiments with visual disturbances, while preserving strong performance on standard LIBERO. These gains address an important weakness of world–action models and are the strongest evidence supporting acceptance. However, further controlled comparisons are needed to establish which components drive the improvements.
-
The content reader connects explicit cross-appearance state correspondence to action prediction while retaining the model’s original visual pathway. Its frozen-backbone variant also improves state retrieval and control, suggesting that useful invariances can be extracted from existing predictive representations without retraining the video backbone. This makes the approach a potentially useful adaptation strategy beyond the particular model evaluated.
Critical weaknesses
-
The paper is missing two key comparisons: training the baseline on the same randomized images using the action labels, and testing the Joint model without contrastive learning in the Clean-to-Randomized setting, where the largest improvement occurs. Without these tests, it is hard to tell how much of the gain comes from contrastive learning and how much comes from seeing more varied images, adding the new modules, or fine-tuning the backbone. This makes the main result less convincing.
-
Using controlled appearance changes to learn representations that focus on physical state is already an established idea. The main addition here is bringing this approach into a world–action model through the content reader and adapter. The causal framing explains why the training pairs make sense, but does not introduce causal discovery. This could still be a worthwhile contribution, but the missing comparisons make it hard to judge how much the proposed design adds over existing approaches.
Questions for authors
-
How does CausalWAM compare with FastWAM trained on the same randomized images using their preserved action labels, with a comparable training budget? This would help determine whether contrastive state correspondence adds value beyond appearance augmentation.
-
What is the Joint model’s performance without contrastive learning in the Clean-to-Randomized setting of Table 3, keeping the architecture and training setup unchanged? This would clarify whether the proposed objective drives the largest reported gain.
6 comments
[W2] Contribution beyond existing appearance-invariant learning methods
Thank you for this thoughtful comment! The key contribution of CausalWAM is to make cross-appearance state correspondence an explicit training objective for the action-facing representation in a world–action model. This allows the action expert to distinguish changes in physical state from variations in scene appearance, while retaining the original visual conditioning.
Several experiments highlight the role of this objective. In the Clean-to-Randomized setting, FastWAM achieves only 1.9% Random success, compared with 7.5% for CausalWAM-Interface and 34.7% for CausalWAM-Joint, as reported in Table 3. Table 5 further separates the effects of action and contrastive supervision: adding paired observations as action targets alone improves Random success only from 4.8% to 6.2%, whereas contrastive supervision raises it to 34.7%. Combining both yields 34.9%.
The contribution of contrastive learning is also reflected in other ablations. In Table 4, removing the contrastive objective reduces CausalWAM-Joint's Random success from 93.62% to 92.18%. Table 6 compares two representation objectives under the same architecture and training data:
| Representation loss | Clean (%) | Random (%) |
|---|---|---|
| Paired-feature MSE | 82.26 | 25.48 |
| SupCon (Ours) | 82.82 | 34.74 |
Although both objectives achieve similar Clean performance, SupCon improves Random success by 9.26 percentage points over paired-feature MSE.
These results show that explicitly learning correspondence between different appearances of the same physical state provides an important supervisory signal for action prediction in WAMs. We have further clarified the relationship to prior work on causal representation learning and contrastive domain randomization in Section 2, and formalized our action-preserving intervention and state-correspondence objective in Section 3.
Main Concerns Addressed
Thank you for your detailed responses and additional experiments. The new comparisons substantially strengthen the paper and convincingly demonstrate the benefit of contrastive supervision beyond appearance augmentation. The comparison with paired-feature MSE further supports the proposed objective.
I have two minor remaining comments:
Please include the matched FastWAM result (5.46%) in Table 5 or the appendix.
Please reconcile the real-robot baseline success rate of 15.6% in the main paper with the 13.3% aggregate from the three evaluation rounds.
Overall, my main concerns have been addressed, and the revisions have strengthened my assessment of the paper.
Response to Reviewer mYq6 - Thank you for reviewing our paper!
Thank you for your thoughtful comments! Below, we address the comparison with FastWAM trained on the same paired observations, report the matched Joint ablation without contrastive learning, and explain how CausalWAM uses state-correspondence supervision in a world-action model. The changes are highlighted in blue in the revised manuscript.
[W1] Matched comparisons to isolate the contribution of CausalWAM
We thank the reviewer for highlighting the need for these two comparisons. We conducted both experiments to examine the contribution of contrastive supervision. With the same paired images and inherited action labels, FastWAM achieves 5.46% Random success, while CausalWAM-Joint without contrastive learning achieves 6.24%. Enabling contrastive learning raises Joint's success to 34.90%. In the Clean-to-Randomized setting, Joint also improves from 4.80% to 34.74% when contrastive learning is enabled, a gain of 29.94 percentage points.
We detail the matched FastWAM comparison in Q1 and the Clean-to-Randomized ablation in Q2.
[Q1] FastWAM trained on the same paired observations
We train FastWAM and CausalWAM-Joint using the same paired observations and their inherited action labels. The results are:
FastWAM and CausalWAM-Joint without contrastive learning achieve similar Random success (5.46% and 6.24%, respectively) when trained on the same paired images with action supervision. With contrastive learning, Joint reaches 34.90%, a gain of 28.66 percentage points over its counterpart. This comparison shows that the improvement goes beyond directly adding action-labelled appearance variations.
[Q2] CausalWAM-Joint without contrastive learning in the Clean-to-Randomized setting
We additionally evaluate Joint without contrastive learning under the Clean-only protocol of Table 3, keeping the architecture and training setup unchanged.
Contrastive supervision improves Random success by 29.94 percentage points, from 4.80% to 34.74%. The architecture, initialization, trainable modules, official Clean demonstrations, and training schedule remain unchanged. The paired observations contribute only through the contrastive loss.