- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents InternW0-Δ, a unified World Action Model that brings together pretrained visual dynamics, scene-level semantic understanding, 4D geometric and motion priors, and action generation within a directed Mixture-of-Transformers framework. Its key proposed component, Causal Imprint, uses future latent-difference supervision and future-feature alignment to learn predictive representations from observed context. The model is pretrained on heterogeneous robot and human data and evaluated on four simulation benchmarks and four real-robot platforms.
Critical strengths
-
Strong empirical performance across diverse benchmarks. InternW0-Δ achieves 92.8% on LIBERO-Plus, 71.9% on RoboTwin Clean2Random, and 23.91% average success on RoboDojo, outperforming the reported WAM baselines.
-
Substantial engineering and data contributions. The authors provide a detailed heterogeneous-data processing pipeline and an efficient inference implementation, reducing reported controller round-trip latency from 780.5 ms to 152.8 ms. These are meaningful practical contributions beyond the model architecture.
Critical weaknesses
- The methodological novelty of Causal Imprint is not sufficiently established. Future-supervised representations for action generation, training-time video supervision, and geometric feature distillation have close precedents in Fast-WAM, InternVLA-A1.5, Track4Action, and 4D-WAM. The proposed combination may be useful, but the current ablations do not isolate the distinctive value of predicting latent differences rather than directly supervising future representations. In Table 5, CI alone improves success from 69.08% to 70.80%, while future-feature alignment yields the larger subsequent gain to 76.45%. The evidence therefore supports the complete predictive-supervision pipeline more strongly than the specific claim that change-oriented imprinting is the key innovation.
Questions for authors
- Can the authors provide a matched ablation comparing latent-difference supervision against direct future-latent supervision, while keeping CI tokens, attention, and future-feature alignment unchanged?
2 comments
Thank you for the additional ablations. However, the reported 1.30% advantage over direct future-latent supervision (75.15% vs 76.45%) is modest and varies across task groups. I therefore encourage the authors to temper the corresponding claims and incorporate these comparisons into the revised manuscript. Considering the overall empirical and engineering contributions, I maintain my Weak Acceptance rating.
Rebuttal by Authors
1. Isolating latent-difference supervision and feature alignment
Both latent-difference supervision and feature alignment are applied to the Causal Imprint tokens. We evaluated each objective independently, as well as their combination, under matched training settings.
Latent-difference supervision alone improves the overall success rate from 69.08% to 70.80%, whereas feature alignment alone decreases it to 64.73%. In contrast, combining the two objectives yields an overall success rate of 76.45%, improving over the baseline by 76.45% - 69.08% = 7.37% and over latent-difference supervision alone by 76.45% - 70.80% = 5.65%.
These results suggest that the two objectives play complementary roles. In particular, the gains produced by feature alignment in the full model should not be interpreted as evidence that feature alignment alone accounts for the overall improvement; rather, its effectiveness emerges when it is combined with latent-difference supervision.
2. Matched comparison with direct future-latent supervision
To directly examine the value of change-oriented imprinting, we replaced latent-difference supervision with direct future-latent supervision while keeping the remaining settings unchanged. This comparison isolates the choice of predictive target within the Causal Imprint framework.
Direct future-latent supervision achieves an overall success rate of 75.15%, compared with 76.45% for latent-difference supervision. Thus, replacing latent differences with direct future-latent prediction reduces overall performance by 76.45% - 75.15% = 1.30%.