- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
WSA1 presents a well-motivated approach that integrates forward and inverse dynamics modeling (i.e., action-to-world and world-to-action prediction) into a unified world-action framework, distinguishing it from many existing approaches that primarily use predicted world states to guide action generation. The experimental results on both simulation benchmarks and real-world robotic tasks demonstrate promising performance and generalization capabilities. The ablation studies further provide convincing evidence of the effectiveness of the proposed design. I also appreciate the authors' efforts to conduct real-world experiments with representative baseline comparisons. Overall, I find this work promising and have only a few relatively minor concerns. I would be willing to increase my score if the authors adequately address the questions raised below.
Critical strengths
-
Well-motivated and intuitive methodological design. The paper proposes jointly learning forward dynamics (action-to-3D-world prediction) and inverse dynamics (3D-world-to-action prediction) within a unified world model. Although similar bidirectional learning ideas have been explored in flow-matching-based dynamics modeling, I still find their application to world-action modeling intuitive and interesting. The authors further leverage a Mixture-of-Transformers (MoT) architecture to establish dependencies between the forward and inverse prediction branches within a shared latent space, potentially improving the robustness of the learning framework.
-
Comprehensive experimental comparisons. Table 2 provides extensive comparisons with representative baselines across simulation benchmarks, where WSA1 achieves competitive and, in several cases, superior performance.
-
Convincing ablation studies and generalization performance. The ablation studies clearly demonstrate the benefits of introducing bidirectional world-action modeling, yielding substantial improvements in average task success rates. I am also convinced by the scene generalization results in Table 6, where WSA1 demonstrates stronger robustness to scene randomization than the compared methods.
-
Promising real-world experimental results. The real-world experiments further demonstrate the effectiveness of WSA1, showing clear improvements over the evaluated baselines. I particularly appreciate the inclusion of real-world robotic experiments and direct baseline comparisons, which strengthen the practical significance of the work.
Critical weaknesses
-
Presentation and clarity. Although the paper is generally well written and logically structured, the connections between the main text and figures could be improved. For instance, I could not find an explicit reference to Figure 1 in the main text. Similarly, the methodological descriptions do not sufficiently guide readers through Figure 2, making the proposed architecture more difficult to follow. I encourage the authors to integrate these figures more explicitly into the narrative.
-
Insufficient theoretical justification for bidirectional modeling. While I can intuitively understand the benefits of jointly learning forward and inverse dynamics, I would appreciate a more rigorous theoretical explanation or discussion of why this design improves causal reasoning and world-action consistency. In particular, it would be helpful to clarify how bidirectional modeling provides advantages beyond learning statistical dependencies between actions and world states.
-
Unclear handling of coupled forward and inverse dynamics. The paper does not sufficiently explain how the proposed architecture handles the temporal dependencies and potential asynchrony between the forward (action-to-world) and inverse (world-to-action) processes. These processes are inherently coupled, as actions influence future world states, which in turn inform subsequent actions. I would appreciate a clearer explanation of how the MoT architecture coordinates these interdependent predictions and maintains their consistency.
-
Additional experimental concerns.
-
LIBERO performance: WSA1 does not outperform LingBot-VA on LIBERO, although the authors attribute the limited improvements to benchmark saturation. I consider this a relatively minor concern, particularly given the promising real-world results, but a more detailed discussion would be helpful.
-
OOD ablations: I am curious how the bidirectional modeling ablations would affect the out-of-distribution generalization results reported in Tables 6 and 7. Such experiments could further substantiate the relationship between bidirectional modeling and generalization.
-
World prediction quality: The current evaluations primarily focus on robotic task success rates. I would also be interested in understanding how bidirectional modeling improves the quality of predicted future world states, particularly in terms of geometric accuracy, dynamics prediction, and physical consistency. Quantitative evaluations of these aspects would provide stronger evidence for the claimed benefits of the world model.
Questions for authors
-
Could the authors clarify how the proposed MoT architecture handles the coupled temporal dependencies between forward and inverse dynamics? Specifically, actions induce changes in world states, while evolving world states simultaneously influence subsequent action predictions. I suspect that the bidirectional attention mechanism plays an important role in coordinating these processes, but a more explicit explanation of how temporal consistency is maintained would be valuable.
-
For the remaining questions, please refer to the concerns raised in the Weaknesses section, particularly regarding the theoretical justification for causal modeling, the influence of bidirectional modeling on OOD generalization, and the quantitative evaluation of future world-state prediction quality.
2 comments
Thank you for your positive feedback and support!
I sincerely thank the authors for their detailed responses and substantial additional experiments, which have effectively addressed most of my concerns regarding experimental validation, particularly the benefits of bidirectional modeling for OOD generalization and world prediction. I appreciate the authors' efforts, and I find the new experimental evidence convincing. My only remaining concern is the physical intuition underlying the proposed bidirectional mechanism. While the authors have clarified how forward and inverse predictions interact through shared attention, I still feel that the explanation is primarily learning-driven, with limited discussion of the underlying forward–inverse dynamical consistency from a physical perspective. I would encourage the authors to explore this aspect more explicitly in future work, as it could further strengthen the physical interpretation of the proposed framework. Given this remaining concern, I have decided to maintain my original rating. Nevertheless, I believe this work makes a valuable and well-supported contribution, and I support its acceptance at ICLR.