- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates the "Commitment-Evidence Gap" in asynchronous world-action models for robotic manipulation, where low-latency action generation outpaces the slower prediction of future world states. To address this mismatch, the authors propose ReSync, an inference-time scheduling rule that briefly holds the action denoising process to allow world state denoising to advance, ensuring actions are conditioned on more mature future world predictions. The method is evaluated on RoboCasa, RoboTwin, Cosmos Policy, and a physical Mobile ALOHA setup.
Critical strengths
-
Novel Problem Identification: The paper identifies a key timing mismatch between action and world clocks in multi-step generative models. This offers a valuable perspective on how inference timing affects decision quality.
-
Plug-and-Play Applicability: ReSync is a pure inference-time scheduling adjustment requiring no model retraining. It demonstrates strong transferability across various datasets like RoboCasa and RoboTwin and architectures like Cosmos Policy.
Critical weaknesses
-
High Inference Latency: The proposed holding mechanism seems to introduce a relatively high latency overhead. Considering the performance improvement is modest, this increased delay might limit its practical application in real-world robotic control.
-
Presentation and Evaluation: The writing could be more accessible by avoiding the over-packaging of simple concepts with new terminology. Furthermore, including comparisons with other existing inference-time optimization methods would likely make the evaluation more persuasive.
Questions for authors
Clarification Requests:
- How did the physical robot handle the increased inference latency during the Mobile ALOHA experiments, and did this delay affect its ability to respond to dynamic changes?
- Would it be possible to include comparisons with other external inference-time optimization strategies to further strengthen the overall evaluation?
Suggestion for Future Work: 3. Have the authors considered integrating inference-time acceleration techniques to help offset the latency overhead introduced by the proposed method? This could be a valuable direction for future improvements.