- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a framework that equips a code-based robotic agent with a learned world model and Structured Object Programs (SOPs). These components enable the agent to predict the outcomes of candidate actions and revise control programs before execution. The framework also supports visuomotor policy post-training. Experiments on simulated manipulation tasks and two real-world tasks report higher task success rates, improved cross-object generalization, and fewer environment attempts.
Critical strengths
-
The pipeline is interesting. This paper uses a world model to predict the possible outcomes of actions proposed by the coding agent. These predictions help the agent evaluate and revise its programs before execution.
-
Ablation studies are useful. The comparisons with RGB-only and duplicated-RGB inputs show that SOP-rendered geometry improves the accuracy of future object-state predictions.
Critical weaknesses
The advantages of the learned world model over a physics simulator remain unclear for the evaluated tasks, which primarily involve rigid-body and articulated-object manipulation. The predicted information, such as part poses and configurations, could also be obtained from a physics simulator. Although Table 2 includes an oracle simulator reference, it does not provide a comparison against a practical simulator baseline initialized from the same perceptual inputs and SOP representation. A controlled comparison between simulator-based and world-model-based planning would help clarify the benefits of the proposed approach. This comparison should report task success rates and computational costs under matched LLM token budgets and candidate-action evaluation budgets.
Questions for authors
Please refer to the Critical Weaknesses section.
In line 033, please use the correct LaTeX quotation marks: ``Code as Policies''.
2 comments
Dear Reviewer, thank you again for suggesting the perception-initialized simulator comparison. With approximately one day remaining in the rebuttal period, we would like to gently follow up on the added comparison under matched budgets (Table 2; Appendix B.6, Table 10) and our clarification of the scope of the results. If your schedule permits, we would greatly appreciate your thoughts on whether these additions address your concern. Thank you for your time and consideration.
We thank the reviewer for identifying the need for a perception-initialized simulator comparison. We have added an Estimated-SOP Simulator baseline to main-text Table 2, with a dedicated controlled comparison in Appendix B.6, Table 10.
To make the revisions easy to locate, the following index summarizes the added experiments, the points they support, and their manuscript locations. The requested simulator comparison is accompanied by controls examining the SOP interface, predictive evaluation, and downstream manipulation.
[W1, Q1] Practical physics simulation from the same perceptual inputs.
The practical simulator is instantiated from the same estimated SOP geometry and kinematics, with predefined collision models and physical settings fixed before testing. It executes candidate action chunks and applies the same SOP progress function to simulator-produced states. The Oracle Simulator remains a separate privileged reference initialized from restored ground-truth simulator states.
Learned and practical evaluators share the code agent, candidate-generation procedure, action interface, and online limits: 1M LLM tokens per episode, 12 candidate evaluations per decision, and 10 minutes per episode.
The added comparison reports:
The learned evaluator is 2.2 percentage points below the practical simulator in overall success, and 3.7 points below the oracle. The practical simulator retains higher success and shorter successful-episode completion time. These results support the scoped claim that learned predictive evaluation approaches simulator-guided planning on the evaluated tasks; they do not establish superiority over physics simulation.
[W1] Additional evidence on evaluation quality.
Appendix B.4, Table 8 also compares these evaluators on shared fixed candidate banks. Top-1 agreement is 81.5% for the dual-stream WM and 93.4% for the practical simulator, with false-positive selection of 48.6% and 25.2%, respectively. This quantifies the remaining evaluator-quality gap, complementing the online success and cost comparison.
[Minor correction] Quotation marks.
The requested LaTeX quotation marks for “Code as Policies” have been corrected in the Introduction.