- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces WorldAgent, an agentic framework for constructing complex, physically simulated 3D worlds from natural language, it combines structured planning, simulation skills, and step-by-step verification to detect and correct errors during construction. The authors also introduce AgenticSimBench, a benchmark of 13 scenarios. Experiments show improvements over the selected agentic baselines on five of seven metrics, supported by ablation studies and a 26-participant user study.
Critical strengths
The work addresses a practically relevant problem and demonstrates a reasonably complete system for constructing complex, editable, and physically simulated 3D worlds from natural-language descriptions. The visual results are also quite impressive, which adds to the practical appeal of the work.
Critical weaknesses
The method seems more like an engineering integration than a novel methodological contribution. Most components, including structured planning, simulation skills, and verification-based refinement, have been explored in prior work. The paper does not clearly establish what new technical insights or mechanisms it brings beyond existing agentic simulation systems.
The experimental evidence is not sufficiently convincing. The evaluation relies on only 13 self-curated cases, without testing on existing benchmarks or comparing against closely related methods such as SimWorlds and GS-Agent. The unclear agent harness used for the backbone-only comparisons further complicates the interpretation of the reported gains. These limitations make it difficult to establish whether WorldAgent offers a meaningful improvement over existing approaches.
Questions for authors
Given the strong capabilities of GPT-6 Astra in its native Codex agent environment, how does WorldAgent compare with GPT-6 Astra running in Codex directly. Is the Astra-only baseline in Table 3 using the native Codex harness. If not, what harness was used.
What would the authors consider the main technical novelty compared with existing agentic simulation methods such as SimWorlds and GS-Agent. In particular, what benefits come specifically from the proposed verification mechanism rather than the domain-specific skills.
Were the 13 AgenticSimBench cases used during the development or refinement of WorldAgent and its simulation skills? How were these cases selected?
How much additional computational cost does WorldAgent introduce. For example, could the authors provide the average number of verification iterations, execution time, or tool calls compared with the baselines. (and under similiar budget, will the proposed method prevail?
3 comments
Follow-up on our response
Dear Reviewer mvyP,
Thank you again for your time and feedback. We posted our response and would appreciate your thoughts on whether it addresses your main concerns. As the discussion deadline approaches, we would be happy to clarify any remaining questions.
Thank you for your consideration.
Best regards, The authors
Follow-up on the Codex comparison and added construction evidence
Dear Reviewer mvyP,
Following up on our response, we clarified that the GPT-6 Astra baseline runs directly in Codex with tool access. In the same-backbone comparison, WorldAgent reduces normalized maximum penetration depth from 0.2248 to 0.0415 and increases causal beat completion from 0.6031 to 0.6825.
To further explain the framework’s contribution, we added component-removal evidence and an anonymous 16-iteration walkthrough, documenting how skills and verification guide construction and correction.
Could you let us know whether the harness clarification and added evidence address your concerns, or which specific points still require clarification? With discussion closing on November 18, timely feedback would allow us to respond before the discussion ends.
Thank you for your time.
The authors
Response to Reviewer mvyP
Thank you for recognizing the practical importance of the problem, the completeness of the system, and the visual results.
Q1: Comparison with Codex.
The GPT-6 Astra baseline in Table 3 uses the Codex execution environment and can invoke tools to construct and execute scenes. WorldAgent outperforms GPT-6 Astra running directly in Codex. The paired comparison improves geometric consistency, event completion, shot planning, and composition completeness. Specifically, WorldAgent reduces Normalized Maximum Penetration Depth from 0.2248 to 0.0415, increases Causal Beat Completion from 0.6031 to 0.6825, improves Shot Planning Quality from 0.5308 to 0.6042, and increases Scene Composition Completeness from 0.9615 to 1.0000.
Q3: Benchmark Construction
AgenticSimBench tasks were generated by randomly combining Blender’s existing simulation capabilities to produce natural-language descriptions of complex scenes, covering both everyday and cinematic scenarios. These tasks were not used to develop the skills or verification rules. In the revised paper, we will describe the task generation procedure. We will release AgenticSimBench as an open-source benchmark in the future.