- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents a system for building executable 3D worlds for embodied agents. The authors propose VibeArena. It uses a shared world program to represent scene layouts, object geometry and articulation, physical properties, and tasks. Multiple agents work together to generate executable 3D environments. VibeArena uses hierarchical intermediate representations to pass task requirements and spatial constraints to a code-based object generation module. It then uses robot execution feedback from a simulator to identify problems. The system performs targeted repairs to object structures, scene layouts, or physical parameters. Across multiple worlds, validated builds are distilled into reusable templates. Accepted repairs are distilled into conditional rules that specify when a repair may apply. Construction histories are also used to improve inspection and repair scheduling. This creates a self-evolving construction loop. The authors evaluate VibeArena on scene generation quality, object quality, physical stability, and downstream embodied task success.
Critical strengths
The paper addresses a valuable problem. A world may fail because of the interaction between an object’s mechanisms and the surrounding scene layout rather than because of the object itself. To address this issue, the paper introduces a task grounded and traceable representation of the world and develops a system for targeted diagnosis and repair. It also stores validated construction results as templates and establishes systematic procedures for validation, selection, refinement, and retirement. These procedures allow the system to extract general rules that can transfer across different scenes. This is an insightful idea. Overall, the experimental design is reasonable and provides some support for the paper’s main claims.
Critical weaknesses
The paper should further narrow and clarify its contribution at the system level. The first contribution presents code based scene construction, Articraft based articulated asset generation, simulation, and targeted repair as major contributions, but each of these capabilities has already been explored in prior work. The hierarchical intermediate representations and the mechanism for self evolution from construction experience described in the latter two contributions are closer to the paper’s central ideas. The authors should reorganize the contribution section around a clear system design principle, or explain more explicitly which capabilities VibeArena provides that existing systems cannot easily offer. This issue mainly affects the paper’s clarity and persuasiveness and does not diminish the practical value of the system itself.
A question that deserves further clarification is whether VibeArena’s system design can produce construction experience that transfers across systems. The paper summarizes successful builds and repairs as templates, conditional rules, and harness policies. However, it remains unclear whether this experience depends on ArenaProgram, realization mappings, and the particular validation pipeline, making it knowledge specific to VibeArena, or whether it can serve as an independent mechanism in other multi agent scene generation systems.
If this experience can be transferred to other systems and provide similar benefits, the paper should emphasize its generality. If it depends on VibeArena’s particular system design, the authors should explain what additional capabilities arise from this coordinated design at the system level.
Questions for authors
Please try to address my questions and concerns in the critical weakness section.
Response to Reviewer e1jP
Thank you for recognizing the value of VibeArena!
Below, we address the weaknesses you identified.
We agree that the hierarchical intermediate representations and self-evolution from construction experience are the two main technical contributions. The original first point was meant to introduce the framework as a whole.
We have rewritten it around the design principle that connects its components and the capability this gives VibeArena:
The revised contribution is highlighted in light green in §1 of the updated PDF.
Thank you for the suggestion.
We agree that cross-system transfer deserves a separate test. VibeArena learns from building and testing each world and applies those lessons to later scenes. Our original experiments show this works within VibeArena. Here we test whether the same idea works in a general-purpose agent framework.
We ran GPT-6 Astra and DeepSeek-V4.1-Flash in Codex. The paper’s general-agent baselines use our direct tool-use setup. Here, Codex manages the agent loop and tool calls, so we measured the starting scores separately under Codex.
We applied VibeArena’s self-evolution design over eight rounds using 135 cases from the SceneSmith and Function-Room benchmarks. For each model, we evaluated the starting agent and the agents after rounds 4 and 8 on the same SceneEval-30 benchmark.
SceneEval-30 scores (%) at three checkpoints
Both models improved on SceneEval-30 under Codex, showing that the self-evolution design transfers across harnesses. Collision rates fell by 3.6 and 3.1 percentage points, possibly because local placement edits can resolve overlaps. VibeArena started at 2.8%, leaving less room to reduce collisions (Tab. 2), and gained more on OOR, OAR, and ACC (Tab. 13). Our ablations show the value of carrying spatial constraints from scene planning into object generation (Tab. 5).
So a generator can improve through its own work by turning the results of construction and testing into guidance for future builds.
We added a sentence at the end of the Introduction summarizing VibeArena’s self-evolution results and their relevance to other systems that build executable 3D worlds. We report the Codex experiment in §4.6 of the updated PDF.
The Codex experiment supports our self-evolution as a potentially valuable design principle for world-building agents.
Thank you for prompting us to test the design beyond VibeArena.