- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
the study proposed I-OctoScene. I-OctoScene is a multi-agent framework for interactive 3D indoor scene synthesis and editing, incorporating progressive feedback through text, clicks, and annotated images. Its contributions include multimodal feedback integration, structured tool coordination through predefined Adaptive Tooling Skills, and a benchmark assessing scene quality and interaction compliance. Validation includes comparisons on common and open-vocabulary room types, component ablations, a 10-participant human evaluation, and runtime/token-cost analysis, with reported improvements in scene quality and user alignment.
Critical strengths
After reading the manuscript, there are several aspects that I think is well addressed:
- Practical interactive authoring: The framework supports progressive instructions through text, clicks, and annotated images, enabling users to refine scenes as their requirements evolve.
- Baseline coverage: Comparisons include established scene-generation methods and the directly relevant SceneWeaver under shared model, asset, and tool settings, providing a useful assessment of scene quality.
- Complementary empirical validation: Component ablations and human evaluation support the framework’s effectiveness, with human preferences providing evidence beyond model-based scoring.
Critical weaknesses
My concerns are as follows:
- The paper does not sufficiently demonstrate that local edits preserve overall scene consistency. Although agents receive global scene information, the experiments do not adequately test whether new edits maintain realistic object sizes, usable space, and earlier user requirements. Handling of infeasible requests, such as adding another bed to an already crowded room, also remains unclear. This limits confidence in the system’s reliability during practical, repeated editing.
- The evaluation is too forgiving to show whether edits are correct. The scoring instructions allow high scores when the system merely attempts an edit or produces something roughly matching the request. The final evaluation also ignores specific details and coordinates. Therefore, the reported scores do not convincingly show that the system correctly performs the user’s requested changes. Do the proposed tools still provide meaningful improvements when used with a more capable foundation model, such as GPT-6 Astra?
- I would love to see discussion related to the failure cases.
- Relevant agentic methods, such as Scenethesis and SAGE, should be discussed, with a clear explanation of how the proposed approach differs from them.
Questions for authors
- Although the planner receives 3D layout metadata, how are support, containment, and under-object relationships geometrically verified? How does the method evaluate the cases where top-down view is insufficient to determine whether the requested relationship is satisfied?
- How would the multi-agent and ATS ablations with a stronger contemporary backbone such as GPT 6? Do the proposed modules still improve performance?
- Please report end-to-end runtime and failure rates over all attempted runs and add failure case disucssion.
- How does the system handle the user request such as inserting a second bed into a bedroom with insufficient usable space? Specify how the system prioritizes user intent, realistic dimensions, collision avoidance, accessibility, and preservation of existing objects, and what it communicates when all requirements cannot be satisfied.