- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes GRASE, an agentic real-to-sim framework that converts monocular indoor videos into editable 3D scenes. The method combines explicit geometric reconstruction with a VLM-based verification and repair loop. It first reconstructs room surfaces and openings from estimated depth and multi-view geometry, then generates and registers object assets, and finally performs object-level and part-wise refinement by repeatedly comparing rendered scenes against the original video observations.
The key idea is to maintain the input video as a persistent reference instead of committing to intermediate reconstruction results. The system uses a collection of existing components, including Depth Anything 3, SAM 3, GPT-6-based VLM reasoning, TRELLIS.2, Blender operations, ICP, and silhouette-based optimization. Experiments on Replica and Imaginarium show substantial improvements over SAM3D and GPT-6-based baselines in geometry and rendering metrics.
Critical strengths
-
The paper addresses a practically important real-to-sim problem and correctly emphasizes that visually plausible reconstruction is insufficient for simulation. Explicit treatment of room topology, object support relationships, and geometric consistency is meaningful for building editable 3D environments.
-
The persistent render-and-verify formulation is intuitive and the reported quantitative improvements are substantial. In particular, explicitly grounding reconstruction in geometric evidence appears to significantly improve both architectural shell reconstruction and object/scene alignment.
Critical weaknesses
-
The main contribution is difficult to separate from a large amount of system engineering. GRASE combines many existing components and classical geometric operations, including DA3, SAM 3, GPT-6, TRELLIS.2, Blender MCP, RANSAC, ICP, silhouette optimization, and hand-designed geometric refinement. While their integration is effective, it is unclear what the central methodological contribution is beyond the orchestration and verification pipeline. The current ablation mainly isolates the geometric critic and does not sufficiently disentangle the contributions of the many other components.
-
The degree of automation, efficiency, and practical cost are insufficiently documented. The paper describes both reconstruction stages as being executed by a tool-using VLM agent, but it is unclear whether any manual correction or scene-specific intervention is required. The paper also does not report end-to-end reconstruction time, number of VLM/tool calls, API cost, or detailed runtime breakdown. These omissions make it difficult to assess scalability, reproducibility, and practical usefulness of such a complex pipeline.
Questions for authors
-
Is the complete pipeline fully automatic after providing the input video? If any human intervention, manual correction, or scene-specific tuning is required, please clarify where it occurs and approximately how much human time is needed per scene.
-
What is the end-to-end reconstruction time per scene? Please also clarify the approximate number of VLM calls, TRELLIS.2 generations, agent revision rounds, and, if applicable, API or computational cost.
-
Given the complexity of the pipeline, can the authors clarify which components are essential to the main contribution? In particular, how much performance is attributable to persistent agentic verification itself versus explicit shell fitting, support-graph reasoning, part-wise refinement, and silhouette optimization?
-
The paper repeatedly motivates the reconstructed scenes as suitable for simulation, but articulation, materials, and physical properties are not recovered. Could the authors clarify the intended meaning of “simulation-ready” and whether the reconstructed scenes have been evaluated in any downstream simulation or embodied task?