- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a learned geometric correction module for diffusion-based 3D indoor layout generation. At selected denoising steps, it takes the denoised layout estimate and builds three structures: a semantic scene graph encoded by a pretrained GraphTripleConvNet, a scalar–vector geometric graph encoded by GVP, and furniture–wall-segment relations. The two representations are fused, and factor-specific branches predict gated corrections for position, size and orientation. The predictor is trained on counterfactual perturbations of valid 3D-FRONT layouts. At sampling time, the corrections are clipped, rescaled and added to the clean estimate before the DDPM posterior update. Experiments on 3D-FRONT bedrooms, dining rooms and living rooms report the best FID and slightly lower collision rates than DiffuScene, MiDiffusion and PhyScene.
Critical strengths
1 Replacing hand-designed physical guidance with a learned, state-dependent correction predictor is a reasonable direction. Splitting the correction into gated position, size and orientation branches is a sensible design, and the ablation (Table 3) shows that the full encoder combined with factor-aware correction works best. 2 The paper is detailed and reproducible. The appendix specifies graph construction, features, the counterfactual dataset and the training stages, and code is released. The guidance-scheduling study (Fig. 4) also gives useful insight into when and how strongly to apply correction.
Critical weaknesses
1 The physical improvements are small, and generation remains far from physically plausible. Around 78–83% of scenes and about half of all objects still collide. Collision rates improve over PhyScene by only 1–3 points, OOB-obj is worse than PhyScene in all three room types, and no seed variance is reported, so it is unclear whether the gains are significant. 2 Key baselines and broader evaluation are missing. The paper does not compare with: simple post-hoc collision and boundary optimization; PhyScene-style guidance applied to the same backbone; 3 All experiments are on a single dataset (3D-FRONT), which is synthetic.
Questions for authors
See weakness.
4 comments
Respond to question 2 : Key baselines and broader evaluation are missing. The paper does not compare with: simple post-hoc collision and boundary optimization; PhyScene-style guidance applied to the same backbone
The same backbone.
DiffuScene serves as the same backbone for these comparisons. As described in Section 3.3, we add the predicted geometric corrections to the denoised layout estimate before the posterior update. Disabling the corrector recovers the original DiffuScene sampling procedure . Accordingly, DiffuScene, PhyScene, and Ours correspond to the DiffuScene backbone alone, the backbone with training-free physical guidance, and the backbone with our learned corrector, respectively. Table 2 reports results for these settings using the same backbone.
Regarding post-hoc optimization.
Post-hoc layout optimization is an early line of work on indoor furniture layout [1]. Prior work has noted that collision and room-boundary constraints may be in tension, and that final-stage corrections may not resolve errors accumulated during generation [2,3]. We also discuss the potential limitations of such approaches in the manuscript:
“When corrections are computed using explicitly formulated rules or objectives, their effectiveness depends on the constraints and interactions captured by these formulations. If relevant interactions are not adequately accounted for, correcting one relation may introduce conflicts elsewhere.”
[1]Interactive furniture layout using interior design guidelines[J]. ACM transactions on graphics , 2011, 30: 1-10.
[2]Physcene: Physically interactable 3d scene synthesis for embodied ai[C]//2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024: 16262-16272.
[3]ScenePilot: Controllable Boundary-Driven Critical Scenario Generation for Autonomous Driving[J]. arXiv preprint arXiv:2605.21168, 2026.
Respond to question 3 : All experiments are on a single dataset , which is synthetic.
We use 3D-FRONT because it is widely used in this field and enables comparisons with prior methods under a common benchmark. On other public datasets, the data or code needed to run prior methods are often unavailable, making consistent comparisons difficult. The table below summarizes the datasets used in recent related work.
| 3D-FRONT | SUNCG | Structured3D | ScanNet | citation count | ||
|---|---|---|---|---|---|---|
| ATISS: Autoregressive Transformations for Indoor Scene Synthesis | Nips 2021 | √ | 384 | |||
| SceneFormer: Indoor Scene Generation with Transformers | 3DV 2021 | √ | 291 | |||
| Scene Synthesis via Uncertainty-Driven Attribute Synchronization | ICCV 2021 | √ | √ | 70 | ||
| DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis | <br>CVPR 2024 | √ | 356 | |||
| PhyScene: Physically Plausible 3D Scene Synthesis for Indoor Scenes | CVPR 2024 | √ | 203 | |||
| DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation | CVPR 2024 | √ | ✓¹ | 40 | ||
| From Programs to Poses: Factored Real-World Scene Generation via Learned Program Libraries | NeurIPS 2025 | ✓² | ✓² | 7 | ||
| Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraints | 3DV 2025 | ✓³ | 98 | |||
| Mixed diffusion for 3d indoor scene synthesis | WACV 2026 | √ | 46 | |||
| SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis | 3DV 2026 | √ | 12 | |||
| Global Graph-Validated Optimization for<br>VLM-based 3D Indoor Scene Generation | ECCV 2026 | √ | ||||
| InSpace: Structure-Aware 3D Indoor Scene<br>Generation from a Single 360° Image | ECCV 2026 | √ |
Dear Reviewer,
Thank you again for your time and thoughtful feedback. As the discussion period is drawing to a close, we would greatly appreciate your feedback on whether our responses have adequately addressed your concerns. If any questions remain, we would be happy to provide further clarification.
If our responses have resolved your main concerns, we would be grateful if you could consider revisiting your score in light of these clarifications. Thank you for your time and consideration.
We thank the reviewer for raising these concerns about physical plausibility, baseline comparisons, and dataset scope. We address each point below.
1 The collision metrics.
Our collision checks use cuboid bounding boxes rather than the furniture meshes themselves ; Therefore, an intersection between bounding boxes does not necessarily indicate a collision between furniture objects. To complement this analysis, **we report the mean penetration depth and normalized embedding ratio for colliding pairs, along with their distributions **(Tables 1–3) , and include an additional analysis of collision severity and boundary violations in Appendix D.
Table 1.Penetration depth
Table 2.Normalized embedding
Table 3.Embedding-ratio distribution
2The CKL metric.
CKL measures the agreement between the category distribution of generated furniture and that of the real data. Our method primarily optimizes geometric relationships and does not directly optimize category-distribution matching. Because geometric corrections are integrated into the joint denoising process, CKL may be affected by their indirect influence on subsequent category predictions, as well as by fluctuations in category frequencies due to the limited sample size.
3The object-level out-of-boundsOOB rate.
Our OOB-obj performance is worse than PhyScene. However, our method reduces the rate of more substantial boundary violations: at violation-area thresholds of 5% and 10%, the rates are 11.55% and 8.39%, respectively, compared with 19.67% and 13.38% for PhyScene. We have added this analysis to Appendix D, “Additional Analysis of Collision Severity and Boundary Violations.”
4The random seeds and variability.
The main text reports only the average results across random seeds. To further assess variability and stability, we provide additional results across random seeds in table below.