- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
SceneBloom generates indoor scenes by dividing a room into functional zones, sampling an image of each zone using diffusion models conditioned on specific assets, and converting those proposals into 3D layouts. Its main contribution is a geometric compiler that resolves overlaps while preserving image-derived relations such as facing, alignment, and proximity. Validation includes comparisons across five room types, controlled component ablations, collision and dynamic-stability tests, navigation-connectivity measurements, and downstream object-navigation experiments.
Critical strengths
The strengths of the study are in two aspects. First, the paper demonstrates the usefulness of its generated scenes through object-navigation training and evaluation on held-out generated and real-scanned environments. The controlled experiments with added occluders further show how scene generation can supply task-relevant training variation. Although the gains are modest, this provides practical evidence of value beyond visual quality and scene-generation metrics. Second, the study separating visual layout proposals from geometric correction allows the system to repair placements while preserving intended spatial relationships. With inventories and assets fixed, contract guidance reduces relation violations from 37.45% to 4.25% and improves visual coherence. Together with zero detected collisions in the main evaluation and approximately 2.7 minutes per layout, these results support the approach’s effectiveness and efficiency.
Critical weaknesses
My major concens are as following aspects:
- The framework’s benefit beyond foundation-model capability remains incompletely established. The controlled ablations demonstrate improvements from visual proposals and relation contracts, but only under the tested model configuration. They do not establish whether these benefits persist with stronger foundation models, or whether comparable performance could be achieved through better prompting and in-context examples with equivalent information and tool access. This leaves uncertainty about the proposed components’ contribution as the underlying models improve.
- The reliability of the generated relations and physical arrangements is insufficiently validated. Contract satisfaction is measured against the VLM’s own extracted relations, without independently verifying whether those relations are correct or complete. Furthermore, despite zero detected collisions, only 75.3% of movable objects pass the stability test. Containment and under-object arrangements are not explicitly addressed, while navigation connectivity does not establish functional clearances for opening cabinets or using furniture. These gaps limit confidence in the broader claim of producing physically valid, simulation-ready environments.
- Limited scene categories are tested. I would love to see the performance on more scene cases beyoud of living room.
Questions for authors
I have the following questions:
- Table 11 provides useful evidence for visual proposals and contract guidance under the tested configuration. Does their advantage persist when the textual planner is replaced with a stronger foundation model? A controlled comparison would help establish whether the proposed design provides benefits beyond improved prompting or in-context learning. Can you distinguish the contribution of the pretrained visual prior from that of the contract-guided compiler. 2.The reduction in contract violations from 37.45% to 4.25% demonstrates agreement with the extracted contracts, but does not establish whether those contracts correctly describe the intended arrangement. Have the authors independently evaluated incorrect or omitted relations, especially for occluded objects and ambiguous facing directions? How was the confidence threshold of 0.75 selected, and does confidence correspond to actual extraction accuracy?
- Table 4 contains five relations but no explicit “inside” or “under” relation. Can the current compiler represent valid arrangements with overlapping ground-plane footprints, such as a chair tucked under a table or an object inside a cabinet? Please distinguish unsupported arrangements from those handled through separate placement rules. Similarly, beyond navigation-mesh connectivity, does the method enforce clearances needed to open cabinets, pull out chairs, or approach furniture for use?
- Why use GPT-4O as the evaluator instead of using more advanced agent such as GPT-6?
- How does commonly failure case look like? can you also report the runtime vs. number of objects / funtional zones in the scene?
10 comments
Response to Reviewer kRN8 (Part 2/5)
W2a & Q1b Relation contract accuracy
W2a: The reliability of the generated relations and physical arrangements is insufficiently validated. Contract satisfaction is measured against the VLM’s own extracted relations, without independently verifying whether those relations are correct or complete. ...
Q1b: The reduction in contract violations from 37.45% to 4.25% demonstrates agreement with the extracted contracts, but does not establish whether those contracts correctly describe the intended arrangement. Have the authors independently evaluated incorrect or omitted relations, especially for occluded objects and ambiguous facing directions? How was the confidence threshold of 0.75 selected, and does confidence correspond to actual extraction accuracy?
Response
We verify the extracted contracts in two approaches. Manual inspection shows that the relations extracted by Qwen3-VL-8B-Instruct, the model used by our method, correctly describe the proposals with few omissions. A second model, GPT-6 Sol, independently extracts relations from the same proposals and confirms that the compiled layouts satisfy the proposed arrangement. We have added the manual verification and the GPT-6 Sol evaluation to Appendix C.2 (Table 8).
1. Manual verification confirms accurate extraction with few omitted relations.
- Qwen3-VL-8B and GPT-6 Sol extract relations with high precision. We sampled 100 distinct relations covering different relation types, including relations extracted by either model alone and by both models. We manually checked them against the proposal images without seeing which model extracted them.
Table R1: Manual verification of sampled relations. The two rows share 35 relations, giving 100 distinct relations in total. Precision is weighted to account for the sampling proportions.
| Extracting model | Relations checked | Precision on judgeable relations ↑ |
|---|---|---|
| Qwen3-VL-8B, used by our method | 67 | 95.8% |
| GPT-6 Sol | 68 | 99.0% |
- Qwen3-VL-8B also extracts accurate relations under challenging visual conditions. We checked 30 cases selected for occlusion or oblique viewing directions. The two incorrect relations concern side-view chairs facing desks.
Table R2: Precision under occlusion and oblique viewing directions.
| Targeted condition | Cases | Relations | Precision on judgeable relations ↑ |
|---|---|---|---|
| Occlusion | 15 | 21 | 100% |
| Oblique viewing direction | 15 | 21 | 90.0% |
| Total | 30 | 42 | 94.9% |
- Few clearly visible relations are omitted. In 20 randomly sampled zones, we identified 46 correct Qwen3-VL-8B relations and five omissions, giving 90.2% recall. All five omissions are beside relations. Three already have a move_near constraint on the same object pair, preserving proximity information that guides their placement.
2. An independent relation set from GPT-6 Sol confirms that compilation realizes the proposed arrangement.
For each proposal, GPT-6 Sol extracts its own relation set from the same image. Compilation uses only the Qwen3-VL-8B contract, and the GPT-6 Sol relations serve only to evaluate the final layouts.
With the contract, violations of the Qwen3-VL-8B relations fall from 37.45% to 4.25%, and violations of the independent GPT-6 Sol relations also fall from 25.89% to 4.09%. The manual verification and this independent evaluation therefore show that the contracts capture valid spatial relationships and help realize them in the compiled layouts.
Table R3: Relation violations in the compiled layouts.
| Compilation setting | Violations of Qwen3-VL-8B relations ↓ | Violations of GPT-6 Sol relations ↓ |
|---|---|---|
| Without a relation contract | 37.45% | 25.89% |
| With the Qwen3-VL-8B contract | 4.25% | 4.09% |
3. The measured violation rates are insensitive to the confidence threshold within the tested range.
A sensitivity analysis over γ ∈ [0.60, 0.85] gives unchanged violation rates, so the results do not depend on the choice of 0.75. The manual checks above directly confirm that the extracted relations are correct.
Response to Reviewer kRN8 (Part 3/5)
W2b Object stability and motion
W2b: ...despite zero detected collisions, only 75.3% of movable objects pass the stability test. ...
Response
Thank you for pointing this out. Because the overall 75.3% score mixes large and small objects, we report stability by object size, which shows where the remaining instability occurs. SceneBloom’s large objects remain nearly stationary, and its small objects also achieve higher stability and less motion than all baselines. We have added the results to Appendix C.1 (Table 6).
1. Large objects achieve 96.8% stability with minimal movement.
This exceeds the 69.2–74.4% stability of the baselines. Large objects move just 1.1 mm at the median, and only 0.3% move more than 0.2 m, compared with 15.9–20.3% for the baselines.
Table R1: Stability and motion of large objects.
| Method | Stability ↑ | Mean displacement (m) ↓ | Median displacement (m) ↓ | Moved >0.2 m ↓ |
|---|---|---|---|---|
| Holodeck | 69.2% | 0.1583 | 0.0106 | 18.0% |
| SceneWeaver | 73.5% | 0.2012 | 0.0070 | 20.3% |
| SAGE | 74.4% | 0.8500 | 0.0116 | 15.9% |
| SceneBloom | 96.8% | 0.0114 | 0.0011 | 0.3% |
2. Small objects also show substantially higher stability and less motion.
SceneBloom achieves the highest small-object stability and the lowest motion on every reported metric. The remaining failures are concentrated among small objects placed on furniture. Our diagnostic analysis associates instability with thin or slender shapes, suggesting that susceptibility to tipping contributes to these failures even when initial placements are collision-free.
Table R2: Stability and motion of small objects.
| Method | Stability ↑ | Mean displacement (m) ↓ | Median displacement (m) ↓ | Moved >0.2 m ↓ |
|---|---|---|---|---|
| Holodeck | 18.0% | 1.1094 | 0.6734 | 72.6% |
| SceneWeaver | 33.0% | 0.4437 | 0.1046 | 43.0% |
| SAGE | 38.2% | 1.0050 | 0.1101 | 42.1% |
| SceneBloom | 66.6% | 0.1351 | 0.0155 | 13.4% |
W2c & Q2a Support for under-object and containment arrangements
W2c: ...Containment and under-object arrangements are not explicitly addressed, ...
Q2a: ...Please distinguish unsupported arrangements from those handled through separate placement rules. ...
Response
Thank you for pointing out these two common arrangements. We extended the compiler with under relations and placement inside articulated storage objects. We have added both extensions to Appendix A.5 (Figure 7 illustrates both arrangements).
1. Under relations specify which objects should be placed beneath others. We add the under relation to the relation contract alongside the five relations in Table 4. The VLM extracts object pairs from the visual proposal, and the compiler adjusts their placement while checking mesh collisions. For example, a chair can be moved beneath its associated table. GPT-6 Sol independently evaluated whether the executed chair–table placements satisfied the intended relation, confirming 90.9%.
2. Inside placement extends the existing small-object pipeline. The VLM selects contents for articulated storage objects, while the compiler identifies internal compartments and supporting surfaces. Objects are placed within these compartments with the doors closed. Per-link convex decomposition preserves the interior free space during physics simulation.
3. Both extensions preserve physical quality. With the same proposals and original relation contracts, existing furniture stability remained unchanged in both comparisons. Neither extension introduced detected mesh collisions, out-of-bounds objects, or additional violations of the original relation contracts.
These extensions demonstrate how the compiler can incorporate additional spatial arrangements through relation extraction and placement procedures.
Response to Reviewer kRN8 (Part 1/5)
We thank the reviewer for the careful reading and detailed feedback. We have revised the paper accordingly and addressed each of the raised weaknesses and questions in detail below. All revisions are marked in blue in the revised manuscript.
W1 & Q1a Component contributions with stronger foundation models
Response
Thank you for suggesting this comparison. We extended the Table 14 ablation, which uses Qwen3-VL-8B-Instruct, to GPT-6 Sol, comparing textual and visual proposals with and without contract guidance. Although GPT-6 Sol textual proposals combined with our contract guidance achieve higher functionality and coherence scores (Table R2), both proposed components retain their advantages with the stronger model. Visual proposals retain their geometric-diversity advantage, and contract guidance gives the closest alignment with real-room layouts by preserving their spatial organization during compilation (Table R1). We have added this comparison to Appendix D.2 (Figure 11).
1. Visual proposals provide geometric diversity through the pretrained diffusion prior. The visual stage draws on this prior to generate varied spatial arrangements. Visual proposals achieve higher geometric diversity than textual proposals under both Qwen3-VL-8B and GPT-6 Sol, with and without contract guidance. The relative gains range from 5% to 13%, with all four paired 95% confidence intervals above zero. Across the evaluated configurations, GPT-6 Sol produces lower geometric diversity than Qwen3-VL-8B, illustrating that stronger textual planning does not automatically yield more diverse layouts.
2. Contract guidance preserves and recovers the proposal’s spatial relations during compilation. These constraints help retain the proposed arrangement as the compiler resolves geometric conflicts. Within the visual branch, enabling contract guidance reduces MP3D LDD by 0.024 under Qwen3-VL-8B and 0.021 under GPT-6 Sol, with both paired confidence intervals below zero, while geometric diversity remains nearly unchanged. This supports its role in preserving spatial organization that better aligns with real-room layouts.
Table R1: Geometric diversity and layout-distribution alignment across foundation-model configurations. Geometric diversity measures pairwise layout variation within each generation condition, averaged over five room types. MP3D LDD measures distance to real-room layout distributions. Bold indicates the best value within each backbone.
Table R2: Judged scene quality across foundation-model configurations. All configurations within each backbone use the same GPT-4o evaluation rubric. Bold indicates the best value within each backbone.