- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper tackles decomposable 3D scene generation from a single image. The goal is to keep object identity while recovering environment geometry object layout and local detail. The method builds on pretrained TRELLIS.2. It first jointly generates the environment and object components in a shared scene coordinate frame. Each object is then normalized to a local frame refined with image and fixed scene latent conditioning and placed back into the scene. For component-aligned supervision the authors use a pretrained generator to produce object and environment assets and construct training scenes through procedural composition geometric validity checks and rendering. The paper reports geometry improvements on indoor and outdoor benchmarks. Ablations analyze the roles of environment components synthetic training data and scene-conditioned refinement.
Critical strengths
1.The method addresses a real and important tension between global layout and local detail. It jointly generates the environment and separate objects in a shared scene frame and then refines each object with scene-conditioned local refinement so scene-level organization and object-level resolution are handled separately but stay linked. This is a clearly motivated and practically useful design compared with generating objects alone and relying on external assembly and the data pipeline keeps scene-object coordinate correspondences for matched supervision.
2.The ablations give useful evidence. They test the environment component and the refinement context separately. The results support the core motivation that local refinement should keep scene context.
Critical weaknesses
1.The distinction from closely related compositional generation methods needs to be developed more clearly. PartCrafter already jointly generates multiple separate components from a single image without pre-segmentation and in a shared global frame. So joint component generation independent identity and shared coordinates are not the main novelty of DistScene. DistScene cites PartCrafter but treats it mainly as object-level part generation and does not explain the relation to the multi-object scene setting or give a direct comparison.
2.It is unclear whether inference starts from a coarse latent or random noise and whether the coarse geometry is an initial state a condition or only sparse coordinate support. It is also unclear how the Eq. (8) correspondence is built when training targets and inputs have different sparse coordinates.
Questions for authors
Q1. Please clarify the relationship between Eq. (8), Figure 7, and Appendix A.1. How are z_0,z_1, and the intermediate state z_t constructed during refinement training? What is the initial state at inference?
Q2. Please provide a focused technical comparison between Scene-Frame Generation and PartCrafter's scene-generation formulation, distinguishing their shared design elements from the additional environment and refinement mechanisms.
Response for zG7w
We thank Reviewer zG7w for the constructive feedback and for recognizing our design for balancing global layout and local detail, as well as the supporting ablations. We address the overlapping concerns together below.
W1 / Q2. Technical distinction from PartCrafter and direct comparison
We agree that joint component generation, separate component identities, and shared scene coordinates are shared design elements. The main differences between Scene-Frame Generation and PartCrafter’s scene-generation formulation are:
Explicit environment generation. PartCrafter jointly generates separate object meshes in a shared scene coordinate frame. Our Scene-Frame Generation instead jointly generates an explicit environment component and multiple object components, allowing objects to exchange information with the surrounding environment during generation.
Object-count specification. PartCrafter conditions generation on a predetermined number of components and initializes the corresponding number of noisy latent sets. In contrast, DistScene uses a fixed maximum number of sparse-voxel component slots and determines the final object count by retaining non-empty slots, without requiring a per-image object count as input.
Beyond Scene-Frame Generation, DistScene introduces scene-conditioned Object-Centric Refinement for local geometric detail and Object-to-Scene Distillation for component-aligned training supervision.
We have revised Related Work to acknowledge PartCrafter’s support for both decomposable objects and multi-object scenes. We also add direct qualitative comparisons in Figures 6 and 7 (Sec. 5.2), and demonstrate refinement of PartCrafter’s outputs in Figure 12 (Appendix A.8).
W2 / Q1. Refinement training, inference initialization, and sparse-coordinate correspondence
Thank you for pointing out this ambiguity. We have corrected the Method section in Secs. 4.3 and 4.4, replacing the description of a degraded coarse latent as the flow’s initial state.
During training, z1 is the canonical object target retained during Object-to-Scene Distillation, and z0 is Gaussian noise defined on the same local sparse support. The intermediate state is constructed as
zt=(1−t)z0+tz1.
Because z0 and z1 share sparse coordinates, interpolation and the velocity target z1−z0 are computed token-wise within the object-local representation. No point-wise correspondence between scene-frame and object-local tokens is required.
At inference, the predicted coarse object mesh is normalized and voxelized to define the local sparse support. Latent features on this support are initialized with Gaussian noise and generated conditioned on the input image and fixed scene-frame latents. Thus, the coarse geometry provides the support and condition, rather than the initial latent features.
Thank you again for your comments. We are happy to continue the discussion if anything remains unclear.