- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents VoxScene, which moves 3D scene arrangement toward an explicit voxel representation so that fine-grained spatial relations can be modeled directly. Generation happens in two stages. First, box-level anchors are generated to set the coarse layout. Then an object-centric diffusion network sequentially synthesizes instance-labeled volumetric occupancies conditioned on those anchors.
Critical strengths
(1) The paper introduces an explicit, instance-labeled voxel representation for 3D scene arrangement. This is an interesting departure from the box- and token-based representations common in prior work.
(2) The experiments show that VoxScene improves physical plausibility while keeping layouts realistic.
Critical weaknesses
(1) The main contribution seems to be the overall pipeline, specifically the coarse-to-fine two-stage decomposition, rather than new network designs.
(2) The paper has no figure illustrating the anchor generation network or the object-centric voxel generation network.
(3) On 3D-FRONT, the evaluation uses FID on top-down semantic renders, overlap, and CD. Prior work such as DiffuScene and PhyScene also reports KID.
(4) The set of baselines feels somewhat limited. Comparisons with more recent scene-synthesis methods (for example, InstructScene)
(5) The paper states that “each voxel belongs to at most one instance, preventing overlap.” However, Appendix C.1 shows that disabling free-space write-back increases OR by only 0.048, about 1% of the roughly 4.8 baseline. This suggests the exclusivity constraint accounts for only a small part of the measured collision reduction.
(6) It would help to include ablations justifying the specific choices for the anchor generation and object generation networks. For example, alternative architectures or a single-stage variant would show how much each design decision contributes.
(7) The experiments use only the living-room split, the smallest at 813 scenes. Results on the bedroom split, the largest, would give stronger evidence that the method generalizes and scales.
Questions for authors
(1) Convolution over slot order is not permutation-equivariant, even with random permutation during training. Could the authors explain why they chose a convolutional design over a transformer, which handles unordered sets naturally?
(2) A codebook with 32,768 entries and embedding dimension 1 is effectively scalar quantization. Could the authors explain the motivation for using VQ here, and why the model samples continuously and then quantizes rather than working in the discrete or continuous space throughout?