- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents WorldSculpt, which generates individually editable object meshes from posed multi-view images, instance masks, and coarse 3D boxes. It adapts Pixal3D through anchor-aligned canonicalization, learned multi-view feature aggregation, and augmentation-based finetuning using only single-object data. The paper also introduces UE-MeshyScene, containing 2,299 objects across six cluttered environments. Validation includes comparisons on four datasets, component ablations, grounding perturbations, and qualitative conversion of Marble-generated worlds.
Critical strengths
-
Strong empirical performance. Improvements extend across four datasets and multiple geometry and alignment metrics. On UE-MeshyScene, [email protected] increases from 0.359 for ShapeR to 0.738. Comparisons with Pixal3D plus the same assembly pipeline also demonstrate benefits beyond scene assembly alone.
-
Useful evidence for scaling object-level priors. Handling up to 701 objects per scene using only single-object finetuning is practically meaningful. The new benchmark and augmentation ablations help substantiate this contribution, particularly under substantial occlusion.
Critical weaknesses
-
The proposed method is somehow incremental. Pixal3D already provides projected feature conditioning, multi-view aggregation, and object-separated scene generation; ShapeR already studies robust object-centric reconstruction from casual captures. WorldSculpt’s distinction therefore rests mainly on its adaptation recipe and demonstrated scale. In Table 5, learned aggregation provides only a modest gain over averaging on UE-MeshyScene, limiting the strength of the architectural contribution.
-
Validation of realistic scenes remains limited. The large-scale benchmark contains six synthetic environments, while the real HouseCat6D evaluation has only 0.34% average occlusion by the paper’s measure. Ground-truth grounding and separately applied synthetic perturbations do not establish robustness to jointly occurring segmentation, association, localization, and camera errors. The Marble demonstration is encouraging but qualitative.
Questions for authors
-
How much improvement remains over native Pixal3D-MV when it receives the same finetuning data, augmentation, and optimization budget? Can the authors quantify performance with jointly estimated grounding on cluttered real captures, for example the ShapeR benchmark?
-
How are the provided ground-truth 3D boxes incorporated into MV-SAM3D? Does it still predict object poses while WorldSculpt uses box-derived placement? A comparison with matched placement, or separate shape and pose metrics, would help clarify the source of the improvement.
Thanks for the rebuttal. The authors have addressed part of my concerns, I would like to maintain my rating as weak accept.