- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper reconstructs part-structured 3D models made of a few parametric primitives from calibrated multi-view images and masks, without 3D supervision. A VLM proposes the part inventory, relations and qualitative shape cues. A compiler grounds these in a visual hull to initialize deformable SuperFrustum primitives and to decide which deformations each part may use. Differentiable fitting with surface-bound 2D Gaussians and mask-ray constraints then estimates the geometry, and the VLM reviews the fitted assembly to add missing parts or reinitialize collapsed ones before joint refinement. On a hand-built Synthetic set, ShapeNet and GSO, it reports lower CD with fewer primitives than PartGS and DBW.
Critical strengths
- The closed loop is a sensible way to use a VLM in reconstruction. The VLM only makes discrete structural decisions and never has to predict metric coordinates, and the fitted geometry is fed back to it as evidence. Turning qualitative cues into deformation permissions is a simple and useful way to limit fitting ambiguity.
- The qualitative results are convincing for curved and slender parts. A mug handle or a set of table feet are fitted as single primitives where PartGS and DBW fragment or merge them, and ReasonFit uses fewer primitives than both baselines on all three datasets.
Critical weaknesses
- The evaluation is small and favors the proposed primitive. The three datasets contain 92 objects in total, and part-level metrics are only reported on the authors' Synthetic set, which is built from the kinds of shapes SuperFrustum represents well. On ShapeNet and GSO, the CD gains over the better baseline are small.
- The ablations are too small to support the central claim. The VLM-revision ablation uses only 3 objects and the component ablation 5, so the large gain attributed to revision isn't established.
- There is no variant that runs the same fitting without VLM initialization, and only one VLM is tested, so it's unclear how much of the gain comes from the VLM rather than the primitive and fitting design.
- SuperFrustum is borrowed from ResFit, while the appearance model follows PartGS. Comparisons with related image-based primitive methods, such as ISCO and GaussianBlock, are also missing.
Questions for authors
- How does the pipeline perform without the VLM, i.e., SuperFrustum fitting with residual birth and pruning from a generic initialization?
- Could you run the revision ablation on the full Synthetic set, and report how often the VLM's edits were correct?
- ShapeNet has part annotations (e.g., PartNet). Could you report dedicated recovery there, on objects not built from the same primitive types?
- How does the method behave with a different VLM?