- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper aims to solve single-image scene reconstruction whose outputs are usable in physics simulators with no floating, interpenetration or wrong scale. The authors propose a training-free pipeline via "perception-then-physics-validation" rather than physics losses. Specifically, a frozen single-view reconstruction backbone, occlusion-aware inpainting, VLM-predicted physical parameters, then Isaac Sim used as a black-box auditor that resamples per-object scale/pose until the scene is statically stable and still matches the input masks.
Critical strengths
The paper has strengths in the following perspectives:
- A reasonable and simple decomposition. The proposed pipeline involves frozen perception + black-box simulator audit + failure-driven local resampling with a hard visual-consistency gate, which avoids differentiable-physics training and keeps outputs tied to the image.
- Protocol choices are good in principle. The authors design identical per-(frame, object) target lists, baselines re-run locally with official weights. RecGen's self-reported HB numbers are close to the paper's re-run, which lends credibility.
- Honest statistics on the one ablation that exists (paired sign tests, CIs), conceding inpainting gains are "moderate but not universally consistent" (Sec. 4.4).
- Qualitative results (Figs. 2, 3, 6, 7) show visibly cleaner meshes than RecGen/Any6D on textured boxes and curved objects, showcasing the performance of the proposed method.
Critical weaknesses
The majority of the weaknesses is related to scope and evaluation, summarized as follows:
- The main claim (physical credibility) is never measured, especially quantitatively. There is no stability rate under simulation, penetration depth, settle displacement or floating-object rate, for the method or the baselines.
- Input modality is ambiguous. The comparison may be RGB vs RGB-D. The paper says "single RGB image" throughout but never names the reconstruction backbone. RecGen conditions on depth-derived pointmaps (RGB-D input) and Any6D needs an RGB-D input. Moreover, it is unclear whether instance masks are ground truth or predicted, and whether the "visib_fract" used for occlusion reasoning (Sec. 2) is the GT annotation of that name, which would be test-time data leakage.
- The core contribution (physics loop) is never ablated. Table 3 ablates only inpainting. There is no "no physics refinement" row, so Table 1 gains cannot be attributed to the loop vs inpainting vs backbone choice.
- Missing baselines. 1) REST3D (cited, closest baseline) is not compared. 2) SAM3D and Any6D+TRELLIS, and 3) the weaker Any6D+InstantMesh is used instead.
Questions for authors
Besides the above weaknesses, I have the following questions for the authors:
- Which exact models are the reconstruction backbone, inpainting model, VLM and segmentation source?
- Are the instance masks and visib_fract from ground-truth annotations or predicted at test time?
- Please add a "no physics loop" ablation and a "VLM priors replaced by constants" ablation on the full target sets, with paired tests.
- Where does the method support curved contact surfaces, given Sec. 3.2 and Eq. 8 only model planar supports? Any experiment with a non-planar support?
- What are ε_v, ε_ω, τ_iou, τ_pen, T_sim, and what is output when I_max is reached with no violation-free candidate?