- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces ISArt, a structure-guided framework for generating simulation-ready articulated 3D assets from a single image. It combines explicit geometric and kinematic reasoning with learned high-fidelity part geometry generation in a closed loop with simulation-based verification. ISArt first uses a VLM to infer part semantics, connectivity, joint types, coarse motion axes, bounding boxes, and cavity information, optionally synthesizing an open-state reference image to reveal occluded internal structures. These structural priors condition a multi-part DiT through per-layer embedding injection and structural cross-attention, guiding the synthesis of part geometry. An agentic articulation-binding module then estimates joint origins, axes, and motion ranges from the generated geometry and constructs a URDF. Finally, the framework uses Isaac Sim renders and video-based feedback to iteratively identify and correct invalid motions, producing validated, executable assets.
Critical strengths
None
Critical weaknesses
The experimental evaluation is limited and lacks comparisons with many relevant methods. Moreover, the related work discussed is not well aligned with the paper’s title and primary research focus.
Questions for authors
-
The paper claims to propose a sim-ready 3D asset generation model, but I do not see how the physical attributes are obtained. If the method only produces articulated assets, how are the mass and dimensions of the model determined? These are variables required for simulation. Moreover, the authors mention PhysX-Anything and PhysForge, but why do they not compare with these sim-ready-focused methods, and instead compare with many articulated-asset methods? This is inconsistent with the paper’s stated goal.
-
The authors spend a large amount of space introducing articulated-asset methods in the related works, but this does not match the paper’s title. Many sim-ready generation methods, including PhysX-3D, were proposed earlier than PhysX-Anything; PhysX-CoT and PhysX-Anything appeared around the same time; and PhysX-Omni is a relatively recent method. None of them are analyzed in relation to the proposed method in the related works.
-
The model framework is very similar to those of Particulate and MonoArt, but the experiments do not compare with these related methods.
If the author can address those questions, I would like to raise my rating.