- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a bottom-up autoregressive framework designed to generate articulated 3D assets directly usable for simulation from text or image inputs. The framework decouples fine-grained geometric components from rigid kinematic links, thereby retaining detailed geometric features while preventing the kinematic structure from becoming unnecessarily complex. The model is capable of jointly generating component geometries, assembling components into rigid links, and predicting articulation properties as well as simulator-oriented physical attributes including joint damping and stiffness. To address the scarcity of fully annotated articulated data, the authors introduce Mobility-PhyX, a scalable data construction pipeline that integrates geometric and kinematic augmentation techniques with VLM-based physical attribute grounding, and is trained jointly on approximately 430K part-aware objects and 30K simulation-ready assets.
Critical strengths
-
This paper proposes a novel representation for modeling fine-grained components and jointly generating their corresponding physical information. This representation allows subtle components to be jointly modeled while remaining distinguishable; for example, the caster wheels of a chair can be separated as individual components rather than being merged into a coarse part.
-
To generate training data and jointly train the model, this paper designs a data construction pipeline for obtaining training data and adopts a heterogeneous training strategy that co-trains on part-aware assets and simulation-ready assets.
Critical weaknesses
None
Questions for authors
-
I noticed that the authors mention PhysX-Omni, which appears to be a relatively recent method, but it was not evaluated in the experiments. I am not sure what the specific reason is.
-
In addition, PhysX-3D should be an early work on physically grounded 3D generation, and PhysXNet should be the earliest related dataset serving this line of methods. I think the authors should mention it in the related work.
-
The experimental section does not include particularly complex visualization examples, so it does not fully demonstrate the advantages of the proposed representation. Moreover, there does not seem to be supplementary material, and I am not entirely sure about the concrete effectiveness of the method.
If the authors can adequately address these concerns, I am willing to increase my rating.
3 comments
The author has addressed my main concerns, and I have raised my score accordingly.
Thank you for your follow-up and for confirming that your major concerns have been addressed. We appreciate your constructive feedback and insightful suggestions. Please let us know if you have any further questions or concerns; we would be happy to provide additional clarification.
We thank the reviewer for recognizing our fine-grained representation and heterogeneous training strategy, and for the constructive suggestions concerning related work and experimental presentation.
Our submission includes a discussion and conceptual comparison with PhysX-Omni in Appendix P and Table 7. PhysX-Omni emphasizes unified generation across rigid, deformable, and articulated asset types, whereas our work focuses on separating fine-grained geometric components from rigid kinematic links within articulated objects.
At submission time, PhysX-Omni was an arXiv-only preprint. The ICLR 2027 Reviewer Guidelines ](https://iclr.cc/Conferences/2027/ReviewerGuidelines)[https://iclrc˙c/Conferences/2027/ReviewerGuidelines explicitly state that “authors are not required to compare to papers solely on arXiv,” while strongly encouraging citation of known related work. We accordingly cited PhysX-Omni and discussed its relationship to our formulation, but did not include it in the numerical comparison.
To address this concern, we have conducted additional experiments comparing our method with PhysX-Omni under the same evaluation protocol detailed in Appendix H. We report the quantitative comparison directly below:
Thank you for pointing out PhysX-3D and PhysXNet. We agree that they are important early contributions to physically grounded 3D generation and will add the corresponding citations to the revised manuscript.
PhysX-3D introduces PhysXGen, a dual-branch framework that jointly models geometry and physical properties within a pretrained 3D latent space. Our method takes a different approach: it explicitly distinguishes fine-grained geometric components from rigid kinematic links and autoregressively generates the component–link–joint hierarchy together with simulator-oriented physical attributes, including joint damping and stiffness. This separation allows multiple geometric components to form one rigid link, preserving geometric detail without unnecessarily increasing kinematic complexity.
Regarding data construction, PhysXNet provides physical annotations through a VLM-assisted human-in-the-loop pipeline, while its PhysXNet-XL extension additionally supports procedural asset composition. Mobility-PhyX focuses on articulated-asset augmentation through retrieval-based component replacement and bidirectional kinematic-tree augmentation. It further grounds joint dynamics by eliciting plausible interaction forces and motion durations from a VLM and deriving damping and stiffness through physical formulations.
The submitted PDF includes supplementary text and visualizations in its appendices. Complex examples appear in Figures 1 and 4b, with additional results in Figures 14–15. For example, Figure 1 includes generated assets with 191 geometric components organized into 92 kinematic groups, illustrating the distinction between geometric and kinematic granularity.
Beyond visual examples, Table 5 directly evaluates the generated hierarchy, reporting component F1 of 0.80, grouping ARI of 0.75, joint F1 of 0.84, and tree-edge F1 of 0.90. Figure 5 further demonstrates the utility of generated assets for downstream manipulation-policy learning.
We acknowledge that still images do not fully convey articulated motion or simulation behavior. Full generated asset packages contain high-resolution meshes extracted using marching cube and can readily exceed OpenReview’s 100 MB supplementary-upload limit. We will therefore provide sample videos of complex generated assets in the supplementary materials, allowing their articulation and simulation behavior to be inspected without downloading the full mesh packages.