- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents ARTISAN, a multi-agent framework for generating articulated 3D objects with detailed attributes, including mass, physical parameters such as roughness and metallicity, and material properties. In this system, the design agent generates a design blueprint from text or image inputs, the coding agents write code for the asset based on the blueprint, and the reviewer agent evaluates the generated asset and provides feedback. The generated assets improve upon existing methods in terms of both visual appearance and the quality of physical attributes.
Critical strengths
-
The paper proposes a multi-agent system for generating articulated 3D objects. The task itself is important, and the proposed method is interesting, particularly the use of a design agent to generate a blueprint from the inputs.
-
The robotics experiments strengthen the paper, although their scope is somewhat limited.
Critical weaknesses
-
The scope of the robotics experiments is somewhat limited. The experiments demonstrate that combining native assets with ARTISAN-generated assets improves the policy success rate, but this also increases the total number of assets used. In addition, no real-world policy evaluation is conducted. Thus, the authors take a step forward in real-to-sim but do not address real-to-sim-to-real.
-
Stability does not necessarily imply greater realism. The agent could assign a higher density to the base of an object and a lower density to its upper parts to achieve stability. However, the authors report only the mass difference at the whole-object level. Therefore, there is no evidence that the generated assets have realistic mass distributions across their parts. Physical parameters such as friction and damping are also not evaluated. The robotics experiments could serve as an indirect assessment, but their scope is limited, as discussed above.
-
Minor suggestions: The reference formatting is inconsistent: some entries use full names, while others use abbreviations; some include page and volume information, while others omit it.
Overall, I lean toward acceptance and would be happy to (and probably will) raise my score further after reading the other reviewers' comments and the authors' rebuttal.
Questions for authors
My concerns are outlined in the weaknesses section. I have no additional questions.
3 comments
Thanks for the authors rebuttal! I don't have more questions for now and I believe this paper provides useful insights to the community. I'll decide whether to raise my score based on other reviewers and AC's feedback.
Thank you for your encouraging follow-up and for recognizing the value of our work. We are glad that our rebuttal has addressed all of your concerns.
We have also provided additional experiments and clarifications in response to the other reviewers. As you revisit the discussion, we would be grateful if you would consider whether this additional evidence supports a higher rating.
Thank you again for your time and thoughtful review.
Response to Reviewer r8Es
We thank the reviewer for recognizing the importance of articulated-asset generation, the value of blueprint-based design, and the contribution of our robotics experiments, and for the suggestions on data augmentation and physical attributes.
[W1]: The scope of the robotics experiments is somewhat limited
(a) The gain does not come from more assets alone. High-quality articulated training assets are scarce and costly to expand. Artisan addresses this bottleneck by generating additional usable assets, enabling better generalization to unseen native objects. Table 3(a) reports an increase from 80% to 84% on RoboTwin and from 39% to 43% on RoboCasa when Artisan assets augment the native training set.
With equal numbers of generated candidates, Artisan achieves usable-asset rates of 100% on RoboTwin and 44% on RoboCasa, compared with 62% and 8%, respectively, for Articraft. Under this equal candidate-generation scale, Artisan-only policies achieve higher average success than Articraft-only policies:
We additionally compare Native + Articraft with Native + Artisan using equal numbers of generated candidates and the same training and held-out evaluation protocol:
Artisan augmentation achieves higher success on both benchmarks, supporting its greater utility as a source of additional training assets.
(b) Real-world evaluation. We agree that sim-to-real policy transfer is not evaluated. Our contribution focuses on real-to-sim, generating articulated assets from real-world inputs that are physically valid and ready for simulation. Transferring policies back to the real world depends largely on factors outside the asset-generation scope of this paper.
We see a full real-to-sim-to-real evaluation as an important next step and have discussed it in the limitations section.
[W2]: Stability does not necessarily imply greater realism
The absence of measured part-level mass ground truth is a limitation of the current evaluation. ABO provides whole-object masses, while the articulated-asset datasets used here also do not provide experimentally verified part-wise masses. We identify this collection and release as future work.
To test whether our stability advantage depends on predicted mass allocation, we conduct an additional experiment on all 50 Stability objects. We remove the predicted part masses and inertias and recompute them using a uniform density of 1000 kg/m³, while keeping geometry, articulation, and other parameters unchanged:
Even without predicted part masses and inertias, Artisan exceeds Articraft's reported stability by 10% in both states. This supports the structural stability of our generated assets.
[W3]: Reference formatting
We have standardized conference and journal names throughout the bibliography and completed the available page and volume information, including the missing page ranges for ABO and TRELLIS and the PMLR volumes for BEHAVIOR-1K and image2mass.