- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ArtModeling links 497 physical articulated objects from 43 categories to detailed simulation assets, within a collection of 1,500 assets. It provides registered RGB-D captures, matched rendered views, part and joint annotations, and interaction recordings. The paper uses these data to compare articulation methods on real and synthetic inputs and to test whether physical calibration improves agreement with a second recording of the same joint motion.
Critical strengths
- The main value of the dataset, in my view, is the correspondence between 497 physical objects, detailed assets, and registered captures. Independently modeled geometry and recorded interactions provide useful references for checking reconstruction and simulated behavior. That combination gives the collection clear value as a benchmark resource.
- I found the real-versus-rendered comparison informative. It holds object identity, camera views, joint states, and reference assets fixed, yet the rankings change for joint and part-pose estimation. This adds a concrete finding about evaluation under real sensing conditions and is a main reason I lean toward acceptance.
Critical weaknesses
- The optimization benchmark includes 153 of the 497 paired objects, restricted to cases where all four methods produce valid outputs. Without per-method completion rates and a clear account of which objects were attempted and excluded, I cannot judge how representative this subset is. Omitting failures may change the method rankings and the conclusions about the gap between real and synthetic inputs.
- The dynamics test covers 36 objects and a second repetition of the same joint motion in the same direction. Because the applied forces are inferred from motion, different force and parameter combinations can produce similar trajectories. I see evidence of improved consistency under this setup, but not enough to judge parameter accuracy or transfer to different speeds, loads, or directions.
Missing references: PD²GS: Part-Level Decoupling and Continuous Deformation of Articulated Objects via Gaussian Splatting (ICLR 2026), Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Dataset (CVPR 2025).
Questions for authors
- How many of the 497 paired objects were attempted and completed by each method, and why were the others excluded? Please report failure rates on real and synthetic inputs and whether accounting for these failures changes the main comparisons.
- How is the excitation for the second interaction obtained independently of its target trajectory? Does any existing evaluation test a different speed, load, or motion direction and help distinguish parameter accuracy from fitting a particular motion?
- What does ArtModeling add beyond earlier collections pairing real observations with digital assets, and which paired captures, complete assets, and evaluation scripts will be released? These details affect my assessment of its value as a reusable benchmark.
4 comments
Response to Reviewer ZkRV 2/2
W2 & Q2: Independent Excitation for the Second Interaction and Dynamics Validation Across Interaction Conditions
A2: We thank the reviewer for raising these concerns. We clarify the excitation protocol and provide additional dynamics experiments under varied interaction conditions.
-
We jointly optimize physical parameters and external excitation using the first interaction trajectory, assuming piecewise-constant force or torque between consecutive sampling times. For the second interaction, the inferred excitation is reused unchanged across all four parameter configurations, while the second recorded trajectory serves as an independent evaluation reference.
-
We further conducted nine real-world pulling experiments on three articulated objects. The suspended masses range from 150 to 350 g, and the additional drawer or tray loads range from 0 to 350 g. A pulley system applies excitation along the joint axis, and an optical-inertial motion capture system records the resulting displacement at 90 Hz. Images of the experimental setups are presented in the ArtModeling Dataset Website.
Table 2. Trajectory residuals from shared-parameter calibration under different suspended masses and additional loads.
| Object | Suspended Mass (g) | Additional Load (g) | RMSE (cm) ↓ | NRMSE (%) ↓ |
|---|---|---|---|---|
| cabinet16 | 300 | 200 | 1.72 | 7.71 |
| cabinet16 | 350 | 0 | 0.71 | 3.18 |
| cabinet16 | 350 | 350 | 0.49 | 2.18 |
| cabinet17 | 250 | 0 | 2.61 | 15.10 |
| cabinet17 | 300 | 0 | 1.40 | 7.92 |
| cabinet17 | 300 | 200 | 1.72 | 9.76 |
| letter_tray2 | 150 | 0 | 0.98 | 5.00 |
| letter_tray2 | 250 | 0 | 1.34 | 6.21 |
| letter_tray2 | 250 | 150 | 1.96 | 9.79 |
| Mean | — | — | 1.44 | 7.43 |
For each object, one shared physical parameter set is jointly calibrated across its three trials. The suspended masses provide nominal gravitational excitation, and motion-capture trajectories provide independent motion references. Across the nine trials, the shared parameter sets achieve a mean RMSE of 1.44 cm and NRMSE of 7.43%, demonstrating consistent motion reproduction across varied loading conditions. ArtModeling further integrates SolverAdapt, enabling users to inspect and adjust mass, density, contact friction, and joint-drive parameters, preview motion responses, and save adapted configurations to USD assets.
W3 & Q3: Relationship to Existing Datasets and Data Availability.
A3: We thank the reviewer for pointing out these relevant works. We will cite PD$^2$GS [1] (ICLR 2026), which introduces RS-Art, and Digital Twin Catalog [2] (CVPR 2025), and clarify their differences from ArtModeling.
-
Compared with RS-Art, which already provides simulation-ready articulated assets with joint annotations and mass, inertia, and friction properties, ArtModeling provides 497 instance-matched real-world articulated objects and extends its physical annotation and evaluation scope with stiffness and damping annotations for the dynamics subset, estimated joint trajectories from real-world interaction videos, and dedicated protocols for physical parameter calibration and dynamics evaluation.
-
Compared with Digital Twin Catalog, which primarily focuses on large-scale digital twins of general objects through high-fidelity geometry, photorealistic PBR materials, and real-world DSLR/egocentric image observations, ArtModeling specifically targets articulated objects. It provides articulation-aware annotations, including part segmentation and joint structures, together with real-world interaction trajectories and physical-property annotations, enabling systematic evaluation of articulated reconstruction, physical parameter calibration, and dynamics.
Data Availability. We will publicly release approximately 300 real-world–digital asset paired instances upon paper publication, including the corresponding real-world captures, digital assets, and annotations. The remaining paired instances will undergo further preparation and quality checks and will be released incrementally within the following two months. We will also release the associated evaluation protocols and scripts to facilitate reproducible research.
[1] Wang, Haowen, et al. "PD$^2$GS: Part-level decoupling and continuous deformation of articulated objects via Gaussian splatting." International Conference on Learning Representations. 2026: 12354–12379.
[2] Dong, Zhao, et al. "Digital Twin Catalog: A large-scale photorealistic 3D object digital twin dataset." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2025: 753–763.
I appreciate the authors' thorough response, which has resolved my key concerns. I will keep my rating as Weak Accept.
Response to Reviewer ZkRV
Thank you for your careful review and positive evaluation of our work. We appreciate your confirmation that our response resolved your key concerns and will incorporate the corresponding revisions and clarifications into the final manuscript.
Response to Reviewer ZkRV 1/2
We thank the reviewer for the valuable feedback and for recognizing the significance of the instance-level correspondence between real-world objects, digital assets, and registered observations, as well as the informative findings from real-versus-synthetic evaluations.
Below, we provide detailed responses to the reviewer's specific comments and questions:
A1: We thank the reviewer for raising this concern. The 497 real-world object–digital asset pairs represent the full ArtModeling dataset across 43 categories, rather than the number of objects attempted in this baseline evaluation. For the unified comparison of four methods, we selected 170 pairs through category-stratified sampling, averaging approximately four objects per category while covering both revolute and prismatic joints. Of these, 153 formed the original common valid evaluation set, and 17 previously excluded objects were added for the expanded analysis. The remaining 327 pairs belong to the full dataset but were not selected for this baseline comparison; they are not method failures. We will make the full dataset and evaluation protocol available to support broader community benchmarking.
The original common evaluation set contained 153 objects with valid outputs from all four methods (105 revolute and 48 prismatic). We additionally evaluated 17 previously excluded objects (10 revolute and 7 prismatic). The remaining 327 candidate objects were not selected for evaluation and are therefore not counted as method failures. We intend to make the broader paired dataset available to support further benchmarking.
We count a run as a failure if it fails to produce an evaluable mesh after training. The additional objects include scissors, knives, sunglasses, and objects with moving parts made of transparent materials such as glass or acrylic. Across the 170 attempted objects, overall failure rates (Real/Sim) are 4.1%/4.1% for PARIS, 3.5%/2.9% for DigitalTwinArt, 1.2%/2.4% for ArtGS, and 2.4%/3.5% for SplArt.
Accuracy and Real–Sim Gaps Across the 170 Attempted Objects. We calculate
Mean CD = (CD-s + CD-m + CD-w) / 3. Each metric cell reports Real / Sim / (Real − Sim); a positive difference indicates higher error on Real inputs. Axis and revolute-joint Motion are measured in degrees. Pivot and prismatic-joint Motion are measured in meters.Table 1. Method-wise completion counts, reconstruction errors, and Real–Sim differences in aggregate means across 170 attempted objects.
Expanded Evaluation. Compared with the original 153 common evaluation objects, the ranking for Mean CD on real inputs with prismatic joints changed, with PARIS moving from 4th to 3rd and SplArt moving from 3rd to 4th. For Pivot on revolute joints with synthetic inputs, PARIS moved from 2nd to 1st, SplArt from 3rd to 2nd, and ArtGS from 1st to 3rd. The rankings of all other metrics remained unchanged. On the original 153 common evaluation objects, 27 out of 28 comparable metrics showed higher errors on real inputs than on synthetic inputs. The only exception was PARIS's revolute-joint Motion metric (-0.02%). After expanding the evaluation to 170 objects, 27 out of 28 metrics again showed higher errors on real inputs, with the only exception being DigitalTwinArt's revolute-joint Pivot metric (Real: 0.684, Sim: 1.831).