- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ArtMesh reconstructs articulated objects from multi-view RGB-D observations at two articulation states and part segmentation information. Built on MeshSplatting, it performs restricted Delaunay remeshing independently within each part to eliminate cross-part triangles. It then fixes the reconstructed meshes and estimates per-part rigid motions using bidirectional vertex-wise and pixel-wise consistency, with backward transformations defined as analytic inverses of the forward transformations. The paper also introduces Articulate-100, a benchmark of 100 objects, and evaluates on this benchmark, PARIS, and additional real captures. With ground-truth segmentation, the method achieves strong joint-axis estimation and part-level geometry results.
Critical strengths
-
The mesh-native formulation is a useful contribution to articulated object reconstruction, with part-aware remeshing improving motion estimation and part geometry.
-
Articulate-100 provides a useful benchmark for evaluating reconstruction across different part counts.
Critical weaknesses
-
Limited methodological novelty. The technical advance over MeshSplatting and existing articulation frameworks, including ArtGS, GaussianArt, and REArtGS++, is insufficiently established. Part-wise application of existing remeshing, rigid transformations, and consistency losses appears incremental, and the paper does not clearly isolate a substantial contribution beyond their integration.
-
Unclear attribution of gains to representation versus segmentation. Although Table 1 states that the baselines receive ground-truth masks, how ArtGS incorporates this supervision is unclear. The comparison therefore does not convincingly separate the benefits of mesh connectivity from part assignments. Furthermore, the predicted-mask variant changes the optimization pipeline, confounding the segmentation-robustness evaluation.
-
Missing relevant baselines. Comparisons with Part²GS [1], ArticulatedGS [2], and SplArt [3] are missing. Furthermore, adapting LARM’s [4] part-mesh extraction and correspondence-based joint estimation pipeline to the same RGB-D observations and part masks would provide a useful baseline for assessing the benefits of ArtMesh’s proposed formulation.
-
Insufficient evidence of simulation readiness. The Isaac Sim demonstration and self-penetration metric provide limited validation of reliable physical interaction. Table 4 reports higher penetration for the directly exported mesh than for the baselines’ TSDF outputs, leaving the claimed advantage of simulation-ready assets without post-processing insufficiently supported.
-
Limited real-world validation of multi-part reconstruction. The real-world evaluation centers on single-joint objects: two PARIS objects and two illustrated SplArt examples. This provides limited evidence that the claimed advantages on complex, multi-part objects transfer to real captures.
-
Insufficient justification of the acquisition requirements. The method requires multi-view RGB-D observations at two articulation states, camera poses, and part information. Although estimated-input experiments are provided, the paper does not sufficiently establish when the reconstruction benefits justify this acquisition burden or which practical applications require this operating regime.
-
Unclear practical benefit of the mesh-native representation. Although ArtMesh improves Chamfer distance, several qualitative examples exhibit noisier surfaces than ArtGS, and visible artifacts remain in the supplementary video. More importantly, its native mesh has worse self-penetration than all three TSDF-extracted baselines (Table 4), with the best result obtained only after TSDF processing. The simulation video also labels its assets as “postprocessed meshes.” These results leave the claimed advantage in directly usable mesh quality insufficiently established.
References
[1] Yu et al. Part²GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splatting. CVPR 2026.
[2] Guo et al. ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splatting. CVPR 2025.
[3] Lin et al. SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting. ICCV 2025.
[4] Yuan et al. LARM: A Large Articulated-Object Reconstruction Model. SIGGRAPH Asia 2025.
Questions for authors
-
What is the central technical innovation beyond combining MeshSplatting with established part-motion modeling and consistency objectives? Which controlled comparison best demonstrates the benefit of this innovation over a straightforward integration?
-
How exactly are ground-truth part masks used by ArtGS? Could you evaluate an ArtGS variant with explicitly mask-constrained part assignments? For predicted masks, could you report results with the main optimization pipeline unchanged to isolate the effect of segmentation quality?
-
Could you compare against Part²GS, ArticulatedGS, and SplArt? Additionally, could you adapt LARM’s part-mesh extraction and joint estimation pipeline to the same RGB-D inputs and part masks, with joint-type assumptions explicitly controlled, to isolate the benefits of your mesh-native optimization?
-
What collision geometry and preprocessing are used in Isaac Sim? Can you provide quantitative evidence of collision validity or interaction success for the directly exported assets, separately from TSDF-processed outputs?
-
How many SplArt objects were evaluated beyond the two illustrated examples? Can you provide real-world multi-part results to substantiate the claimed benefits on complex articulated objects?
-
Which concrete application scenarios justify acquiring posed multi-view RGB-D observations at two articulation states? What evidence shows that the resulting fidelity or functionality compensates for this acquisition cost relative to methods with less demanding inputs?
2 comments
Reply to Reviewer
D. Collision geometry and interaction success. The Isaac Sim scene uses our TSDF meshes ("postprocessed meshes") with a convex-hull collision shape per part; for the window, self-collision between its thin adjacent panels is disabled. For the directly exported assets, we ran a SAPIEN interaction study on all 100 objects (Table R2). Every direct export loads and simulates stably, and with no TSDF step and our own predicted joints it opens more joints than the baselines' TSDF meshes, each driven by its own predicted joints. It is not guaranteed to be watertight; we recommend the TSDF pass when watertight collision geometry is required.
Table R2. SAPIEN 2.2: fraction of joints a constant force (20 N prismatic, 5 N m revolute) opens over at least 90% of their range. CoACD collision geometry, all collision pairs enabled. Each method is driven by its own predicted joint motion, with the joint range taken from GT; GT: PartNet meshes with GT joints.
| GT | GaussianArt + TSDF | ArtGS + TSDF | ReArtGS++ + TSDF | Ours (direct) | |
|---|---|---|---|---|---|
| Pull-open success (%) ↑ | 91.3 | 39.3 | 67.2 | 65.6 | 74.4 |
Penetration of the direct export is identical with our predicted joints and with GT joints and is already present at the two observed states, so it comes from seam-level surface noise, not joint error; after TSDF it drops from 0.0494 to 0.0043 (Table 4, Table R1).
Table R1. Self-penetration along the joint sweep (21 states), mean over 100 objects, as % of the direct export's maximum over the sweep. Absolute SPD is in Table 4 (direct 0.0494, TSDF 0.0043).
| mesh | motion | max over s (%) | s=0 (%) | s=1 (%) | intermediate (%) |
|---|---|---|---|---|---|
| direct export | GT | 100 | 79 | 83 | 99 |
| direct export | ours | 100 | 79 | 82 | 99 |
| + TSDF | ours | 8 | 6 | 7 | 8 |
E. Real-world evaluation. We evaluated all 9 SplArt real captures (the paper shows two), all single-joint. Joint type is correct on 9/9 for ArtMesh, 9/9 for ReArtGS++, 8/9 for ArtGS (toolbox predicted prismatic) and 4/9 for GaussianArt (every hinge predicted prismatic). Real multi-part captures with two scanned states and reference joints are scarce, and building such a dataset is not feasible in the rebuttal period.
F. Acquisition requirements. Posed multi-view RGB-D at two states is the standard setting of the compared methods and matches how digital-twin assets are built: an object is scanned closed and opened with a handheld or robot-mounted sensor. With Depth-Anything-V2 depth, Axis Ang rises moderately and COLMAP poses dominate the remaining error (Supp. Table 5). Part masks are predicted by PArtSAM (point B).
G. Mesh quality. The baselines' native output is a set of Gaussian ellipsoids, not a surface (Appendix A, Fig. 8). Their TSDF mesh is fused afterwards from rendered depth, a lossy proxy that loses thin parts and absorbs floaters, while our exported mesh is exactly what ArtMesh optimizes. Under the same TSDF pass, ArtMesh gives the best surface agreement (Table R7) and the lowest self-penetration (Table 4: 0.0043 vs 0.0247 ArtGS, 0.0128 GaussianArt, 0.0100 ReArtGS++).
Table R7. Normal consistency with GT parts at state 0 (symmetric mean absolute cosine to the nearest-point normal; higher is better).
| method | all parts | movable parts |
|---|---|---|
| GaussianArt + TSDF | 0.794 | 0.771 |
| ArtGS + TSDF | 0.708 | 0.658 |
| ArtMesh + TSDF | 0.865 | 0.870 |
Reply to Reviewer
Summary of responses
We thank the reviewer for the detailed review and the specific experimental requests.
A. Central innovation. The backbone swap in Supp. Table 9 is the requested "straightforward integration" comparison: our pipeline is kept and only the mesh backbone is replaced. The two non-trivial components are isolated by their own ablations: per-part restricted Delaunay (a global remesh lets the consistency losses pull vertices across joints) and the analytic-inverse bidirectional cycle. Vertex-wise consistency is analyzed in our response to gh3r Q1 (Tables R4, R5).
B. Masks. We thank the reviewer for catching an error in the Table 1 caption: ArtGS and ReArtGS++ do not consume per-pixel masks; they take only the number of parts and initialize part centers by clustering. To separate the representation from the part assignment, we re-ran both with part centers initialized from GT masks (Table R3). ArtMesh also keeps a lower CD-s (18.98 vs 23.65 and 34.94 mm).
Table R3. Articulate-100, all methods with GT part masks, same protocol as Table 1. Lower is better.
For predicted masks, we ran GaussianArt with the same PArtSAM masks as Ours-PArtSAM on all 100 objects. ArtMesh's Axis Ang rises from 3.48° to 10.42° with Part Motion unchanged, whereas GaussianArt degrades sharply, so with predicted masks ArtMesh is about 5x more accurate in axis angle and part motion (GaussianArt Part Motion 20.31). Without GT masks, ArtMesh-PArtSAM also has the lowest CD-m (58.52 vs 151.41 ArtGS and 98.94 ReArtGS++, Table 1).
Running the predicted-mask setting with the main optimization pipeline unchanged was not feasible within the time and compute of the rebuttal period. With improved segmentation models this adaptation may become unnecessary, but current models do not yet solve the challenging problem of part segmentation on their own, which is why the predicted-mask variant includes our articulation-aware PArtSAM frontend.
C. Additional baselines. Part²GS, ArticulatedGS and SplArt each require per-object training on all 100 objects and, in several cases, data-pipeline adaptation; with the other requested experiments this exceeded our compute in the rebuttal period, so we prioritized concerns shared across reviews. LARM is trained on PartNet-Mobility data that overlaps with our test set, so its released model would not give a fair comparison, and retraining on a disjoint split is beyond our resources.