- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposed Repart method for 3D segmentation. RePart is a 3-stage method: 1. fit 3D meshes with geometric primitives; 2. group geometric primitives into semantic parts; 3. project the part labels back to the original mesh. The grouping process is formulated as a Markov decision process. At each step, RePart decides whether to merge two primitive groups or stop. The decision policy is optimized by reinforcement learning, using rewards based on partition overlap and the number of predicted parts. Experiments demonstrate the effectiveness of the proposed method.
Critical strengths
- 3D mesh segmentation is an important research topic.
- The approach of fitting geometric primitives and then merging them to obtain a mesh segmentation is interesting and offers a novel perspective on part segmentation.
Critical weaknesses
- The experimental evaluation is limited. The training and testing datasets are relatively simple. Recent part segmentation methods are often trained and evaluated on HY3D-Bench and PartObjaverse, whereas this paper reports results only on PartNet and 3DCoMPaT++.
- The segmentation depends heavily on the initial primitive fitting. Once a primitive is fitted incorrectly, the merge-only procedure cannot correct it. Because primitive fitting relies on geometry rather than semantic information, such errors may be common when geometric and semantic boundaries do not align.
- Geometric primitives may be less suitable for complex shapes. Structures with intricate openings or rich surface detail can be difficult to approximate with simple primitives. A poor or fragmented fit could make the subsequent grouping process less reliable.
Questions for authors
- How does RePart perform on more challenging datasets, such as HY3D-Bench and PartObjaverse?
- How could the method detect and correct errors in the initial primitive fitting?
- What additional strategies could make the approach more robust to complex geometry, including intricate openings and fine surface details?
4 comments
Thank you for the additional experiments and clarifications. The HY3D-Bench evaluation and expanded test sets address a substantial part of my concern about the evaluation scope. The initialization study is also useful: using the same trained policy across different decomposition granularities provides evidence that the method tolerates some variation in the primitive workspace. These results make my original clear-rejection assessment too strong, and I am raising my score from 1 to 2 (weak rejection).
My remaining concerns are about the extent of this robustness and transfer. On HY3D-Bench, RePart substantially improves over MPS, but its mIoU is close to SAMPart3D and remains well below P3-SAM. The reported limited transfer to PartObjaverse would also benefit from quantitative results and the evaluation settings. Regarding initialization, the mean SQ purity is informative, but it does not show how frequently severely mixed primitives occur or how strongly they affect the final segmentation. A breakdown of low-purity cases and representative complex-shape failures would help establish the method’s practical limits. I appreciate the authors’ explicit acknowledgment of these limitations; the new evidence strengthens the paper, although it does not yet fully resolve my concerns.
Follow-up Response to Reviewer 1Xay
Thank you for the careful reading and for updating your assessment. We address the remaining points below.
1. HY3D-Bench: gap to P3-SAM, proximity to SAMPart3D. This benchmark is in-domain for P3-SAM: its part labels come from the same kind of connected-component annotation pipeline, by the same team, that labeled P3-SAM's 3.7M training meshes. RePart is trained on 900 PartNet shapes, from geometry only, on a single RTX 3090. The ranking reverses under PartNet's label convention, where RePart leads P3-SAM on both test sets (mIoU 0.5460 vs. 0.4858, and 0.5083 vs. 0.4326). On 3DCoMPaT++, which neither method was trained on, P3-SAM leads in mIoU by 0.04–0.05, and RI and SC differ by about 0.02 or less in either direction. Against SAMPart3D on HY3D-Bench, RePart is ahead in mIoU, VoI (0.9015 vs. 1.0919), and SC, and it leads PartField on all four metrics. A policy trained on 900 shapes therefore doubles the mIoU of its initialization (0.2529 to 0.5096) on object types it has never seen.
2. How often mixed primitives occur and how much they matter. Two analyses answer this.
Per-shape breakdown. We grouped the 200 test shapes of each dataset by their mean SQ purity under the default setting:
| Mean SQ purity | PartNet shapes | PartNet mIoU | 3DCoMPaT++ shapes | 3DCoMPaT++ mIoU |
|---|---|---|---|---|
| < 0.5 | 1 | 0.1045 | 1 | 0.1276 |
| 0.5–0.7 | 17 | 0.2220 | 20 | 0.2669 |
| 0.7–0.9 | 80 | 0.4896 | 85 | 0.4128 |
| ≥ 0.9 | 102 | 0.6492 | 94 | 0.5078 |
Severely mixed decompositions are rare: one shape per dataset falls below 0.5, and 9% (PartNet) and 10.5% (3DCoMPaT++) fall below 0.7. When they occur, they matter: mIoU on these shapes is 0.22 (PartNet) and 0.26 (3DCoMPaT++), against 0.49–0.65 and 0.41–0.51 on the remaining 90%. This is the practical limit of a merge-only policy, and it is confined to roughly one shape in ten.
Controlled change of purity. With the trained policy held fixed, we changed only the MPS setting:
| Dataset | Setting | Mean purity | mIoU |
|---|---|---|---|
| PartNet | Coarse | 87.40% | 0.5193 |
| PartNet | Default | 90.22% | 0.5460 |
| PartNet | Fine | 91.26% | 0.5512 |
| 3DCoMPaT++ | Coarse | 85.52% | 0.4253 |
| 3DCoMPaT++ | Default | 88.73% | 0.4476 |
| 3DCoMPaT++ | Fine | 90.29% | 0.4522 |
On PartNet, raising mean purity by 3.86 points changes mIoU by 0.032, and the last 1.04 points change it by 0.0052. On 3DCoMPaT++, 4.77 points change mIoU by 0.027, and the last 1.56 points by 0.0046 (RI, VoI, SC, and runtimes are in our reply to Reviewer mBL1, R2.2). Refining the decomposition therefore helps, with diminishing returns once most shapes are already well decomposed. Table 4 (Sec. 4.3) shows the other lever: with the primitives fixed and only the grouping objective changed, PartNet-furniture mIoU goes from 0.3757 for the best alternative, Greedy-BC, to 0.4280 for RePart-S, our policy trained on the same 300 furniture shapes.
3. Complex shapes. The 200 HY3D-Bench meshes include characters, food, and buildings, none of which appear in PartNet training, and the HY3D-Bench results above are computed over all of them. Final boundaries are not tied to SQ surfaces: with the groups fixed, replacing facewise nearest-SQ labeling with Boundary-Aware Surface Labeling raises mIoU by 0.03 to 0.09 across the three PartNet groups (Appendix Table C.8). The remaining failures occur when an SQ bridges two parts or a thin structure is fitted in fragments, and we will add representative cases of both to the revision.
PartObjaverse-Tiny Results (Reviewer 1Xay)
Following up on your request for quantitative PartObjaverse results and the evaluation settings. We randomly split PartObjaverse-Tiny into two halves of 100 shapes and report RePart on one half under two settings: (a) zero-shot, where the PartNet-trained policy is applied without any further training, and (b) adapted, where the same policy receives 50 further training steps on the other 100 shapes. Metrics are computed as in Table 2.
| Method | mIoU ↑ | RI ↑ | VoI ↓ | SC ↑ |
|---|---|---|---|---|
| EMS | 0.1424 | 0.373 | 1.770 | 0.283 |
| MPS (initialization) | 0.2372 | 0.719 | 2.370 | 0.295 |
| PrimAny | 0.2654 | 0.744 | 2.453 | 0.292 |
| SAMPart3D | 0.4674 | 0.818 | 1.300 | 0.541 |
| PartSAM | 0.4915 | 0.772 | 1.563 | 0.481 |
| PartField | 0.6677 | 0.815 | 1.088 | 0.548 |
| RePart, zero-shot | 0.4388 | 0.774 | 1.330 | 0.530 |
| RePart, adapted (50 steps) | 0.5125 | 0.809 | 1.168 | 0.588 |
Zero-shot, RePart raises its MPS initialization from 0.2372 to 0.4388 mIoU and lowers VoI from 2.370 to 1.330. It trails SAMPart3D by 0.029 mIoU, PartSAM by 0.053, and PartField by 0.229; this is the limited transfer we noted earlier. After 50 training steps on 100 shapes, mIoU rises to 0.5125, above SAMPart3D and PartSAM, with the second-best VoI and the highest SC, while PartField still leads by 0.155 mIoU. A brief adaptation thus recovers 0.074 mIoU, which indicates that much of the zero-shot gap comes from the shift in object types and label convention rather than from the grouping formulation. We will add this table to the revision.
Response to Reviewer 1Xay
We thank the reviewer for raising the limits of transfer evaluation and the dependence of primitive grouping on the underlying geometry.
R3.1 — HY3D-Bench and PartObjaverse. We evaluated the PartNet-trained model directly on 200 generated meshes from HY3D-Bench, without fine-tuning. The set includes categories not present in the PartNet training data. The main results are:
Compared with MPS, RePart increases mIoU by 0.2567 and reduces VoI by 1.1823, demonstrating that sequential grouping remains useful on these generated meshes. It ranks second in mIoU, VoI, and SC, but remains substantially below P3-SAM; we will qualify our generalization claims accordingly. Our current PartObjaverse experiments, in contrast, show limited transfer. We will explicitly report this limitation rather than attribute it to a single cause without a controlled analysis. The present evidence supports transfer to the tested HY3D-Bench distribution, not universal cross-dataset generalization.
R3.2 — Detection and correction of initial fitting errors. The reviewer is correct that a cross-part SQ cannot be split by the current merge-and-stop policy. We use a moderate MPS initialization and additionally measure the purity of SQ occupied supports; mean purity is 90.22% on PartNet (8,317 SQs) and 88.73% on 3DCoMPaT++ (10,805 SQs). Here, purity is the dominant ground-truth part fraction among independently occupied points in an SQ, averaged equally over valid SQs. It describes the initial semantic mixing, not an inference-time error detector. Geometric fit residuals and assignment uncertainty are available as state descriptors, but the current model has no validated primitive-splitting or repair operation. Boundary-aware surface labeling can refine the final mesh boundary but likewise cannot correct a fundamentally mixed primitive. We will state this distinction and the remaining limitation explicitly.
R3.3 — Intricate openings and fine surface details. We agree that intricate openings, thin structures, and high-frequency detail can lead to inaccurate or fragmented SQ fitting. RePart uses SQs as a workspace for part organization, not as the final reconstructed surface. After grouping, Boundary-Aware Surface Labeling transfers the inferred part identities to curvature-consistent regions of the original mesh, so final boundaries need not coincide with SQ surfaces. This can preserve local surface detail when the underlying part grouping is correct. However, it cannot recover missing structural components or reverse cross-part mixing already present in the initial SQs. We will clarify these two cases and add representative complex-shape successes and failures, without claiming that surface labeling resolves severe initialization errors.