- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Segment–Snap for recovering movable parts, their motion parameters, and handles from a static RGB point cloud. The method combines three independently trained predictors for parts, dense handles, and part-associated handle proposals. Detected handles guide a training-free geometric decoder to resolve hinge-side ambiguity, while part-associated proposals and contextual class correction improve handle prediction. These two information transfers are applied once, without iterative feedback. Experiments on the Articulate3D validation set report improvements in hinge localization and handle detection, with fixed-input ablations, repeated training, and learned-decoder comparisons examining the benefits and limitations of the coupling.
Critical strengths
The paper provides convincing evidence that detected handles are useful for resolving hinge-side ambiguity. In Table 4, replacing centroid origins with handle-guided origins improves motion AP from 13.74 to 40.98 while keeping part masks, classes, scores, and axes fixed. This is a meaningful result because it separates better hinge placement from better segmentation. It shows that a relatively simple geometric decoder can make effective use of information that is already available from scene perception.
The supplementary analysis is thorough and helps explain what the system actually improves. Repeated-training experiments distinguish the relatively consistent proposal gains from the smaller and more variable class-correction gains. The matched learned-decoder comparisons are also useful, and the authors appropriately acknowledge that the confidence intervals do not establish superiority over the strongest learned alternatives. These controls make the empirical findings more credible than an aggregate benchmark improvement alone.
Critical weaknesses
The main concern is the limited contribution beyond existing geometric reasoning and complementary prediction sources. As the paper acknowledges, selecting a hinge opposite a handle already appears in S2O; the distinction here is primarily the use of independently detected scene handles. This is a useful adaptation, but the reverse transfer does not yet provide strong evidence of a more substantial methodological advance. In Table S3, parent conditioning changes handle AP by only +0.34 before correction and −0.52 after correction, with both confidence intervals including zero. Table S2 also shows that dense-only label correction reaches 30.66 AP, close to the full correction’s 30.99. These results support the usefulness of additional proposals and label evidence, but do not clearly establish the added value of the proposed part-conditioned mechanism over a simpler combination of independent predictions. The authors acknowledge these limitations; nevertheless, they leave the central novelty argument unconvincing to me. The evaluation provides limited evidence that the reported advantages generalize beyond the development setting. Model and hyperparameter selection consulted the same 42-scene validation split used for reporting results. This is particularly relevant because the decoder relies on planar surfaces and fixed upright rotational axes. An independent evaluation would help determine whether the gains persist once the configuration is frozen. The external comparisons do not fully resolve this concern: Table 1 uses published results without matched training resources or a verified common origin-distance implementation, while REACT3D is not trained on Articulate3D and the proposed predictors are. These differences are disclosed, but they make the comparisons less informative about the contribution of the coupling itself. My concern is insufficient independent validation, not that using a validation set for model selection is inherently improper.
Questions for authors
Could you clarify the intended contribution of parent conditioning in light of Table S3? Is there evidence that it improves the final handle output over an unconditioned proposal source with matched capacity and training, rather than simply providing additional detections?
Could you provide an input-matched comparison with the S2O-style geometric rule discussed in the paper, holding part predictions, geometric fitting, and evaluation fixed? In particular, how much improvement comes from replacing a geometry-derived handle proxy with independently detected scene handles? This comparison would materially affect my assessment of the methodological contribution.
Which model choices and decoding thresholds were selected using the 42 validation scenes, and are any results available on an untouched scene split or test set with those choices frozen? I am asking for clarification of the existing selection protocol and any independent evidence, rather than suggesting a broader future-work agenda.
3 comments
Reply 2/3 — Independent proposals, hidden-test results and validation selection
>>> Concern 4 Added value over a simpler combination of independent predictions
>>> Response Thank you. Our joint-network proposals provide added value over the tested simpler combination of independent predictions: they recover more missed handles and achieve higher final handle AP. We explain these two results below.
1. Before class correction, joint proposals recover 53 missed handles, versus 8–11 from a second dense detector. We conducted an additional comparison that fixes the reference dense detections (24.63 AP) and replaces joint proposals with each of three independently trained dense repeats from Tab. S5. Both sources use the same appending procedure, score scale, class correction and part predictions:
| Appended source | New handles before correction | Handle AP before correction | Handle AP after correction |
|---|---|---|---|
| Second dense detector (three repeats) | 8–11 | 25.34–25.77 | 25.42–25.83 |
| Joint-network proposals (reference) | 53 | 29.65 | 30.99 |
2. Joint proposals achieve 30.99 final handle AP, versus 25.42–25.83 under the same class correction. The advantage is already present before correction: joint proposals reach 29.65 AP, versus 25.34–25.77 for the independent dense sources. Thus, the tested independent combination does not reproduce the joint source's recovery or AP benefit. We will add this control to Tab. S2.
>>> Concern 5 (Q3) Generalization beyond the development setting and selection protocol
>>> Response Thank you. Our official hidden-test results support generalization beyond the development setting with the planar/upright priors. We report these results, then clarify which model choices and decoding thresholds were informed by the 42 validation scenes.
1. Our best challenge entries lead both official hidden-test leaderboards. Across multiple submissions, our best scores are 48.28 motion AP and 34.46 handle AP. Test labels remain hidden; the challenge server scores submissions:
| Motion (hidden test) | AP50 | AP50 (axis) | AP50 (origin) | Motion AP |
|---|---|---|---|---|
| Ours | 55.38 | 52.34 | 49.76 | 48.28 |
| pico-mr | — | — | — | 41 |
| coreMany | 46.68 | 43.15 | 43.28 | 40.56 |
| teamzb | 47.20 | 44.99 | 38.55 | 37.11 |
| core | 44.44 | 41.05 | 39.55 | 36.89 |
| ZZZ | 47.72 | 44.81 | 37.77 | 35.72 |
| linxii | 43.52 | 41.35 | 35.47 | 33.60 |
| coreN | 43.70 | 40.60 | 35.94 | 33.38 |
| astar | — | — | — | 29 |
| ZeroR | 39.53 | 37.25 | 30.14 | 28.61 |
| Uni Stuttgart | — | — | — | 27 |
| USDNet (official baseline) | 43.66 | 37.98 | 31.54 | 26.34 |
| wwwjh | 43.66 | 37.98 | 31.54 | 26.34 |
| ww | — | — | — | 26 |
| ShinNam! | 35.52 | 33.73 | 29.04 | 24.67 |
| ttt | 30.58 | 28.38 | 25.99 | 24.00 |
| Handles (hidden test) | Handle AP |
|---|---|
| Ours | 34.46 |
| coreMany | 32.86 |
| core | 32.60 |
| teamzb | 31.10 |
| ZZZ | 30.69 |
| coreN | 28.86 |
| ZeroR | 25.71 |
| moon | 24.80 |
We include current and previous editions, using USDNet's latest official baseline. Dashes mark unreported metrics; USDNet's test handle AP is unreported. We report these test leaderboards as permitted by ICLR 2027.
2. The system achieves strong axis- and origin-gated test performance with the planar/upright priors. The reported test entry achieves 52.34 axis-gated AP and 49.76 origin-gated AP, versus at most 44.99 and 43.28 for other reporting entries. These priors are geometric rules with no learned parameters; the axis-rule validation comparison is disclosed below.
3. Validation informed checkpoint selection, the axis-rule comparison and decoding settings.
| Component | Selection or setting |
|---|---|
| Checkpoints | Part model: best validation motion AP, at 70% of training. Dense model: best validation segmentation score. Joint model: final weights. |
| Axis prior | Upright rotation axis, retained after validation showed no statistically resolved advantage for an alternative axis rule. |
| Part decoder | 0.5 m handle gate, 5 cm cleanup radius, connectivity rescoring. |
| Dense handles | 2.5 cm grouping radius; 3-point minimum size to retain small handles. |
| Children and correction | 0.30 mask threshold, 90% containment, part confidence 0.3. |
| Child score scale | 0.05; tested values from 0.05 to 0.5 give identical AP. |
| Learned-decoder baselines | Checkpoints minimize loss on a held-out training fold; the reported best-of-three head seed is selected by validation AP, as disclosed in the supplement. |
Reply 3/3 — USDNet and REACT3D comparisons
>>> Concern 6 Contribution of coupling and scope of external comparisons
>>> Response Thank you. Our fixed-input controls establish the contribution of coupling, with a common origin-distance implementation for the new motion comparisons. Below, we address training resources and evaluation, explain REACT3D's training conditions, and summarize the controlled results for both transfers.
1. The additional USDNet comparison fixes part predictions and uses a common origin-distance implementation. Tab. 1 reports published Articulate3D benchmark results. To measure handle guidance on controlled part inputs, we additionally retrained USDNet on the 195-scene Articulate3D training split for 200 epochs using its released recipe, selecting the checkpoint by validation part AP50. All new rows use the same 42 validation scenes and released line-distance evaluator. The retrained model reaches 31.87 part AP50 and 10.26 motion AP; the published 41.8 and 25.0 remain references. Every row uses the same retrained USDNet masks, classes and scores:
| Decoder on the same retrained USDNet parts | Motion AP |
|---|---|
| USDNet's motion head | 10.26 |
| Our geometric decoder, centroid origins | 9.44 |
| Our geometric decoder, our detected handles | 27.22 |
Detected-handle guidance adds 17.78 pp (paired 95% scene interval [12.55, 23.02]) between the two geometric-decoder rows, with masks, classes, scores and axes fixed. This isolates the handle-guidance gain from differences between trained part predictors.
The official hidden-test leaderboard also lists USDNet and our entry under the same reported metrics: 31.54 origin-gated AP and 26.34 motion AP for USDNet's official baseline, versus our 49.76 and 48.28.
2. REACT3D in Tab. 2 is an additional comparison that broadens our evaluation. For our Articulate3D benchmark comparisons, please refer to Tab. 1. REACT3D combines pretrained models without additional Articulate3D training; our predictors use the Articulate3D training split. We evaluate the released method as designed and score both systems on the same 42 validation scenes with the benchmark evaluator. Their inputs and training differ, as disclosed at L417–418.
3. Fixed-input controls show gains in both directions of coupling. For handles to motion, the additional USDNet experiment raises motion AP 9.44 → 27.22 with part predictions and decoder axes fixed. For parts to handles, Tab. S2 fixes dense detections and shows joint proposals raising handle AP 24.63 → 29.65 before class correction. These gains measure the two transfers with their base predictions held fixed.
Reply 1/3 — Matched S2O comparison, conditioning and class correction
We organize your review into six concerns and answer them in this order:
>>> Concern 1 (Q2)Contribution and matched S2O comparison>>> ResponseThank you. Our contribution is using independently detected scene handles to improve hinge selection. We credit S2O's opposite-handle rule (L162–163). S2O estimates handles from protrusions within part geometry; our scene detector can find handles outside the predicted part mask. Our additional matched comparison raises motion AP 30.72 → 40.98 (+10.27 pp) by replacing S2O's cue with ours on identical predicted parts.We conducted the requested comparison with only the handle cue changed. On 42 validation scenes, we evaluate annotated and predicted parts separately, fixing masks, classes, scores, geometric fitting, axes, four hinge candidates, hinge selection and evaluation. Both cues act on rotating parts where our detector finds a handle within 0.5 m of the part support; others retain centroid origins. We use S2O's released estimator and constants, taking the room-facing side as front because object-body associations are unavailable.
Detected cues improve motion AP under the same hinge rule. Gains are 10.27 pp on predicted parts (paired 95% scene interval [6.09, 14.44]) and 6.20 pp on annotated parts ([2.51, 9.89]). Across three additional part-model runs, predicted-part gains are 8.43–11.96 pp. We will add this comparison to the paper.
>>> Concern 2 (Q1)Purpose and evidence for parent conditioning>>> ResponseThank you. The complete per-part design improves recovery over the unconditioned source; final-AP superiority is unresolved. We explain conditioning's intended contribution below.1. Conditioning alone has no established AP benefit at fixed shared-map readout (Tab. S3a). This holds before and after class correction. The paper attributes the AP gain to complementary joint-network proposals (L321–322). We will state this distinction in the abstract.
2. Parent conditioning lets each part propose its own handle. Training uses part-associated handle targets. Proposals inherit their parent's score and class and survive only if their parent survives filtering. The unconditioned head uses a shared map trained on the union of all handles.
3. The complete design improves recovery; its final-AP advantage is not statistically resolved. Our additional comparison matches model capacity, training data, schedule and seed. Both sources use the same dense detections (24.63 AP), appending and class correction. Conditioning, readout and training targets change together:
Our design recovers more missed handles in 18 scenes and fewer in 2 (scene-level sign test, p = 0.0004). The final-AP difference has paired 95% scene interval [−1.10, +3.53].
>>> Concern 3Full correction adds 0.33 pp beyond dense-only correction>>> ResponseThank you. Full correction adds 0.33 pp over dense-only label correction; our complete design also recovers more missed handles than the tested independent source. We separate these two benefits below.1. Part labels improve correction on identical proposals. Tab. S2 fixes joint-proposal masks and scores: full correction reaches 30.99 handle AP, versus 30.66 with dense-only correction. Parts-only correction reaches 30.63, versus 29.65 without correction. The part and dense-handle sources provide overlapping label evidence.
2. The broader contribution includes recovery before class correction. Our additional comparisons fix dense detections. Before correction, our complete per-part design recovers 53 missed handles, versus 27 for the unconditioned shared-map variant and 8–11 for a second independently trained dense detector across three runs.