- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies test-time adaptation for 2D-to-3D point cloud part segmentation under geometric corruption, category shifts, and synthetic-to-real transfer. It introduces TRACE, which organizes predictions from multiple views into semantically compatible evidence chains, calibrates them using overlap between their 3D supports, and uses an exact closed-form composition rule to avoid enumerating the chains. An uncertainty-gated objective then adapts sift prompts while keeping the perception and lifting models frozen. Experiments with PartSLIP and PartSTAD, five TTA baselines, component ablations, and a real-world demonstration show consistent improvements across the three shift settings.
Critical strengths
-
The topic of robustness and generalization in 2D-to-3D perception models is both timely and important, as it is a common challenge in many real-world systems, yet somewhat overlooked by the TTA community.
-
The central idea of “chains of evidence” is novel and intuitive. By recognizing that predictions across views are coupled and may conflict, the paper explains why conventional TTA struggles in the 2D-to-3D lifting pipeline. Tracing compatible evidence chains then provides a coherent basis for adaptation.
Critical weaknesses
-
PartSLIP and PartSTAD differ in region extraction and lifting, but both use GLIP and the same ten fixed views. Evidence with fewer valid views or a different 2D detector would help establish how broadly TRACE’s gains apply.
-
The ablations support the value of geometric calibration and uncertainty gating, but do not include a closely matched, simpler cross-view consensus baseline using the same prompt updates and adaptation objective. It is therefore difficult to isolate the benefit of evidence-chain consolidation from geometric reweighting and selective updates.
Questions for authors
-
How does TRACE perform with fewer valid views or a different 2D detector? This would clarify the scope of the reported gains.
-
How reliable is the uncertainty gate when different views confidently support conflicting classes?
-
With the same prompt parameterization, update budget, and adaptation objective, how does TRACE compare with a simple geometry-weighted cross-view consensus baseline? This would clarify the specific contribution of evidence-chain consolidation.
5 comments
Response to x8Yt (part II)
Q2. How reliable is the uncertainty gate when different views confidently support conflicting classes?
A3: Thank you for this question. We assessed the gate’s reliability by examining whether points with conflicting cross-view support pass it. We measure conflict using the mean pairwise Jensen–Shannon divergence, , across valid visible views and classify points as high conflict when .
R-Table 13 shows that the gate filters out most high-conflict points, with those passing it accounting for 0.62–1.35% of all valid points. Additionally rejecting these remaining points improves mIoU by only 0.06 / 0.02 / 0.12 points, indicating a small net effect on segmentation performance. We have included this empirical validation in Appendix C.4 of the revised manuscript.
R-Table 13: Conflict statistics and additional conflict rejection. The final column adds rejection of points with to the original gate.
| Setting | High-conflict points (%) | High-conflict points passing the gate (%) | TRACE mIoU | TRACE + conflict rejection |
|---|---|---|---|---|
| Corruption shift | 17.84 | 1.14 | 35.60 | 35.66 |
| Category shift | 9.78 | 0.62 | 34.97 | 34.99 |
| Sim-to-real shift | 24.63 | 1.35 | 38.51 | 38.63 |
W2 / Q3. How does TRACE compare with a simple geometry-weighted cross-view consensus baseline?
A4: Thank you for this question. Following your suggestion, we compare TRACE with different cross-view fusion baselines under the same prompt parameterization, update budget, and adaptation objective: Averaging, Normalized product, and geometry weighting. R-Table 14 shows that TRACE consistently outperforms all three baselines across both backbones and all three shift types. Among the simpler baselines, geometry weighting achieves the highest average mIoU on both backbones, supporting the value of geometric reliability in combining cross-view evidence. We have included this comparison and analysis in Appendix C.5 of the revised manuscript.
R-Table 14: Comparison with cross-view fusion baselines under category shift.
| Backbone | Fusion | Complexity shift | Composition shift | Shape shift | Average |
|---|---|---|---|---|---|
| PartSLIP | Averaging | 24.10 | 22.95 | 25.16 | 24.07 |
| PartSLIP | Normalized product | 23.74 | 22.92 | 24.76 | 23.81 |
| PartSLIP | Geometry weighting | 24.54 | 23.02 | 25.06 | 24.21 |
| PartSLIP | TRACE | 25.91 | 24.05 | 27.53 | 25.83 |
| PartSTAD | Averaging | 30.99 | 31.93 | 33.57 | 32.16 |
| PartSTAD | Normalized product | 30.31 | 31.83 | 33.27 | 31.80 |
| PartSTAD | Geometry weighting | 32.19 | 32.53 | 34.80 | 33.17 |
| PartSTAD | TRACE | 34.42 | 35.13 | 35.37 | 34.97 |
References
[1] Shilong Liu et al. Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection. ECCV, 2024.
Thank you for the detailed rebuttal. All my concerns have been satisfactorily addressed. The additional experiments support TRACE’s effectiveness across different view counts and detectors, while the conflict analysis and view-fusion baselines further validate the proposed design. I have decided to raise my score from 3 to 4.
Response to x8Yt (part I)
Thank you for your careful review and positive assessment of our work. We especially appreciate your recognition of the importance of robustness in 2D-to-3D perception and the value of reasoning jointly about cross-view evidence. Your constructive suggestions help us clarify TRACE’s applicability and strengthen its empirical evaluation. We address each concern below with additional results and methodology clarification.
W1 / Q1(a). Evidence with fewer valid views would help establish how broadly TRACE’s gains apply.
A1: Thank you for this constructive suggestion. We additionally evaluated TRACE with 6, 8, and 10 rendered views on both PartSLIP and PartSTAD under category shift. R-Table 11 shows that fewer views reduce visible-point coverage. At six views, ZeroSiam underperforms both frozen models, while TRACE improves their mIoU by 1.01 and 1.64%, respectively. TRACE consistently improves over the frozen models across all six configurations, supporting its effectiveness with fewer available views. We have included this experiment and its analysis in Section 6.4 of the revised manuscript.
R-Table 11: Effect of view count on category shift. Visible-point coverage is the percentage of points visible from at least one rendered view.
W1 / Q1(b). How does TRACE perform with a different 2D detector?
A2: Thank you for this valuable question. We replaced GLIP with Grounding DINO [1] in the PartSLIP pipeline under the six category-shift directions. R-Table 12 shows that TRACE outperforms the strongest compared baseline by +8.36% mIoU on average, with improvements in every direction. This gain exceeds that observed with the original GLIP-based PartSLIP, suggesting further potential when TRACE is paired with stronger detectors. We have included these results and analysis in Table 4 of the revised manuscript.
R-Table 12: Category-shift results on additional pipelines. PartSLIP + Grounding DINO replaces the detector with Grounding DINO.