- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents TopoAudit3D, a framework for evaluating the topology of reconstructed 3D objects. The work is motivated by the observation that 3D reconstructions can achieve low geometric errors in terms of Chamfer Distance (CD) and Hausdorff Distance (HD) while still exhibiting incorrect topology. The authors propose an evaluation method that converts different 3D representations into a common signed distance field (SDF) and compares their Betti numbers with those of the ground truth at multiple offsets. They also introduce a neural SDF model that refines coarse predictions through local corrections. Experiments on three cardiac datasets highlight discrepancies between geometric and topological evaluations, while ablation studies assess the proposed reconstruction model.
Critical strengths
- The proposed framework provides a systematic approach to evaluating the topology of 3D objects reconstructed using different methods, complementing conventional geometric metrics.
- The extensive experimental evaluation highlights discrepancies between geometric and topological measurements. The findings are supported by comparisons across multiple reconstruction methods and datasets, together with instance-level analysis. The controlled ablation studies provide additional insight into the proposed reconstruction model, while the authors acknowledge differences in input supervision.
Critical weaknesses
- The experimental evaluation is limited to cardiac datasets, leaving it unclear how well the framework generalizes to more complex, high-genus 3D shapes. In addition, the paper does not sufficiently investigate whether converting different 3D representations into a common SDF introduces topological artifacts, which could affect the reliability of the evaluation.
- The proposed reconstruction model uses substantially more supervision than the competing methods, limiting conclusions about their relative effectiveness. Moreover, the capacity-matched MLP achieves better mean results in the controlled ablation studies, raising questions about the additional value of the proposed architecture.
Questions for authors
Q1. How reliably can the proposed framework detect topological errors involving multiple handles, small holes, and narrow tunnels in high-genus shapes, such as those in Thingi10K, GSO, or Objaverse?
Q2. How sensitive are the reported topology measurements to the resolution and numerical choices used during SDF conversion, particularly for small holes and narrow tunnels?
Q3. How does the choice of SDF offsets affect the reported topology metrics, particularly when the number of reference-stable offsets varies across instances?