- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces a feedforward model for predicting a collection of local geometrical properties (UDFs, normals, mean-curvature magnitude and Gaussian curvatures) from unoriented point clouds. Authors use a single point transformer to jointly predict those, trained on a purely synthetic dataset of quadratic patches. At inference, this approach samples a set of patches using farthest-point sampling, and uses predicted quantities at those patches to create a mesh: per-patch UDFs are fused into a single distance field, and normals and curvatures are then used for mesh refinement. Evaluation is conducted on a set of standard synthetic benchmarks and small set of real-world scans.
Critical strengths
- Strong performance on surface reconstruction and curvature accuracy. The method is either best or runner up on most metrics, and seems to be somewhat robust to noise. This is consequential since it suggests that a single model can jointly predict several quantities necessary for high-fidelity reconstructions, while generalizing from purely synthetic training data.
Critical weaknesses
- Idea of predicting SDF/UDF properties with a point transformer / pointnet is far from novel, such as LoSF-UDF. Apart from the baselines already mentioned in the paper, Points2Surf and PPSurf seem like established methods that also operate on (noisy) point clouds. It also looks like a lot of the baselines used are not the most recent (e.g. recent MPF, PrimitiveUDF are not compared to). Proposed approach does not advance existing architecture (takes an off-the-shelf point transformer) in a meaningful way, does not address scalability (final pipeline still requires per-shape fitting which can take >11mins). Overall, it seems like this work might be of limited interest to wider community.
- Results on normals are not SOTA, and method seems less robust to noise than some of the baselines, which makes the claims of the paper somewhat weaker.
Questions for authors
- Robustness to non-uniform sampling: would be great to have a discussion on whether non-uniformity of input point clouds (which is common in real-world data) significantly changes the result?
- How much of the gain is due to predicted UDF vs post-processing? E.g. it looks like in terms of inference-only UDF prediction PatchGF performs worse than some of the baselines?
- Could you elaborate on the key fundamental distinction with LoSF-UDF? That method also trains a UDF predictor on synthetic quadratic patches. Without a direct ablation on components it is hard to judge the difference.