- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
A convolution for genus 0 surfaces is introduced. It combines convolutions defined on the unit sphere with conformal spherical parametrizations. This allows for computing convolutions in a simpler setting (on the sphere as opposed to the general curved surface) using closed from formulas. Moreover, for parametrizations with low conformal distortion, symmetry properties of the convolutions on the sphere approximately transfer to the surface. Experiments on synthetic data indicate robustness and approximate equivariance of the proposed convolutions.
Critical strengths
(S1) The method allows for using closed from formulas for computing convolutions on surfaces at the cost of a one time computation of a spherical parametrization. This may make the method attractive in practice
(S2) The suggested approximate equivariance is open to an error analysis that combines explicit error sources such as the conformal distortion of the parametrization and quadrature errors.
Critical weaknesses
(W1) The proposed framework is restricted to surfaces of genus 0 and a conformal parametrization with low distortion. In many shape collections, not all surfaces satisfy these requirements. This may severely limit the practical applicability of the method. In addition, it may be hard to tell in advance whether or not the method is applicable to the data set, as even if all surfaces are of genus zero and do not have boundary, the conformal distortions may not be small enough.
(W2) The experimental evaluation is limited to synthetic data. In combination with (W1), I find that not enough experimental evaluation demonstrating that the proposed convolution is competitive with alternative convolutions for learning on surfaces is given. Results and comparisons to prior work on benchmarks could help to demonstrate this.
Questions for authors
I am wondering what happens when the conformal distortion of the spherical parametrization is high? In the theory, small conformal distortion is considered. In practice, bounding the conformal distortion for a whole collection of shapes may be difficult. Is there a distortion value at which distortion begins to significantly degrade equivariance or accuracy?
For which data sets, such as FAUST, would the method be applicable and what is the maximum conformal distortion for these data sets?
3 comments
Q2 — Applicable data sets, e.g. FAUST.
- FAUST is a failure case. The CMCF sphere maps compress the extremities extremely (34–43% of faces below of the uniform face area); with full-precision maps, 74 of 100 meshes pass a strict recovery test. On vertex correspondence, pmConv with the fixed polar stencil fails (0.33 top-1); a variant that takes its support from the two-ring mesh neighbourhood reaches 0.932, and GEM-CNN 0.994 (settings not matched). The diagnostics reveal the compression before training.
- ADNI hippocampi: 853 of 928 maps pass the screen (rejected: 6.3% of HC, 11.1% of AD). Angle distortion is low ( p99 median 1.34), but area distortion is strong.
- MNIST: near-conformal up to (at most 8 of 1000 meshes have a fold); folds are widespread only at the strongest setting.
W2 — Real data.
We add hippocampus surface classification on ADNI: Alzheimer's disease (AD) vs healthy controls (HC), five splits with disjoint test sets (641 of the 853 subjects), identical training rules for all models, and the pmConv operator as submitted. We use two inputs: unsigned mean curvature (the main input, fixed in advance) and vertex coordinates. The full tables for both inputs go to the appendix of the revised PDF.
- Ranking, curvature input. On the pilot fold (AUC, 3 seeds), pmConv-ResNet 0.834 ± 0.017 and pmConv 0.833 lead, followed by GEM-CNN 0.817, shallow GEM-CNN 0.812, SplineCNN 0.809, GCN 0.801 and MLP 0.799. Over the four remaining folds, the pmConv variants average 0.818–0.826 and the GEM-CNN variants 0.812–0.818.
- Locked comparison. We selected pmConv-ResNet vs GEM-CNN on the pilot and locked the comparison before running folds 2–5. The AUC difference averages +0.006 (positive in 3 of 4 folds), and all four DeLong intervals include zero.
- Coordinate input. SplineCNN, GEM-CNN and pmConv improve, to 0.838–0.856, and pmConv-ResNet (0.852) is within 0.004 of the best (SplineCNN); GCN drops. The coordinate encoding was chosen using pmConv results only.
- Caveats. The 75 maps that fail the screen are excluded for every model, the folds overlap in training and validation roles, and the intervals are unadjusted.
We read this as competitive performance among the evaluated surface models in the screened cohort; superiority is not established.
Summary. New in this response: diagnostics before training with distortion statistics per dataset, an exploratory error-versus-distortion analysis, FAUST as a failure case, the ADNI benchmark, and a revised Appendix A for the implemented sampler (revised PDF).
Thank you for the detailed answers. The additional experiments and analysis shed more light on the weaknesses. However, the weaknesses remain, and my rating has not changed.
We thank the reviewer for highlighting the closed-form computation and the error analysis. Two issues found since submission limit the submitted claims.
W1 / Q1 — High distortion: can one tell in advance?
This is a good question, and we explored it further for this response.
Short answer. Yes, the distortion can be measured before training, and the theory says how it enters. What we cannot give is a validated value at which accuracy or equivariance breaks down.
In more detail:
Diagnostics before training: folded or degenerate spherical faces, and q. Measured statistics:
"q median" and "q p99" are the per-mesh median and 99th percentile over faces, each summarised by its median over meshes.
Distortion vs. error on ADNI (exploratory), on 514 test subjects, within each diagnosis. Errors correlate with distortion for pmConv and for GEM-CNN, which does not use the sphere map, so the association may reflect the cohort. With curvature input, the pmConv−GEM error difference is unrelated to distortion (Spearman ρs=0.02 in HC, 0.04 in AD); with coordinate input it is related (+0.25, −0.28). No degradation threshold is identified.
Synthetic stress. The MNIST accuracies in the short answer span Table 1 from σ=2.0 to 4.5. The strongest setting has folds in almost every mesh, so this is evidence outside the injective-map setting.