- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the geometric structure of errors in monocular surface-normal estimation beyond conventional angular-error metrics. It introduces two complementary analyses: continuous generalized bas-relief (GBR) fitting to characterize global prediction–reference discrepancies, and a prediction-only curl score to assess local geometric inconsistency.
Experiments across four normal estimators show that matched predictions tend to exhibit low-shear GBR structure, while the fitted relief parameter correlates with held-out angular error. The curl score achieves AUROC values of 0.772–0.913 for identifying the worst 10% of predictions on NYUv2, outperforming normal roughness. Additional experiments include correspondence-breaking controls, selective prediction, and cross-dataset evaluation.
Critical strengths
-
The paper addresses an important limitation of angular-error metrics by examining how prediction errors are geometrically structured. Its evaluation across four different architectures, together with correspondence-breaking controls and pixel cross-fitting, provides evidence that the observed patterns are not purely incidental.
-
The curl score requires neither retraining nor additional network inference. Its consistent improvements over roughness, together with supplementary TTA comparisons and iBims-1 evaluation, demonstrate promising practical value for identifying unreliable predictions.
Critical weaknesses
Although matched predictions exhibit low fitted shear, this does not establish that GBR explains a dominant portion of their errors. Substantial angular errors remain after full GBR fitting (e.g., 35.19° to 32.71° for Marigold and 33.74° to 31.41° for MoGe-2 in Table 1).
Furthermore, GBR is not compared with alternative low-dimensional transformations of comparable complexity. The random pixel cross-fitting protocol also does not establish transferability across spatially distinct regions. The NYUv2–GSO comparison changes both projection geometry and scene content, making the interpretation of the lower shear on GSO less conclusive.
Consequently, the evidence supports GBR as a useful diagnostic representation but does not yet fully establish it as a distinctive, general failure structure.
The curl formulation follows integrability conditions under an orthographic height-field model, whereas the primary experiments involve perspective images. Although Appendix K mentions perspective-correct alternatives, quantitative evidence is limited.
Moreover, an integrable normal field can still exhibit substantial systematic angular error. Thus, curl measures local consistency rather than accuracy itself. Stronger controls are needed to establish whether its predictive advantage specifically reflects integrability violations rather than boundary complexity, surface orientations, or numerical effects.
The novelty discussion should also better distinguish this work from prior integrability-based normal estimation (e.g., Yoon et al., ECCV 2016) and surface-normal uncertainty estimation (e.g., Bae et al., ICCV 2021).
Questions for authors
1. Can the authors quantitatively compare the proposed curl score with perspective-correct formulations and boundary-masked variants on the full reliability evaluation set? Does its advantage persist after controlling for surface-orientation and boundary effects?
2. How much of the original angular error is explained by GBR compared with alternative global transformations of similar complexity? Does GBR fitting remain effective when evaluated on spatially contiguous held-out regions rather than randomly sampled pixels?
3. Can the authors clarify the reference-normal generation, curl implementation, and evaluation protocols, and provide the main experimental code or per-image results? The supplied supplementary code primarily reproduces a GBR visualization rather than the paper's principal quantitative experiments.