- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies tangent-space estimation through local quadratic regression with a learned orientation, a free intercept, and no normal linear term. By profiling out the regression coefficients, it distinguishes coefficient conditioning, residualized linear separation, and full orientation curvature. Its main theoretical contribution is an explicit example showing that well-conditioned regression designs can coexist with a singular profiled Hessian. The paper also provides conditional recovery bounds, local optimization analysis, and numerical comparisons.
Critical strengths
The distinction between coefficient stability and orientation curvature is conceptually useful. The explicit cancellation construction, together with its extension to small asymmetric perturbations, provides a concrete illustration of this distinction. The experiments demonstrate improved recovery on noiseless quadratic data, and the authors are transparent about unfavorable results and the limitations of their guarantees.
Critical weaknesses
My main concern is the limited methodological and practical significance of the contribution. Joint tangent and polynomial estimation is well established, and the proposed formulation does not improve the known statistical rate. Although the local curvature analysis is interesting, the paper does not establish that this insight leads to a reliable diagnostic based on observed data, an effective algorithmic remedy, or improvements in a downstream learning task. The connection between theory and implementation also remains incomplete: the convergence results concern gradient descent within a suitably localized smooth basin, rather than the implemented L-BFGS procedure from PCA initialization (Appendix C.12). Empirically, the clearest benefit occurs on noiseless exact quadratic data. The matched comparisons do not establish an advantage over two-fit Jet estimation in the noisy quadratic settings, while full optimization has higher error in all six tested cubic-mismatch conditions (Section 4.4). External MMLS also achieves lower mean error in three of the four study categories in Table 1. Consequently, the additional optimization cost and complexity are not supported by a sufficiently compelling practical benefit. These concerns leave me unconvinced that the contribution warrants acceptance.
Questions for authors
What substantive capability does the proposed method provide beyond established local polynomial estimators and MMLS? Can the full residualized orientation Jacobian be estimated from observed data and used to improve initialization, neighborhood selection, or estimation accuracy? Can the convergence analysis be connected to the actual L-BFGS implementation and its practical parameter choices? Finally, which realistic data regime or downstream task demonstrates a clear benefit sufficient to justify full optimization over simpler one- or two-fit alternatives?