- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies intrinsic input sensitivity in hyperbolic residual networks of the form . For an aligned reference trajectory with structured covariant damping, it derives an exact differential and a unique contraction–expansion threshold governed jointly by curvature, residual displacement, and damping. It then provides sufficient bounds that allow derivative defects and turning, a constrained neural realization, depth-uniform neighborhood contraction, and finite-time cone escape. Numerical experiments check the formulas and certificates. With the original backbone parameters frozen, a correction that vanishes in value and first derivative at the reference points improves a synthetic nonlinear classification task while preserving the augmented backbone's reference trajectory and complete reference Jacobian product throughout correction training.
Critical strengths
-
The paper provides a precise, intrinsic account of the interaction between curvature, residual displacement, and covariant damping. The exact threshold is complemented by bounds allowing turning and derivative defects, a realizable constrained parameterization, and finite-neighborhood results.
-
The fixed-reference learning experiment is carefully controlled. Freezing the original backbone parameters and training a correction with zero value and derivative at each reference point preserves the augmented backbone's reference trajectory and full reference Jacobian product, while substantially improving XOR-type accuracy.
Critical weaknesses
My main concern is the significance and transferability of the insights beyond the controlled construction. The parameterization in Section 4.1 is expressly designed to satisfy the derivative and trajectory conditions, and it remains unclear how the resulting quantities would diagnose or guide a residual network outside this realization. The learning study does not substantially close this gap: a correction vanishing to first order can change nonlinear behavior in a general smooth coordinate chart, and the tested multiplicative correction supplies the type of second-order interaction required by the four-dimensional XOR task. Moreover, the input radius of 0.02 exceeds the reported sufficient contracting radii (Appendix C.4), so these experiments do not demonstrate how the finite-neighborhood certificates inform learning in the tested input regime. I recognize that the authors explicitly disclose these limitations, and the controlled results remain valid. Nevertheless, I am not yet persuaded that the combination yields a sufficiently substantial additional insight for acceptance.
Questions for authors
-
Could you provide a concrete vector-field or residual-network example beyond the realization in Section 4.1 for which , the derivative defect, and turning can be computed or estimated? What nontrivial propagation conclusion or design decision would the conditions reveal in that example? An analytic example would help establish the contribution's transferability without requiring a large-scale benchmark.
-
What additional learning insight is obtained from the fixed-reference experiment beyond the general freedom to change higher-order terms while preserving first-order information? In particular, is there a specific conclusion attributable to the curvature-dependent propagation analysis? A clear analytic comparison with the flat case, or a focused matched control, could help isolate the knowledge gained from this part of the study.