- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
For high-dimensional von Mises–Fisher learning, real numerical implementations can produce identical forward losses while supplying different gradients. The paper introduces the AR/FR, a fixed-depth analytic realization that constructs a potential and its derivative jointly, ensuring forward–backward coherence by construction, and establishes a uniform cubic-order error bound. It also tests classification and OOD detection under different numerical realizations.
Critical strengths
- Clear presentation. The figures and mathematical formulation clearly illustrate the distinction between approximation accuracy and forward–backward coherence, making the central problem and proposed construction easy to follow.
2.Theoretical support. The paper provides theoretical analyses of finite-recurrence errors and their implications for gradient consistency. It also establishes a uniform cubic-order error bound for the proposed Bessel ratio approximation and extends this guarantee to scores and fixed-state objectives.
Critical weaknesses
1.Limited applicability and insufficient evidence of practical significance. The proposed remedy targets vMF objectives involving high-order Bessel functions. Most models may do not have this numerical structure, which demonstrate limited applicability. And the current experiments provide limited evidence of its benefits across different learning applications. Moreover, Table 1 shows mixed downstream results, leaving insufficiently established when the identified gradient mismatch causes meaningful performance degradation and when correcting it is beneficial. Evaluations on additional vMF-based tasks, would help establish the scope and practical significance of the contribution.
2.Missing comparison with a closely related paired approximation. Scott et al. (2021) already approximate the Bessel ratio analytically and integrate it to obtain a corresponding normalizer surrogate, thereby providing a mathematically coherent, recurrence-free construction. However, the paper does not directly compare AR/FR against this approach. Consequently, the experiments do not establish the incremental benefit of the proposed approximation over an existing method that already provides these properties. Comparisons of numerical accuracy, and downstream performance of Scott et al. (2021) are needed to substantiate the advantage of AR/FR.
Questions for authors
1.The exposition lacks sufficient context and motivation. For example, AR and FR are introduced in lines 84–86 without a clear explanation of what they represent or how their roles in the method should be understood.
2.The derivation and motivation of Eq. (6) are not clearly explained. Specifically, it is unclear how this expression is obtained and why this particular functional form is chosen.