- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper analyzes the errors in two existing Riemannian MeanFlow methods and identifies three types of errors: endpoint errors, composition errors, and tangent-space errors. The authors provide detailed mathematical analyses of these errors, along with relatively clear proofs. To address these issues, the paper proposes an approach based on endpoint representations and multi-split geodesic semigroup consistency. The experiments first verify the existence of these errors, supporting the theoretical analysis. In subsequent experiments on real-world datasets, the proposed method achieves the best performance on several benchmarks across SO(3), Earth, RNA, and DNA.
Critical strengths
The paper identifies and addresses error issues in existing Riemannian MeanFlow methods. The proposed method is relatively robust to hyperparameter choices, and the additional computational cost remains within an acceptable range.
Critical weaknesses
-
The experimental results show that the proposed method does not achieve the best performance on all datasets. Does this suggest that its effectiveness still depends on the specific dataset, rather than providing a general solution to the identified errors? For example, if the model makes accurate predictions, there should be no tangent-space errors. Does the BSC loss still work if the manifold is not a Hadamard manifold?
-
Potential errors in JVP computation. In practice, JVP is used to compute the covariant derivative and covariant differentiation. However, JVP only provides the differential term and does not directly include the Christoffel symbol terms. Could this introduce additional hidden errors? If so, how much would these errors affect the actual results?
Questions for authors
see weaknesses.
4 comments
Q2: JVP connection corrections and their numerical effects.
A: We thank the reviewer for raising this concern. We agree that a standard JVP provides only the differential term and does not automatically include the connection correction. For Eulerian/LDI, however, the relevant quantity is the combination of both derivative terms in the complete training target. In the left-trivialized representation of SO(3), their connection corrections are and , respectively. Since within the chosen logarithm branch, their contributions cancel: Thus, an individual JVP differing from a covariant derivative does not imply an error in the combined LDI target.
To quantify the practical effect, we froze the model weights and inputs on Swiss (SO(3)) and Earthquake (), and compared the targets, losses, and gradients of all trainable parameters computed with raw JVPs versus full geometric corrections. On the sphere, the correction uses tangent-space projection. For Eulerian and BSC, all three discrepancies remain at numerical precision, approximately . These results show no observable target, loss, or gradient error from using raw JVPs for Eulerian/LDI or BSC in the tested settings.
This conclusion does not directly extend to PT, whose target lacks the log-map derivative term needed for the cancellation. For PT on Swiss, the target, loss, and relative gradient discrepancies are , , and , respectively. On Earthquake, the target and loss discrepancies are and , while the gradient discrepancy remains near numerical precision. The effect of connection terms therefore depends on the complete objective and geometric representation.
Table Target, loss, and gradient discrepancies between raw-JVP and covariant computations.
| Dataset | Method | |||
|---|---|---|---|---|
| Swiss | PT | |||
| Swiss | Eulerian | |||
| Swiss | BSC | |||
| Earthquake | PT | |||
| Earthquake | Eulerian | |||
| Earthquake | BSC |
Thank you for the detailed response and additional experiments. The authors have addressed all of my concerns.
Thank you for your time and constructive feedback, which has helped us improve the paper. We are glad that our responses and additional experiments have addressed all of your concerns.
We sincerely thank the reviewer for the thoughtful and constructive review and for the positive assessment of our paper’s soundness and informativeness. We particularly appreciate your recognition of our analysis of the errors in existing Riemannian MeanFlow formulations and of the experiments supporting that analysis. We are also grateful for your acknowledgment of the method’s robustness to hyperparameter choices and its acceptable computational overhead. It is encouraging that the paper helped deepen your understanding of these geometric issues. Your questions about dataset-dependent performance, applicability beyond Hadamard manifolds, and the implementation of covariant derivatives are valuable for clarifying both the scope of our claims and the numerical realization of the method. We address each point below and will revise the manuscript to make these aspects clearer.
Q1: Dataset-dependent gains, exact predictions, and applicability beyond Hadamard manifolds.
A: We thank the reviewer for these questions. We agree that the gains from BSC depend on the data distribution, manifold geometry, and model fit. Our aim is to identify and address geometric mismatches in finite-time generation, rather than guarantee the best performance on every dataset. In particular, the effect of the metric gap depends on displacement length and error direction; when this effect is weak or predictions are already sufficiently accurate, the additional benefit may be limited.
Regarding accurate predictions, we distinguish the two gaps. For the representation gap, perfectly fitting the parallel-transported path-average velocity does not necessarily recover the endpoint log-displacement required by the sampler. Thus, zero regression error need not imply zero endpoint error. For the metric gap, we agree with the reviewer: when the endpoint prediction is exact, both tangent-space and geodesic losses vanish. Our claim concerns how these losses weight nonzero prediction errors, rather than an incorrect realizable fixed point of endpoint-based methods. This distinction is discussed in Appendix D.1.
BSC also applies to non-Hadamard manifolds, as illustrated by our sphere and SO(3) experiments. The Hadamard assumption ensures a globally unique barycenter and the associated stability inequality; it is not required to define the BSC loss. Appendix E.2 provides a local extension: when the relevant endpoints lie in a common geodesically convex region and the Fréchet objective satisfies suitable strong-convexity conditions, a local stability guarantee holds with a curvature- and region-dependent constant. Uniqueness and smoothness can fail near the cut locus, so we do not claim an unconditional global guarantee on arbitrary non-Hadamard manifolds.