- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The is a well-known conjecture that is often raised to explain why learning models in general are able to learn from finite samples even over high-dimensional data. Nonetheless, in many works this hypothesis is invoked without much theoretical rigor, and without an analysis of whether the space in which the data lie – or its (learned) representation – satisfies the geometric properties characteristic of manifolds. Hence, the authors propose the Geometric Manifoldness Index (GMI), an index to measure the "manifoldness" of point clouds based on two features of : the local intrinsic dimension and (Federer) reach. Combining these two into a single continuous metric, the authors are able to diagnose when and to what degree such conditions may not be fully satisfied. Experiments on synthetic datasets show the usefulness of the metric, though on so-called real-world data the results are more nuanced. Across raw images, autoencoder latents, token embeddings, and single-cell transcriptomics, many spaces score well below synthetic manifolds, per-class subsets score higher than pooled datasets, latent spaces become more manifold-like mainly under distributional regularization, and GMI shows no consistent relation with reconstruction quality. That is an interesting and important step toward a more informed use of the manifold hypothesis.
Critical strengths
S1. The authors seek to partially address one of the field's long-standing hypotheses, i.e., the manifold hypothesis. Their proposal is based on the analysis of how close data or (latent) representations are to a subclass of smooth embedded manifolds, through a fine-grained metric that captures two properties of such objects. Thus, the method is well-motivated and the authors do a good job in explaining it effectively. Moreover, the decomposition into and is useful in itself, as it separates dimension inconsistency from reach failures such as cusps and self-intersections.
S2. The metric aligns well with its expected behavior on data known to be coming from a manifold. Specifically, the synthetic dataset experiments show that it achieves higher values when samples come from a smooth embedded manifold, and generally lower values otherwise. For instance, it separates the Klein bottle embedded in from its self-intersecting immersion in , flags the junction of the lollipop, and degrades continuously under additive noise. The breadth of the study across modalities and the ablations on the main design choices are also valuable.
S3. The authors are transparent about the scope of the metric. As they put it, GMI is "an operational diagnostic rather than a certificate of manifoldness" (or lack thereof). The same care applies to its components: they state that measures the consistency, not the correctness, of the dimension estimates, they acknowledge that the reach score is a biased proxy, and they report the cases where is undefined or not invariant to reparametrization.
Critical weaknesses
W1. The paper's promise is bold: challenge informal uses of the manifold hypothesis. Nonetheless, the proposed method has a set of limitations, raised at the beginning, that make it more of an overpromise. (i) It is based on properties of a subclass of submanifolds embedded in Euclidean spaces, whose notion of smoothness is itself imprecise. Although "smooth" usually means , as in Definition 7, the paper also uses it for manifolds (Definition 1) and for loosely "well-behaved" structures (e.g., the "nearly-smooth" controls of Section 5). (ii) The second property (positive reach) is neither sufficient nor necessary for smooth manifolds, and smoothness implies positive reach only under further assumptions such as compactness. Even jointly, the two signatures cannot detect boundaries, which the introduction lists among the departures from a smooth manifold.
W2. Though the reach proxy helps with computational tractability, it is biased, and the bias does not seem to go in the direction the paper relies on. Section 4.2 argues that both relaxations can only raise . This holds relative to the plug-in minimum over the sampled pairs, but not relative to the true reach, since tangent-estimation errors and off-manifold noise typically enlarge the normal component in the denominator of Eq. (1). Indeed, Figure 18 places below the analytic reach for almost every shape, by about an order of magnitude for the circle and the ellipse, and an underestimated reach favors the paper's main claim. Moreover, since equation 7 normalizes by the median first-neighbor distance, also depends on the sampling density, and clean high-dimensional manifolds in Table 1 obtain values comparable to those of reach-zero shapes and not far from that of pure noise.
W3. The conclusions on real data are based on absolute GMI values and on their trend in , but neither is calibrated. Even for clean manifolds, GMI depends on the intrinsic dimension and on the sample size. For example, in Figure 12b, the tori and end at about the level of the self-intersecting shapes of Table 1, and GMI on decreases steadily with . Likewise, the less noisy sphere of Table 1 scores below the cone and both self-intersecting shapes, although Definition 1 allows data to lie in the vicinity of a manifold. Hence, neither the decline in Figure 5 nor per-class scores below the one-dimensional rotation orbit used as positive control are, by themselves, evidence against the manifold hypothesis.
W4. The related work and the paper's positioning are lacking. It would be interesting to have a more in-depth discussion of what has been proposed in the literature on the analysis of the conditions under which the manifold hypothesis might hold. The main text discusses only HADES (Lim et al., 2025) and the test of Robinson et al. (2025), while the literature seems to be much richer, e.g., the local-homology approaches of Bendich et al. (2012) and Stolz et al. (2020), the segmentation by local intrinsic dimension of Allegra et al. (2020), the multiscale local PCA of Little et al. (2017), and the reach estimator of Berenfeld et al. (2022). Since the building blocks of GMI are standard, this positioning is important.
References
- Allegra, M., Facco, E., Denti, F., Laio, A., and Mira, A. Data segmentation based on the local intrinsic dimension. Scientific Reports, 10, 2020.
- Bendich, P., Wang, B., and Mukherjee, S. Local homology transfer and stratification learning. In Proceedings of the ACM-SIAM Symposium on Discrete Algorithms (SODA), 2012.
- Berenfeld, C., Harvey, J., Hoffmann, M., and Shankar, K. Estimating the reach of a manifold via its convexity defect function. Discrete & Computational Geometry, 67, 2022.
- Little, A. V., Maggioni, M., and Rosasco, L. Multiscale geometric methods for data sets I: Multiscale SVD, noise and curvature. Applied and Computational Harmonic Analysis, 43(3), 2017.
- Stolz, B. J., Tanner, J., Harrington, H. A., and Nanda, V. Geometric anomaly detection in data. Proceedings of the National Academy of Sciences, 117(33), 2020.
Questions for authors
Q1. How does GMI behave as grows for noisy samples of a smooth manifold whose intrinsic dimension, ambient dimension, sample sizes, and noise level match those of the real datasets (e.g., with in the range of the published estimates in Table 3)? If GMI also declines with in that setting, how can the decline in Figure 5 be distinguished from data that lie in the vicinity of a manifold, which Definition 1 allows? A reference distribution of GMI under such matched controls would make the conclusions of Section 5.1 considerably more convincing.
Q2. Could the authors specify the synthetic shapes of Table 1 (construction, intrinsic dimension, embedding in , and noise model)? Figure 11 refers to a full catalogue in Appendix D that I could not find (possibly Table 1, but there is no reference).
I will closely follow the authors' response and update my assessment in case my concerns are addressed.
3 comments
response 2
W2: Bias and interpretation of the reach proxy.
We agree with the reviewer that our original discussion did not adequately distinguish between the effects of our computational approximations and the discrepancy between estimated and true Federer reach.
Restricting evaluated pairs and applying mean-then-min aggregation increases the estimate relative to the corresponding sampled pairwise minimum over the same estimated tangent spaces. However, this does not establish an upper bound on true Federer reach, since tangent-estimation errors, noise, and finite sampling may introduce bias in either direction.
We have clarified this distinction in Section 4.2. The resulting quantity is explicitly described as a computational proxy, rather than a statistically consistent estimator or bound on Federer reach.
We have also expanded the empirical analysis of this approximation in Section 5.2. Figure 6 compares the proxy against analytic Federer reach on geometries with known reach, illustrating its sensitivity to the underlying geometric scale while revealing discrepancies from the true values. Figure 7 further examines a sphere progressively flattened into an ellipsoid, showing that GMI decreases as the true reach approaches zero, even though the surface remains smooth for every positive thickness.
Additionally, Figure 8 compares alternative Federer-ratio aggregation strategies. The pairwise minimum is particularly sensitive to individual extreme estimates, whereas mean-then-min reduces this sensitivity but may obscure localised singularities. These experiments illustrate the trade-off underlying our design choice and motivate interpreting the reach component as an empirical geometric diagnostic rather than a precise reach estimator.
W3 and Q1: Calibration, sampling, and interpretation of real-world data.
We agree that absolute GMI values and their variation with sample size are insufficient to establish whether real-world observations are compatible with an underlying manifold. Instead, we have expanded Section 5 to systematically investigate how the diagnostic responds to controlled changes in geometry and sampling.
Section 5.3 examines increasing additive noise on synthetic manifolds, demonstrating that GMI provides a graded assessment of departures from regular geometry in the evaluated settings. Section 5.4 investigates sampling effects by comparing equally spaced observations with randomly selected subsets of the same image-rotation manifold. These experiments demonstrate that sampling nonuniformity alone can substantially affect GMI, even when the underlying geometry remains unchanged.
Regarding Q1, we agree that noisy-manifold reference distributions matched to real-world datasets in intrinsic dimension, ambient dimension, noise level, and sample size would be required for stronger conclusions about manifold compatibility. Our current experiments characterise these effects individually but do not provide fully matched reference distributions. Accordingly, the revised manuscript does not attempt such hypothesis-testing conclusions.
W4: Relation to existing geometric diagnostics.
We agree that GMI should be situated within the broader literature on geometric regularity, rather than being presented primarily as an alternative to manifold-hypothesis testing.
We have now expanded the Related Work section to incorporate the references suggested by the reviewer, including Allegra et al. (2020) on local intrinsic-dimension segmentation, Bendich et al. (2012) on local homology and stratification, Little et al. (2017) on multiscale geometric analysis, Stolz et al. (2020) on geometric anomaly detection, and Berenfeld et al. (2022) on reach estimation through convexity defects.
These works provide important complementary perspectives on identifying geometric irregularities and estimating properties of underlying data structures. Our objective differs in providing a single continuous diagnostic that combines local dimensional consistency with reach-related regularity, rather than performing statistical manifold-membership testing or estimating a particular geometric quantity in isolation.
We do not claim that GMI replaces these methods, but rather that it offers an interpretable and computationally tractable complementary tool for investigating geometric properties of finite point clouds.
Q2: Synthetic constructions and reproducibility.
We agree that the synthetic constructions should be sufficiently specified to permit reproduction and interpretation of the reported results.
Section 5.1 now clarifies the general sampling procedure: synthetic point clouds are generated by independently sampling the parameter spaces of known geometric shapes and mapping these samples into their ambient Euclidean embeddings.
We also provide representative visualisations (Figure 3), component-level results (Table 1), and additional investigations of local dimension and reach-related estimates (Figures 4–5).
response 3
Practical applications of GMI.
Beyond addressing the mathematical limitations, an important change to the manuscript is the explicit investigation of what GMI can be used for in practice.
Section 6 now presents four applications:
-
Diagnosing dataset heterogeneity: Comparing pooled datasets with semantic subsets reveals differences in geometric regularity and identifies whether these arise primarily from dimensional inconsistency or reach-related effects. For example, pooled MNIST exhibits greater variability in local dimension estimates than individual digit classes, illustrating how GMI can help diagnose geometric heterogeneity.
-
Analysing learned representations: Comparing autoencoder families reveals how different training objectives are associated with distinct geometric structures in latent space, including differences between class-specific and pooled representations.
-
Evaluating preprocessing choices: In single-cell transcriptomics, GMI reveals substantial sensitivity to PCA dimensionality in Puram, compared with greater stability in Baron2. We complement this analysis with quantitative neighbourhood-preservation measurements, illustrating how GMI can help assess the sensitivity of geometric analyses to representation choices.
-
Investigating representation quality: We examine whether greater geometric regularity corresponds to better reconstruction performance across autoencoder families. The relationship varies across training objectives, demonstrating that higher manifoldness does not necessarily accompany better reconstruction. GMI thus provides complementary information about representation geometry rather than a universal proxy for downstream performance.
We hope these revisions address the reviewer's concerns about the soundness and interpretation of GMI, while better communicating the diagnostic contribution originally intended.
response 1
We thank the reviewer for their careful and constructive assessment, particularly for recognising the value of combining local dimensional consistency with reach-related geometric regularity, and for highlighting the importance of explicitly characterising the limitations of GMI.
We agree that the original presentation placed excessive emphasis on challenging the manifold hypothesis, leading to conclusions stronger than those supported by our experiments. Our intended contribution was to develop, systematically characterise, and demonstrate the usefulness of GMI as a finite-sample diagnostic of geometric regularity, rather than to establish whether the manifold hypothesis holds or fails. We have substantially revised the manuscript to better communicate this objective.
The revised paper now separates the controlled characterisation of GMI (Section 5) from its practical applications (Section 6), while making its mathematical assumptions and limitations explicit.
W1: Geometric assumptions and scope of the diagnostic.
We agree that the original manuscript did not sufficiently distinguish between different notions of manifold smoothness and geometric regularity.
Section 3 now explicitly defines the reference setting as C1,1 embedded submanifolds with positive Federer reach and intrinsic dimension smaller than the ambient dimension. This is motivated by the framework of Fefferman et al. (2013), although we do not impose their volume constraint or claim to test membership in their manifold class.
We also agree that dimensional consistency and reach-related regularity do not constitute a complete characterisation of manifold structure. In particular, GMI does not reliably identify all boundaries or singularities, and a high score cannot certify that the underlying support is a regular embedded manifold. We now define manifoldness operationally, referring specifically to the two geometric properties assessed by GMI.