- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies on-manifold peripheral anomalies: observations that remain close to a low-dimensional manifold but are peripheral relative to the distribution’s intrinsic geometry. It proposes Iso-depth, a three-stage framework that estimates intrinsic coordinates using ISOMAP, computes statistical depth in the resulting embedding, and trains a neural network to predict these depth values directly from the original observations.
Critical strengths
-
A coherent geometric formulation supported by a useful stability analysis. The paper identifies an interpretable detection objective: global peripherality measured along the manifold, rather than distance from the manifold or local neighborhood isolation.
-
The controlled experiments are informative and address several sources of error separately. The synthetic evaluation is more informative than a single aggregate detection table. Figure 1 on page 8 separates sampling error from geometry-induced depth error and compares neural predictors trained on estimated versus population depth targets.
Critical weaknesses
-
The experiments do not sufficiently isolate the benefit of statistical depth over simpler intrinsic-centrality scores. The paper’s main distinction is between global intrinsic peripherality and local isolation. However, the most informative matched-embedding comparator is LOF, which addresses the latter objective. The reported baseline set does not include a simple global-centrality score on the same recovered coordinates, such as distance from an estimated center, or a score based on average graph distance. Consequently, it remains unclear how much of the gain requires statistical depth specifically, rather than unfolding the data and applying any suitable global-peripherality measure.
-
The real-data evidence does not convincingly validate the proposed intrinsic-geometric mechanism The paper transparently states that Cardio was selected after exploratory comparisons among candidate datasets. It also applies a dataset-specific adjustment to the fetal-movement feature’s scale, and explicitly states that this adjustment is not proposed as a general preprocessing rule. Thus, the only real-data case is an exploratory, specially configured example rather than independent validation of a reusable procedure.
-
The effectiveness of proposed method on real datasets compared with other recent baselines reamins unknown. The authors only select one real dataset from ADBench for case study, but its performance on other 46 datasets reamins unknown.
Questions for authors
See Weaknesses.
We appreciate the reviewer for asking us to isolate the contribution of statistical depth, clarify what the Cardio case establishes, and assess Iso-Depth on a broader set of real datasets.
Tukey depth is the least probability mass in any halfspace containing a point. A point midway along a long boundary can have low depth even when its distance from the center and average distance to other observations are modest. Distance from an estimated center measures radial separation. Mahalanobis distance adjusts for scatter but retains ellipsoidal contours. Mean graph distance averages shortest-path distances to all observations. Since ISOMAP does not impose elliptical contours, these scores can miss boundary points that depth detects.
Across 100 Swiss-roll seeds, mean AP was 0.3402 for depth, 0.1961 for Mahalanobis distance, and 0.1671 for distance from the sample mean on the same recovered coordinates. Mean graph distance achieved 0.1739. The paired AP gain over Mahalanobis distance was 0.1441 (exploratory, unadjusted 95% interval [0.1303, 0.1579]). Among each method's top 30, pooled recall along the middle of the long edges was 20.7% for depth versus 0.4% for Mahalanobis distance, with fractional weighting of cutoff ties.
Prior studies reconstructed phase-space attractors from fetal heart rate recordings [1] and estimated attractor manifolds from cardiotocography signals [2]. This motivates examining geometric structure in Cardio's derived features.
We scaled features to make their different units comparable. Under ordinary IQR scaling, fetal movement (FM) accounted for 94.9% of total pairwise squared distance because its IQR was small relative to its spread. We imposed a lower bound on its scaling denominator so other features could contribute to graph construction. This adjustment used feature values alone, without pathology labels, and retained all observations and values.
At a fixed ISOMAP dimension of two, Iso-Depth achieved AP of 0.538 under standard scaling, 0.558 under ordinary IQR scaling, and 0.596 after the FM adjustment. Under ordinary IQR scaling, PCA-Depth achieved AP of 0.259 and LOF on the same embedding achieved a best AP of 0.304 across four neighborhood sizes. After adjustment, AP was 0.245 for PCA-Depth and 0.167 for the reported embedded LOF baseline. The advantage over these comparators was already present before adjustment. Among the top 176 ranks, Iso-Depth identified 98 pathological recordings before adjustment and 104 afterwards, compared with 93 for ECOD.
Cardio is an exploratory demonstration. Q3 discusses datasets where geometric extremes can be defined independently of the embedding for a more direct assessment.
References
[1] Chaffin, D. G., Goldberg, C. C., and Reed, K. L. (1991). The dimension of chaos in the fetal heart rate. American Journal of Obstetrics and Gynecology, 165(5), 1425–1429. DOI [2] Feng, G., Heiselman, C., Quirk, J. G., and Djurić, P. M. (2023). Cardiotocography analysis by empirical dynamic modeling and Gaussian processes. Frontiers in Bioengineering and Biotechnology, 10, 1057807. DOI
Answer to Q3.
Iso-Depth targets geometric extremes, which can have close neighbors and escape LOF. Its use requires a meaningful reference population, a defensible metric, and evidence linking anomalies to structural extremes.
Across 20 ADBench datasets and 10 seeds per dataset, provisional transductive average AUROC/AP were 0.6734/0.3005 for Iso-Depth, 0.6845/0.2915 for ambient depth, 0.6422/0.2694 for MDS depth, 0.7505/0.4580 for Isolation Forest, 0.6064/0.2794 for ambient LOF, and 0.6077/0.3108 for OCSVM. Iso-Depth exceeded MDS depth and LOF on both average metrics.
We selected COIL-100 [1] because controlled rotation provides a known circular parameter. It has 72 views per object at 5-degree intervals. Removing an arc creates two endpoints. With no original anomaly labels, we marked the three retained views nearest each endpoint as positives using rotation angles, independently of detector scores. Mean AUROC was 0.777 for Iso-Depth and 0.723 for same-embedding LOF. This tests constructed boundary retrieval, whose practical relevance requires separate validation.
On Extended Yale B [2,3], we defined targets by a pose-lighting combination. Iso-Depth had lower AUROC than MDS depth (0.488 versus 0.560). Known acquisition parameters alone therefore do not guarantee better detection.
References [1] Nene, Nayar, Murase. Columbia Object Image Library (COIL-100). CUCS-006-96, Columbia University, 1996. [2] Georghiades, Belhumeur, Kriegman. From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE TPAMI 23:643-660, 2001. doi:10.1109/34.927464. [3] Lee, Ho, Kriegman. Acquiring linear subspaces for face recognition under variable lighting. IEEE TPAMI 27:684-698, 2005. doi:10.1109/TPAMI.2005.92.