- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes to use Agglomerative Hierarchical Clustering (AHC) applied to random subsamples, followed by the respective subtree summation (SS). The resulting method AGD-SS is then a SS dissimilarity from random AHC forests. The paper aims to make the connection of AGD-SS with persistent homology (PH), discusses some theoretical stability results and evaluates it on real and synthetic data. I'd say the main strength of AGD-SS is its simplicity and tractability. While there's a potential, the paper in its current form seems to be quite far in terms of conveying novelty and clearly delineating the AGD-SS contributions from the already existing tools.
Critical strengths
The AGD-SS method is simple and tractable.
Critical weaknesses
While the paper overall reads well, it seems to be half-baked in its current form both in terms of methods and experiments.
The paper is vague mathematically. For example, the authors state "Manifold Topology Preservation: The method must correctly identify the topology (Persistent Homology (Chazal & Michel, 2021; Hausmann et al., 1995)) of the dataset." How is topology of the data defined and what is the relation to PH? One option is to formalize it through nerves and the Nerve theorem but it is not done.
Nothing is said on the dimension of topological features. Is it H_0 or H_1? So what is preserved then?
What is the selected scale in the PH pipeline? How sensitive the validation results to the choice of and the simplicial complex?
The paper does not present a proper comparison with the baselines, and overall, the list of competitors is very limited. For example, how do the kernel based methods perform here?
There is no ablation and sensitivity analysis.
Most importantly, the presented experiments do not convey sufficiently strongly why we need geodesic distances, that is, the epsilon that the existing methods cannot provide but AGD-SS brings. Examples from functional data analysis may be a potential source to highlight geodesic learning.
Questions for authors
See weaknesses above.