- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether existing hyperbolic vision-language models actually make meaningful use of hyperbolic geometry. The authors analyze several representative hyperbolic VLMs and find that their learned representations remain close to the Euclidean regime, while many entailment cones operate in a saturated regime. Motivated by these observations, they propose EuHier, a Euclidean hierarchy-aware VLM that retains whole-part compositional supervision without hyperbolic operations or entailment cones. Experiments on zero-shot classification, retrieval, hierarchical evaluation, and scene understanding show that EuHier performs competitively or better than the evaluated hyperbolic baselines, suggesting that part of the gains in prior work may come from additional whole-part/compositional supervision rather than hyperbolic geometry itself.
Critical strengths
S1. Comprehensive geometric analysis and empirical evaluation. The paper examines hyperbolic VLMs beyond downstream performance, including representation geometry, distance distortion, nearest-neighbor behavior, and entailment-cone saturation. The experiments also cover multiple models and downstream tasks, providing useful empirical observations.
Critical weaknesses
W1. Limited novelty and insufficient differentiation from prior work. A key part of the geometric diagnosis has already been studied in existing work. In particular, HyperConeNet (Wang et al., IEEE TCSVT 2026) has identified and analyzed the invalid cone-aperture domain and the saturation of half-aperture angles at pi/2 in MERU. These findings overlap directly with an important part of the present paper's motivation and analysis. Although the authors extend the investigation to additional hyperbolic VLMs and introduce EuHier, the paper does not sufficiently discuss this prior work or clearly establish the novelty of its additional contributions.
Relevant reference: Wang et al., Enhancing Hyperbolic Vision–Language Representations via Adaptive Apertures and Contrastive Entailment, IEEE TCSVT, 2026. https://doi.org/10.1109/TCSVT.2026.3701206
W2. Insufficient clarity and consistency in baseline reproduction. The paper's main geometric findings rely on retrained versions of existing hyperbolic VLMs, but the reproduction details and deviations from previously published results are not sufficiently explained. For example, using ViT-B/16, HyCoCLIP achieves 43.6 on ImageNet compared with 45.8 in its original results, with similarly noticeable drops on CIFAR-100 (55.9 vs. 60.1) and SUN397 (52.9 vs. 57.2). In contrast, the reproduced UNCHA results are generally much closer to its originally reported performance. I understand that results may vary across implementations and training settings, but such differences deserve a clearer explanation, especially since the paper draws its main geometric conclusions from these retrained models.
Questions for authors
Q1. Could the authors clarify how their geometric analysis differs from HyperConeNet (Wang et al., IEEE TCSVT 2026), particularly regarding the diagnosis of cone-aperture saturation? Additionally, I noticed a closely related preprint, Is the Geometry Doing the Work? (arXiv:2607.05268), which investigates several similar geometric phenomena in hyperbolic VLMs. It would be helpful if the authors could discuss the relationship between these findings and clarify the distinct contributions of the present work.
Relevant reference:
- Wang et al., Enhancing Hyperbolic Vision–Language Representations via Adaptive Apertures and Contrastive Entailment, IEEE TCSVT, 2026. https://doi.org/10.1109/TCSVT.2026.3701206
- Kim et al., Is the Geometry Doing the Work? An Operating-Point Audit of Hierarchy in Hyperbolic Vision-Language Models, arXiv:2607.05268, 2026. https://arxiv.org/abs/2607.05268
Q2. Could the authors clarify the baseline reproduction procedure, including whether official implementations were used and what modifications, if any, were made? How do the authors explain the differences between their reproduced HyCoCLIP results and the officially reported numbers, particularly on ImageNet, CIFAR-100, and SUN397? Have the main geometric findings also been verified using publicly released checkpoints?
Q3. What geometry does EuHier-H actually learn? Could the authors report the same geometric diagnostics used for the existing hyperbolic VLMs, such as curvature, embedding radii, and distance distortion? This would help clarify whether EuHier-H operates in a meaningfully hyperbolic regime and whether the contribution of geometry has been adequately isolated.
8 comments
Official Comment by Authors (2/4)
(A1 continued) We also acknowledge the closely related findings of contemporaneous work [2] on near-Euclidean representations and cone saturation. Our Euclidean training comparisons provide complementary evidence by evaluating the effects of part supervision and compositional objectives under matched settings. We additionally quantify pairwise distance changes and nearest-neighbor agreement using the same frozen representations. While it analyzes curvature gradients, our radial gradient analysis holds curvature fixed and separates the contributions of aperture widening and exterior angle reduction to the entailment loss.
Importantly, while recent works [1,3] address entailment cone collapse and evaluate their proposed loss components, an important question remains whether their performance gains require negative curvature. To examine whether competitive performance can be achieved without hyperbolic operations, we reproduced both methods and trained EuHier with one part per sample (Table A). ARGENT [3] performs comparably overall to CLIP trained with the same whole and part image–text pairs, while EuHier w/ 1-part outperforms both ARGENT and HyperConeNet across the reported metrics. EuHier also improves over CLIP with one part, indicating that how whole–part information is used matters beyond the number of part pairs. These results extend our empirical comparison beyond models using the original entailment cone objective and demonstrate that strong performance on the evaluated tasks can be achieved through compositional supervision without hyperbolic operations. Together with our geometric analysis, these findings highlight an important distinction between achieving strong downstream performance and demonstrating that the learned representations meaningfully exploit negative curvature. We will clarify these distinctions in the main text.
[Table. A] Additional comparisons with HyperConeNet and ARGENT. † denotes our reproduced results for the additional baselines.
\small \begin{array}{l|cc|cc|cc|ccccc} \hline & & \llap{\text{Classification}} & & \llap{\text{Text retrieval}} & & \llap{\text{Image retrieval}} & & & & \llap{\text{Hierarchical metrics}} & \\\\ \text{Model} & \text{ImageNet} & \text{Avg} & \text{COCO (R@5/10)} & \text{Flickr (R@5/10)} & \text{COCO (R@5/10)} & \text{Flickr (R@5/10)} & \text{TIE}\downarrow & \text{LCA}\downarrow & J\uparrow & P_H\uparrow & R_H\uparrow \\\\ \hline \text{CLIP} & 37.3 & 37.1 & 69.2/79.1 & 91.8/96.1 & 55.6/67.3 & 82.5/89.3 & 3.823 & 2.298 & 0.774 & 0.845 & 0.846 \\\\ \text{CLIP w/ 1-part} & 43.8 & 43.0 & 70.6/80.4 & 91.8/95.8 & 57.1/68.3 & 83.4/89.8 & 3.317 & 2.096 & 0.804 & 0.867 & 0.866 \\\\ \text{HyperConeNet}^{\dagger} & 37.0 & 37.2 & 67.2/78.3 & 90.4/95.1 & 55.3/67.0 & 82.0/88.2 & 3.850 & 2.290 & 0.772 & 0.845 & 0.844 \\\\ \text{ARGENT}^{\dagger} & 43.9 & 42.8 & 70.9/81.0 & 92.9/96.3 & 58.0/69.3 & 84.4/90.7 & 3.360 & 2.100 & 0.802 & 0.864 & 0.865 \\\\ \text{EuHier w/ 1-part} & \underline{48.3} & \underline{45.3} & \underline{72.3}/\underline{82.1} & \underline{93.8}/\underline{96.8} & \underline{59.3}/\underline{70.6} & \underline{85.8}/\underline{91.9} & \underline{2.980} & \underline{1.980} & \underline{0.826} & \underline{0.881} & \underline{0.882} \\\\ \text{EuHier w/ 5-part} & \mathbf{49.5} & \mathbf{45.9} & \mathbf{75.0}/\mathbf{83.8} & \mathbf{94.7}/\mathbf{97.6} & \mathbf{62.4}/\mathbf{72.9} & \mathbf{88.1}/\mathbf{93.3} & \mathbf{2.884} & \mathbf{1.950} & \mathbf{0.833} & \mathbf{0.885} & \mathbf{0.887} \\\\ \hline \end{array} }$$ - [1] Wang et al., Enhancing Hyperbolic Vision–Language Representations via Adaptive Apertures and Contrastive Entailment, IEEE TCSVT, 2026. - [2] Kim et al., Is the Geometry Doing the Work? An Operating-Point Audit of Hierarchy in Hyperbolic Vision-Language Models, arXiv:2607.05268, 2026. - [3] Huynh, Chuong, et al., Argent: Adaptive hierarchical image-text representations, ECCV, 2026.Official Comment by Authors (3/4)
A2. Baseline reproduction and validation with official checkpoints
We appreciate the reviewer's emphasis on reproducibility. We used the official implementations released by the respective authors for all baselines. When reconstructing GRIT, we encountered expired image URLs, an issue also reported in PHyCLIP, and recovered approximately 13M of the original 20.5M image–text pairs. The resulting differences in training data size and composition may partly explain the performance discrepancies observed on certain datasets. Nevertheless, comparing models under the same training conditions is essential for consistently evaluating their relative performance and learned geometry. We therefore retrained all baselines using the same reconstructed dataset, backbone, and training budget, reporting the mean and standard deviation over three independent runs.
Importantly, we also verified our main geometric findings using the publicly released MERU, HyCoCLIP, and UNCHA checkpoints with both ViT-B and ViT-S backbones. As shown in the Table.B-C, the reported G_pos and G_neg values do not exceed 0.65%, NNA@1 ranges from 99.14% to 99.98%, and saturation rates for the evaluated text-parent cones range from 95.33% to 100%. These results confirm that the near-Euclidean behavior and cone saturation are not confined to models retrained under our experimental setup.
[Table. B] Point geometric analysis of the released checkpoints.
\small \begin{array}{l|c|l|rr} \hline \text{Model} & \text{Backbone} & \text{Modality} & r & T \\\\ \hline \text{MERU} & \text{ViT-B} & \text{text} & 0.198 & 1.0065 \\\\ & & \text{img} & 0.299 & 1.0150 \\\\ \hdashline \text{MERU} & \text{ViT-S} & \text{text} & 0.198 & 1.0066 \\\\ & & \text{img} & 0.294 & 1.0145 \\\\ \hline \text{HyCoCLIP} & \text{ViT-B} & \text{part text} & 0.130 & 1.0028 \\\\ & & \text{text} & 0.141 & 1.0033 \\\\ & & \text{part img} & 0.203 & 1.0068 \\\\ & & \text{img} & 0.204 & 1.0069 \\\\ \hdashline \text{HyCoCLIP} & \text{ViT-S} & \text{part text} & 0.133 & 1.0029 \\\\ & & \text{text} & 0.145 & 1.0035 \\\\ & & \text{part img} & 0.202 & 1.0068 \\\\ & & \text{img} & 0.203 & 1.0069 \\\\ \hline \text{UNCHA} & \text{ViT-B} & \text{part text} & 0.200 & 1.0066 \\\\ & & \text{text} & 0.199 & 1.0066 \\\\ & & \text{part img} & 0.409 & 1.0281 \\\\ & & \text{img} & 0.409 & 1.0281 \\\\ \hdashline \text{UNCHA} & \text{ViT-S} & \text{part text} & 0.200 & 1.0067 \\\\ & & \text{text} & 0.200 & 1.0067 \\\\ & & \text{part img} & 0.394 & 1.0261 \\\\ & & \text{img} & 0.394 & 1.0261 \\\\ \hline \end{array} }$$ **[Table. C] Pairwise geometric and cone validity analysis of the released checkpoints.** $${ \small \begin{array}{l|c|l|rrrr} \hline \text{Model} & \text{Backbone} & \text{Modality} & G_{\mathrm{pos}} & G_{\mathrm{neg}} & \text{NNA@1} & S_{\mathrm{final}} \\\\ \hline \text{MERU} & \text{ViT-B} & \text{text}\to\text{img} & 0.64\\% & 0.65\\% & 99.92\\% & 99.58\\% \\\\ \hdashline \text{MERU} & \text{ViT-S} & \text{text}\to\text{img} & 0.65\\% & 0.65\\% & 99.94\\% & 99.41\\% \\\\ \hline \text{HyCoCLIP} & \text{ViT-B} & \text{part text}\to\text{part img} & 0.27\\% & 0.27\\% & 99.88\\% & 100.0\\% \\\\ & & \text{part text}\to\text{img} & 0.27\\% & 0.27\\% & 99.92\\% & 100.0\\% \\\\ & & \text{text}\to\text{part img} & 0.33\\% & 0.33\\% & 99.94\\% & 100.0\\% \\\\ & & \text{text}\to\text{img} & 0.33\\% & 0.33\\% & 99.98\\% & 100.0\\% \\\\ \hdashline \text{HyCoCLIP} & \text{ViT-S} & \text{part text}\to\text{part img} & 0.29\\% & 0.28\\% & 99.84\\% & 100.0\\% \\\\ & & \text{part text}\to\text{img} & 0.28\\% & 0.29\\% & 99.91\\% & 100.0\\% \\\\ & & \text{text}\to\text{part img} & 0.35\\% & 0.35\\% & 99.95\\% & 100.0\\% \\\\ & & \text{text}\to\text{img} & 0.34\\% & 0.35\\% & 99.97\\% & 100.0\\% \\\\ \hline \text{UNCHA} & \text{ViT-B} & \text{part text}\to\text{part img} & 0.63\\% & 0.60\\% & 99.18\\% & 98.31\\% \\\\ & & \text{part text}\to\text{img} & 0.63\\% & 0.60\\% & 99.14\\% & 98.31\\% \\\\ & & \text{text}\to\text{part img} & 0.63\\% & 0.61\\% & 99.66\\% & 97.34\\% \\\\ & & \text{text}\to\text{img} & 0.62\\% & 0.61\\% & 99.67\\% & 97.34\\% \\\\ \hdashline \text{UNCHA} & \text{ViT-S} & \text{part text}\to\text{part img} & 0.63\\% & 0.60\\% & 99.29\\% & 97.94\\% \\\\ & & \text{part text}\to\text{img} & 0.63\\% & 0.61\\% & 99.36\\% & 97.94\\% \\\\ & & \text{text}\to\text{part img} & 0.64\\% & 0.62\\% & 99.56\\% & 95.33\\% \\\\ & & \text{text}\to\text{img} & 0.63\\% & 0.62\\% & 99.71\\% & 95.33\\% \\\\ \hline \end{array} }$$
Official Comment by Authors (1/4)
We thank the reviewer for their detailed assessment. We address the concerns below and provide additional analyses to clarify our findings.
A1. Distinct contributions and comparison with related work
We thank the reviewer for pointing out these closely related studies. We agree that their relationship to our work should be clearer in the main text. HyperConeNet [1] previously identified the invalid aperture domain and cone saturation in MERU. Our study extends beyond this diagnosis through the following analyses and empirical comparisons.
Quantifying the effect of curvature on learned representations. HyperConeNet examines cone apertures, negative containment, and radial organization. We extend the geometric diagnostics with a systematic, multi-level evaluation to investigate whether comparisons between learned embeddings materially depend on negative curvature, connecting local curvature exposure and cone validity to pairwise distance distortion and nearest neighbor decisions. With the representations fixed, we compare hyperbolic distances with Euclidean distances in the tangent space at the origin. The small distance changes and nearly unchanged nearest neighbor decisions in Table 1 demonstrate the limited influence of the hyperbolic metric on embedding comparisons in the evaluated models. This connects geometric diagnostics to actual similarity decisions, providing quantitative evidence of the practical effect of negative curvature beyond cone validity alone. Also, our analysis covers more advanced models, including HyCoCLIP, PHyCLIP and UNCHA, and finds the same behavior even in UNCHA despite its more extensive compositional supervision.
Separating the mechanisms of radial contraction. HyperConeNet describes the original entailment loss as a hard-threshold mechanism that lacks constraints on negative samples. We further show that even an active positive entailment penalty can decrease through parent contraction within the valid cone domain, before aperture clipping occurs. Contraction both widens the aperture and decreases the exterior angle while the child embedding, curvature, and radial directions remain fixed. We derive these gradient contributions and measure them during early training. In HyCoCLIP, the exterior angle contribution is larger on average over all active pairs, whereas the aperture contribution is larger near the valid cone boundary (Section 3.4 and Appendix D.2). Thus, our analysis identifies how the active objective can reduce its penalty through radial contraction, beyond the absence of penalties for negatives inside the cones.
Examining the role of compositional supervision. HyperConeNet evaluates improvements to a hyperbolic formulation. Beyond improving the hyperbolic objective, we ask whether strong performance from whole–part supervision requires hyperbolic operations. EuHier serves as a simple Euclidean reference for this question, using compositional contrastive supervision without entailment cones.