acceptodds
Under review as a conference paper at ICLR 2027

RAP: Radial-Angular Random Projection for Hyperbolic Representations

Abstract

Random projection is a basic compression primitive for Euclidean representation learning, with the Johnson–Lindenstrauss lemma giving a target dimension independent of the ambient dimension. As hyperbolic representations gain increasing attention in modern Transformers, vision-language models, and large language models, the same need for oblivious dimensionality reduction arises, but no analogous primitive yet exists for hyperbolic representations. We study this gap. Two natural attempts fail in dual ways: a tangent-space scheme gives a clean local guarantee but is chart-bound and pays a curvature penalty, while a fully hyperbolic projection in the hyperboloid model is geometrically native but mixes radial and angular error before feeding them into the conditioning of . We propose radial-angular random projection (RAP), which preserves the radial coordinate exactly and applies a Euclidean random projection only to the angular direction, lifting the result back to the target hyperboloid. RAP is hyperbolic-to-hyperbolic by construction, costs one Gaussian matrix-vector product, and reduces hyperbolic compression to a normalized angular JL question on . We prove a finite-set RAP guarantee with explicit conditioning, complemented by a local tangent-space JL theorem and an arcosh-conditioning lemma for the fully hyperbolic comparator. Across an origin-centered broad-radius point cloud, a balanced tree, a clustered Gaussian, and the WordNet noun hierarchy, RAP attains the lowest mean relative distortion in every cell, reducing distortion over the strongest hyperbolic baseline by roughly an order of magnitude on broad-radius data. RAP also scales efficiently to million-point datasets and delivers improved retrieval performance on vision–language representations. Code is available in an anonymous repository: https://anonymous.4open.science/r/RAP-0C10/README.md.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.