- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the geometric properties of population CLIP loss. It first characterizes the optima of the alignment and repulsion components of the loss, respectively. It then gives the asymptotic optimal bound for the uniform diagonal configuration. The authors further regard the midpoint of the image-text pairs as a prototype; under the temperature condition, the paper describes unrestricted and fixed-gap population optima for the prototype objective, deriving a Gaussian limit for fixed-dimensional projection. Experiments show improvements in terms of geometric metrics on MS-COCO and CC3M, but the downstream performance varies.
Critical strengths
-
Theorem 5 provides a meaningful geometric characterization. The paper gives a sharp inverse-temperature threshold for the prototype objective to achieve both perfect alignment and spherical uniformity, and further characterizes the optimal prototype law for a fixed second moment. I find this is the paper's most distinct theoretical increment beyond previous alignment-uniformity explanations.
-
The experiments support the claim that the proposed objective can substantially change the geometry from pretrained models. The comparison fixed the architecture, initialization, and batch size, and only replaced the loss. The centroid gap, uniformity, and coordinate KS all show improvements on MS-COCO and CC3M.
Critical weaknesses
- The theoretical increments are modest, and the positioning against previous work deserves more careful consideration.
Particularly, Cai et al. (2026) have analyzed cross-modal divergence from the population energy view. Dufumier et al. (2023) have proposed centroid repulsion and characterized spherical uniformity of the centroids in the asymptotic regime under perfect alignment. The derivation of Gaussian projections from spherical uniformity has already been proposed in Betser et al. (2026). So, the major contribution of this work should be more concentrated on the temperature thresholding and fixed-gap characterization in Theorem 5, rather than repulsion or Gaussianity themselves.
Also, Theorems 1, 2 only demonstrate that the optima of the two components are not compatible, but this does not mean the CLIP loss optimum necessarily entails a nonvanishing gap. Theorem 4 provides a necessary condition for outperforming uniform reference, which does not prove that such a configuration must exist. I realize this limitation is acknowledged, but these results appear insufficient to establish that this tradeoff explains the modality gap observed in pretrained CLIP-like models.
- The theoretical claim does not fully align with the experimental evaluation.
The fixed-gap results are derived from unrestricted triplets. Yet, a fixed gap cannot ensure that the optimal uniform prototype law on the sphere of radius can be realized by separate encoders from given data distributions. Lemma 4 does not address this realizability. Besides, HGR gives an upper bound of , which makes the claim that the "whose radius is determined by HGR" in the Abstract feel like an overclaim compared to what it supports.
Experiments did not evaluate this fixed-gap geometry directly either. For , Theorem 6 is for the prototype distribution, whereas Figure 4 evaluates the embedding coordinates pooled from the two modalities. Also, the paired gap in Table 1 is still about 1.17, which cannot be treated as a perfect-alignment situation. The current experiments support improvements in terms of coordinate statistics, but is insufficient to support the theoretical claims.
References:
Dufumier B, Barbano C A, Louiset R, et al. Integrating Prior Knowledge in Contrastive Learning with Kernel. International Conference on Machine Learning. ICML 2023.
Betser R, Gofer E, Levi M Y, et al. InfoNCE Induces Gaussian Distribution. ICLR 2026.
Cai Y, Zhang Z, Liu Y, et al. The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence. ICML 2026.
Questions for authors
-
I suggest the authors to address the positioning of the work against previous analyses more carefully. For example, compare the analytical object, assumptions, and claims more clearly with Cat et al. (2026) and Dufumier et al. (2023). Besides temperature thresholding and fixed-gap characterization, what are the new findings that cannot be derived from prior work?
-
For a fixed raw image-text joint distribution, what condition may characterize that the uniform prototype law on the sphere of radius can be realized from the separate encoders?
-
When the paired gap is nonzero, why does Figure 4 report the pooled modality coordinate, not the prototype characterized in Theorem 6? Does the experiment align with theoretical predictions if you directly measure the radius distribution and the projection distribution of the prototype?