- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces ALP - alignment preserving projection for reducing the embedding dimensions of a CLIP-like model. The method essentially trains linear layer projections on top of both modality encoders, distilling the original teacher scores. ALP is evaluated against COCO with PCA and Matryoshka representation learning as a baselines.
Critical strengths
Performing an empirical study on various vector compression techniques would be beneficial for the community, so given a substantial extension this paper has a good potential.
Critical weaknesses
-
This paper introduces nothing novel. Compressing the embedding through linear projection is a widely used technique in practice across all over areas of information retrieval, as well as logit-level distillation from the original model.
-
While an empirical study of various vector compression techniques could be beneficial to the community, the current study is very narrow:
- The method was examined only for CLIP which is now very outdated. The study should be extended to other models such as SigLIP, MetaClip, DFN and SOTA clip-like models such as SigLIP2, PE etc.
- The evaluation should be extended to more benchmarks, covering (possibly) multilingual retrieval (XM3600), zero-shot image classification (ImageNet and its variants) etc.
- In practice, the vector is usually quantized before saved in an ANN index, and very rarely saved in FP32. For instance, 8-bit quantisation which is very common achieves the same effect in terms of memory. Such a study should cover the performance in conjunction with vector quantisation methods.
Questions for authors
See above.