- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes AGFF-EMBED, a framework that combines global and fine-grained embeddings through multiple similarity patterns and LogSumExp aggregation, while incorporating explicit hard-negative gradient amplification (EGA). Although the method achieves promising results on MMEB and MMVP-VLM, the motivation and methodological contributions are not sufficiently justified. The introduction presents multi-granularity perception and hard-negative enhancement as separate motivations without establishing a coherent research objective. Moreover, the paper does not clearly demonstrate why existing MLLM embedding approaches are inadequate or why the proposed architectural choices are necessary. Consequently, the novelty and necessity of the proposed framework remain insufficiently established.
Critical strengths
-
The method is evaluated on MMEB and MMVP-VLM, with ablation studies examining individual components and additional analyses of computational overhead.
-
The paper addresses the challenge of matching multimodal inputs that require different levels of semantic granularity, which is relevant to general-purpose multimodal embedding.
Critical weaknesses
-
Unfocused motivation. The introduction first motivates multi-granularity perception and then shifts to hard-negative enhancement, combining them without establishing a coherent research objective. This makes the work appear to be a combination of two loosely related techniques rather than a unified methodological contribution.
-
Insufficiently justified problem formulation. The authors treat the diversity of matching tasks as evidence of limitations in existing MLLM embeddings, without demonstrating that current methods cannot adequately address these requirements. It remains unclear whether the limitations stem from single-vector representations, contrastive learning objectives, or the inadequacy of existing multi-vector and similarity interaction mechanisms.
-
unclear necessity of individual components. The method combines learnable prompt tokens, multiple embeddings, similarity aggregation, and EGA-based hard-negative gradient amplification. Improvements over the baseline do not establish the necessity of these individual components or justify why this particular combination is required.
Questions for authors
What is the central research problem that necessitates combining multi-granularity perception with hard-negative gradient amplification? Can the authors provide empirical evidence that existing MLLM embedding methods are insufficient for this problem and clarify why the proposed combination of learnable prompts, multiple embeddings, LogSumExp aggregation, and EGA is necessary, rather than a combination of loosely related techniques?