- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MINER, a lightweight plug-in framework that enhances single-vector visual document retrieval by extracting and fusing retrieval-relevant information from intermediate transformer layers. It combines CKA-based layer selection, alignment-aware probing, performance-adaptive neuron masking, and cross-layer fusion. Experiments on ViDoRe V1/V2/V3 show improvements across several dense retrieval backbones while preserving the index storage advantages of single-vector retrieval. The approach is practically motivated, but the novelty of its individual components, the fairness of the training comparisons, and the justification for several design choices require stronger evidence.
Critical strengths
1.The paper addresses the trade-off between retrieval quality and efficiency in visual document retrieval, aiming to improve single-vector retrieval without increasing index storage costs. 2.The experiments cover three backbones and ViDoRe V1/V2/V3, along with ablation studies, efficiency comparisons, and hyperparameter sensitivity analyses.
Critical weaknesses
1.Limited methodological novelty. Exploiting intermediate Transformer representations for retrieval and feature aggregation has been extensively studied. MLR (EMNLP 2025) investigates multi-layer representation aggregation for single-vector retrieval. Furthermore, SV-RAG (ICLR 2025) and URaG (AAAI 2026) demonstrate the retrieval capabilities of intermediate representations in MLLMs. Consequently, MINER's core motivation and overall methodology substantially overlap with prior work, with its contributions appearing largely limited to specific layer-selection and neuron-masking strategies.
2.Prior studies suggest that selecting an appropriate intermediate representation may outperform using the final-layer embedding. For example, SV-RAG reports better retrieval performance from an intermediate layer (Layer 21) than from the final layer, while FreeRet (ICML 2026) identifies lexicalization pressure in the final MLP of generative MLLMs, which can degrade semantic retrieval representations. However, MINER does not compare against a properly trained best-single-layer baseline or establish the necessity of including final-layer features in the fusion. It therefore remains unclear whether the proposed multi-layer fusion offers meaningful advantages over simpler intermediate-layer selection strategies.
3.The alignment ratio is defined as the quotient of cosine similarity and CKA, but its theoretical motivation and advantages over simpler layer-selection criteria are not sufficiently established. Moreover, replacing continuous feature weights with binary masks between the probing and fusion stages may introduce a representation mismatch.
4.MINER introduces additional contrastive training, making it difficult to distinguish the benefits of intermediate representation mining from those of additional supervised optimization. Performance gains are relatively modest in several settings.
References:
MLR (EMNLP 2025): Investigating Multi-layer Representations for Dense Passage Retrieval https://aclanthology.org/2025.findings-emnlp.1333/
SV-RAG (ICLR 2025): SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding https://proceedings.iclr.cc/paper_files/paper/2025/hash/0d40c7b4d78bf7f08ba532542818f6c0-Abstract-Conference.html
URaG (AAAI 2026): URaG: Unified Retrieval and Generation in Multimodal LLMs for Efficient Long Document Understanding https://ojs.aaai.org/index.php/AAAI/article/view/39729
FreeRet (ICML 2026): FreeRet: MLLMs as Training-Free Retrievers https://proceedings.mlr.press/v306/zhu26ba.html
Questions for authors
1.What are the fundamental methodological differences between MINER and existing approaches exploiting intermediate representations for retrieval, such as MLR, SV-RAG, and URaG?
2.Why is multi-layer fusion necessary instead of directly selecting the most retrieval-effective intermediate layer? Could the authors compare MINER with a best-single-layer baseline under matched training data and computational budgets?
3.Given FreeRet's findings on lexicalization pressure in the final MLP, why does MINER still use final-layer representations as cross-modal anchors and include them in the fusion? Would excluding the final layer improve retrieval performance?
4.Would a lightweight projection head trained on the best intermediate layer or the final layer with the same contrastive objective achieve comparable improvements?
5.Do the proposed alignment ratio and performance-adaptive masking provide significant benefits over fixed layer selection and simple weighted fusion?