- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes VisLens, a visual search method for MLLMs that localizes query-relevant regions by decoding early visual tokens through a lightweight tuned lens. The resulting crops are combined with the original image for final answering, avoiding iterative LLM-based search. Experiments across three MLLM backbones show consistent gains on fine-grained visual search benchmarks and favorable accuracy–latency trade-offs
Critical strengths
- Efficient and well-motivated formulation. VisLens turns early visual representations into a practical localization mechanism before LLM processing, reducing the need for iterative search or tool-use rollouts.
- Strong empirical validation. The method gives consistent improvements across multiple backbones and benchmarks, with supporting ablations, detector controls, and failure analyses that align well with the proposed mechanism.
Critical weaknesses
Incomplete comparison with the closest prior work. FOCUS is closely related in using internal MLLM representations for localization, but is absent from the main accuracy–latency comparison. This weakens the claimed Pareto-frontier advantage.
Questions for authors
- Can the authors provide a same-backbone, same-hardware accuracy–latency comparison with FOCUS?
- Could the authors clarify whether “single forward pass” specifically means a single LLM forward pass?
3 comments
Dear Reviewer VPmL,
Thank you again for your review and positive assessment. In our rebuttal, we addressed your comments by:
- Expanding the discussion of FOCUS, explaining the architectural difference, and clarifying that our accuracy–latency Pareto comparison applies only to the evaluated baselines.
- Clarifying that "single forward pass" means a single LLM forward pass, and updating the manuscript at its first mention.
As we approach the end of the discussion period, we would appreciate hearing whether our responses have addressed your questions. We would be happy to provide any further clarifications.
Response by Reviewer
Thank you for your response.
I will maintain my rating of 3. Unfortunately, I am not very familiar with this research area, so my confidence score is 2.
I am also somewhat puzzled as to why several papers assigned to me for ICLR this year fall outside my areas of expertise. I would appreciate it if paper assignments could be more closely aligned with my broader research area, as they have been in previous years.
We thank the reviewer for the positive assessment, and for finding the formulation well motivated and the empirical validation strong. We address each question below.
We agree that FOCUS is an important related method and now discuss it more explicitly.
The key architectural distinction is where localization occurs:
Because FOCUS has not released code, we cannot provide a verified same-backbone, same-hardware comparison. We have therefore clarified that our measured accuracy–latency Pareto comparison applies to the evaluated baselines, without claiming an experimentally established advantage over FOCUS.
Yes. We mean a single LLM forward pass, not a single pass through the entire multimodal pipeline.
VisLens performs target extraction, lens decoding, and crop construction before LLM inference. It requires additional vision-encoder processing for the crops and lightweight lens computation, but no second LLM pass.
We have clarified this definition at the first mention in the revised manuscript.