- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper proposes a training-free visual search method (SAGE) to solve fine-grained details perception in high-resolution images. SAGE consists of a bottom-up surprise module and a top-down relevance module. The former organizes high-resolution image into overlapping square tiles and identifies more informative visual tokens relative to their surrounding context, while the latter selects regions that are most semantically relevant to the task query. The outputs of two modules are used to guides crop proposals, which are reranked using target-existence probabilities. Final answering uses the global image and selected local evidence. Experiments with four MLLM backbones on three high-resolution benchmarks demonstrate the proposed SAGE consistently improves accuracy.
Critical strengths
- The paper attempts to use the bottom-up and top-down search mechanisms in the human visual search process to solve the problem of high-resolution image perception, and designs two modules to implement it. The experimental results indicate that this type of person search mechanism has high search efficiency.
- SAGE outperforms both the corresponding base model and ZoomEye in overall accuracy across all backbone–benchmark combinations. With LLaVA-OV-7B, it achieves 94.8%, 73.4%, and 70.3% on V* Bench, HR-Bench-4K, and HR-Bench-8K, respectively. This breadth strengthens the practical empirical contribution.
Critical weaknesses
- The two core modules in SAGE simply adapt the designs from existing methods to the visual search mechanism. SURGE already combines surprise-guided computation with optional query-relevance filtering in video understanding task and FOCUS already uses internal visual–text similarity to construct relevance maps, generate crop proposals, and re-rank them using target-existence confidence. In addition, SURGE defines surprise through temporal prediction errors, whereas SAGE measures deviation from a cross-tile mean whose interpretation as expected visual content is unclear in heterogeneous scenes. This deviation reflects feature distinctiveness, which does not inherently indicate task-critical evidence or favor small objects. Although the ablation suggests incremental utility, it does not establish the suitability of this reference or substantiate the proposed interpretation of spatial surprise.
- Figure 2 in the paper appears to be an AI-generated image that has not been manually edited and contains multiple non-standard contents. Firstly, the Re rank selected patches in component "3. Cognitive Filtering" are very unclear, making it impossible to confirm whether they are the content of the original image, and the sorting score is completely unreadable. Secondly, the icon sizes vary and are not strictly aligned. Thirdly, the image resolution is low, making it difficult to distinguish detailed information.
- Lack of generalization experiments on other high-resolution benchmarks, such as MME-RealWorld-Lite [1] and ZoomBench [2].
- Hyperparameter sensitivity is unclear. Important choices include tile count, overlap ratio, IoU threshold, layer averaging set L, and the existence-verification prompt. There is little or no sensitivity analysis.
- The paper’s writing requires further refinement. For example, line 38-41 and line 90-91.
[1] Mme-realworld: Could your multimodal llm challenge high-resolution real-world scenarios that are difficult for humans?
[2] Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perception.
Questions for authors
- What is the core technical contribution of the proposed method compared to existing methods SURGE and FOCUS? Has it been verified through experiments?
- How are surprise scores and relevance scores fused? Are they multiplied, added, normalized, or weighted? How are their scales matched?
- How exactly is SAGE applied to multi-view inputs? Are the two views encoded jointly as a longer video sequence? How are candidates selected across views, and how is the final crop composed?