- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper addresses the problem of visual representation learning and proposes a method that integrates two distinct representations, DINOv3 and SgiLIP. More specifically, the proposed method first computes the similarity between every possible pair of DINOv3 patch features and SigLIP tokens, and then integrates the semantically rich SigLIP tokens into the spatially rich DINOv3 patch features based on this similarity. Experimental evaluations on image captioning and visual question answering demonstrate that the proposed method outperformed the baselines (DINOv3 and SigLIP) and closely related methods (GRANULON, CoME-VL, and MERV) in most cases.
Critical strengths
S1. The problem dealt with in this paper is significant. Visual representation learning is one of the most significant and fundamental research problems in computer vision. Among various visual representations, DINO is the most popular and relies solely on still-image inputs. However, as a result, visual representations produced by the DINO framework lack detailed semantic information. Meanwhile, the recent emergence of large-scale vision-language models (LVLMs) would generate another line of semantically rich visual representations under their guidance. In this sense, the problem of enhancing DINO to obtain semantically rich information is becoming one of the research problems attracting attention from computer vision researchers.
S2. The structure of the proposed method, as shown in Figure 3, is reasonable and technically sound. Although the way of aligning SigLIP tokens onto DINOv3 patch features seems brute-force, narrowing the selection to a small number and aligning the features of both is technically sound. Also, the technique of integrating aligned features with optimized rotations is reasonable.
S3. The experimental evaluations in image captioning and visual question answering demonstrate the unreasonable effectiveness of the proposed method. The proposed method greatly outperforms CoME-VL, which also integrates DINOv3 and SigLIP with cross-attention architectures, in almost all the settings.
Critical weaknesses
W1. The current manuscript is extremely difficult to read, which is a great loss given the excellent technical content. Until I looked at Figure 3, I could not even grasp the basic outline of how the proposed method was structured or what its key features were. What the authors should do first is to ensure that readers understand what can be achieved using the proposed method. However, the current manuscript skips it and focuses on explaining individual technical components. Also, it deliberately tries to explain something that could easily be conveyed concisely in a complicated way. I would recommend that the authors majorly revise Sections 1 and 2 in the camera-ready version. Also, Lemma 1 and related descriptions can be removed from the main content, as they are not the focus of this paper.
W2. I could not understand why the current methodology, called orthogonal bridge injection, is the best for integrating two aligned features. I understand that it might be better to contain trainable parameters in the methodology. However, I could not understand why the current shape is the best in terms of performance rather than computational cost. As far as I checked, it has not been well justified, neither literally, theoretically, nor empirically. For example, we can easily find simpler ways, such as concatenating D and ¥overline{S}.
Questions for authors
Q1. I am not familiar with the automatic judge used in this paper and Granulon. I would know its reproducibility against LLM deprecation.
2 comments
Thank you very much for your time and for the constructive discussion throughout the review process. We truly appreciate your thoughtful feedback, which has been very helpful in improving the clarity and completeness of our work. We have carefully considered your comments and made every effort to address the concerns you raised. We hope that our responses have provided sufficient clarification.
We would also be very happy to address any remaining questions or concerns you may have. If there are any aspects of our methodology, experiments, or explanations that you feel still need further clarification, please do not hesitate to let us know. We would be more than willing to provide additional explanations or evidence. Thank you again for your patience and consideration. We sincerely appreciate the opportunity to discuss our work with you.
Manuscript Clarity, Fusion Design, and Evaluation Reproducibility
Thank you for recognizing PAIQ's excellent technical content. Your constructive comments and suggestions are very helpful, and we will carefully incorporate them into the revised manuscript.
W1: Manuscript readability
Response. We acknowledge that the writing needs substantial improvement; English not being our first language may have contributed. In the camera-ready version, we will:
W2: Orthogonal Bridge Injection Design Explanation
1. Theoretical rationale
2. Empirical evidence
3. Related-work support
We draw inspiration from these established works, which provide relevant theoretical and implementation support for our design choices.
Q1: Automatic Judge and Reproducibility
1. Automatic judge
Following GRANULON [1], each response is independently scored on two axes:
The two metrics are requested separately, with no shared context. We use GPT-4o with fixed settings and record each model identifier and response ID. Prompts, scoring rules, and request settings are in Appendix H, C.3 (Table 8), and C.4 (Table 9).
2. Reliability
Multimodal LLM-based evaluation has been widely adopted in visual benchmarks and evaluation frameworks, including Prometheus-Vision (ACL 2024), WildVision-Bench (NeurIPS 2024), CapArena (ACL 2025), DCScore (ICLR 2025), and other related works. Manual checks also show high correlation between LLM scores and output quality (Appendix G).
3. Reproducibility without an LLM judge
PAIQ achieves the best accuracy on both benchmarks without an LLM judge.
References
[1] Granulon: Awakening Pixel-Level Visual Encoders with Adaptive Multi-Granularity Semantics for MLLM
[2] Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation
[3] WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences
[4] CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era
[5] Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning