- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies description reliance in vision-language models. Generating an image description before answering a visual question often improves VQA accuracy, but also increases inference cost. The authors propose Internalization, a two-stage post-training method that transfers the benefit of caption-assisted answering into a compact latent prior, enabling direct answering. The paper also introduces InternVQA to measure the performance gap between direct answering and caption-then-answering.
Critical strengths
1、The paper addresses a practically important problem. It clearly shows the gap between direct and caption-assisted answering, while reducing this reliance can directly lower inference cost. 2、The evaluation is comprehensive, covering multiple VLM families and model scales, together with extensive ablations, public benchmarks, efficiency analysis, multiple evaluators, and human evaluation. This provides strong support for the main empirical findings.
Critical weaknesses
1、The current experiments do not fully establish that the gains come from "description internalization." Caption-then-answering adds not only an explicit description, but also extra autoregressive computation and self-generated context. Stage II further contrasts caption-assisted and unconstrained answers, so the training signal also reflects differences in answer quality and directness. It is therefore unclear whether explicit descriptions are the key factor. 2、The InternVQA judge knows which answer comes from direct answering and which comes from caption-then-answering. This may introduce evaluator bias. A cleaner setup would hide the inference mode and randomize answer order.
Questions for authors
1、Would similar gains remain if the chosen answers came from a strong teacher without an explicit caption-then-answer stage? This would help distinguish description internalization from more general stronger-inference distillation. 2、Could the authors re-evaluate the main InternVQA results with the inference mode hidden and the answer order randomized?