- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors present DRIVE, which is an approach to improve how accurately VLMs can locate target objects in images. In order to do this, the model will first predict a point; then describe what the model expects to see at that location; and finally check a visual marker prior to making an adjustment to its prediction. The model is trained via RL using the final pointing results. Using 300 VABench-P examples, DRIVE increased accuracy from 67.33% to 71.67% when compared to directly predicting with the same trained model.
Critical strengths
- The idea of the method is straightforward.
- The problem is clearly stated (discrepancy between good object identification and bad actual pointing coordinates)
Critical weaknesses
- No clear baseline comparison with prior work (thos VLMs finetuned for pointing, or frontier VLMs).
- Testing on only a single benchmark, very limited evaluation.
- Poor writtings very AI-alike.
- The methodology has no novelty.
Questions for authors
See weakness.