- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes BindOPSD to improve object-to-location binding in vision-language models. It equips a teacher with a joint scene view and correspondence-aware attention, then transfers this spatial signal to a student that uses only the original image at inference through on-policy self-distillation. The authors also introduce a gradient correction and the FineBind benchmark. Experiments with 4B and 9B models report gains on FineBind and most of nine external spatial benchmarks; ablations examine the contributions of the joint view and correspondence-aware attention.
Critical strengths
(1)With the joint view held fixed, adding correspondence-aware attention improves the overview-only student on all four ablation benchmarks at both model sizes. This is the clearest evidence for the paper’s central mechanism. (2)Breadth of reported gains: The 9B student improves on eight of nine external spatial benchmarks while using only the original image at inference. If the inconsistent baseline figures are reconciled, this would be a meaningful practical result.
Critical weaknesses
(1)Inconsistent baselines: The 9B FineBind baseline is 47.0 in Table 1 but 53.2 in Table 4; other baseline scores also differ. These discrepancies change the claimed gains and prevent a reliable assessment of the main result. (2)Insufficient validation: FineBind’s construction and split controls are poorly documented, and there is no matched ablation for the proposed gradient correction despite declines in the 9B model’s general reasoning scores. These gaps weaken two central claims.
Questions for authors
(1)Why do the same base models have different scores in Tables 1–2 and Table 4? Please identify the evaluation protocols and provide corrected results. (2)How were FineBind examples sourced, checked, and split to prevent image or scene overlap between training and test sets? (3)What matched comparison without gradient correction supports its claimed retention effect, given the 9B model’s declines on the reported general reasoning tests?