- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper constructs DPO preference pairs without any external judgment by exploiting relations among unlabeled inputs. The authors build a neighborhood for each image from a representation that preserves the input structure, then prompt the current policy to emit a structured sequence of (state, texture) tuples. The anchor's own description and those of its neighbors form a candidate pool, scored by a similarity-weighted normalized edit distance to the neighbors minus a contrastive term over non-neighbors, with the argmax and argmin taken as the chosen and rejected responses. The procedure runs for three rounds of iterative DPO on Qwen2-VL-7B and Gemma-3-4B across financial price charts, ECG waveforms and seismic traces, and is evaluated zero-shot on downstream tasks that never appear in training.
Critical strengths
The motivation for learning preferences from structural relationships among unlabeled inputs is clear. The paper is well organized, and the proposed method is easy to follow.
Critical weaknesses
- The compared baselines are relatively dated and mainly cover methods from 2024. More recent work has explored automatic construction of DPO preference datasets for VLMs [1][2], but these methods are not included in the comparisons. Comparisons with more recent methods would help assess the competitiveness of the proposed approach.
- The evaluation mainly focuses on time-series charts. These results do not yet establish whether the gains extend to general visual question answering and multimodal understanding. Evaluating the model before and after preference training on representative benchmarks, such as MMBench or LLaVA-Bench for general understanding and POPE or AMBER for hallucination, would provide more direct evidence for the broader claims about visual grounding.
[1] Re-Align: Aligning Vision Language Models via Retrieval-Augmented Direct Preference Optimization. [2] Self-Consistency as a Free Lunch: Reducing Hallucinations in Vision-Language Models via Self-Reflection.
Questions for authors
- Could you evaluate the model before and after preference training on MMBench or LLaVA-Bench for general understanding and POPE or AMBER for hallucination?
- The related work mainly covers earlier methods and omits several recent approaches to automatic preference data construction for VLMs. Could you update this discussion to cover relevant work from 2025 and 2026 and clarify how the proposed method differs from these approaches?
- Could you add comparisons with recent baselines from 2025 and 2026 for automatic construction of DPO preference datasets, including relevant methods such as [1][2]?
- For each round, what fraction of training pairs has the anchor's own description as the chosen response, as opposed to a neighbor's description? Please also report within-neighborhood description diversity per round.