- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
Pair2Point is a VLM-based text-to-image reward model. It first trains a pairwise judge on Gemini-annotated, dimension-level comparisons, then distills it into a pointwise scorer by averaging the judge's scores over same-prompt opponents, and uses it as the reward for Flow-GRPO.
Critical strengths
- Useful data contribution. Existing preference data mostly comes from older generators. The three resources built on recent models (P2P-CoT-16K, P2P-Image-70K, P2P-Bench) fill this gap, and P2P-Bench with unanimous six-annotator labels is a nice benchmark for modern reward models if released.
Critical weaknesses
-
Why bother with the pairwise teacher? Gemini already provides per-image, dimension-level scores and weights for every pair (Fig. 2). The simplest baseline is to turn these into one score per image with the same weighted rule as Eq. (7) and regress a pointwise model on it directly. Why train a pairwise teacher first and then distill it again into a pointwise student? This is the most important ablation for the paper's central design, and it is missing. The regression-head row in Table 3 doesn't answer it, since it uses a BT loss on pairwise winners only and drops the dimension-level labels.
-
Missing comparisons with the closest baselines. JRM, Z-Reward and RewardDance share the same motivation (reliable judgment during training, cheap pointwise scoring at inference) and are discussed in the paper (lines 75–77, 141–143), but none of them appears in Table 1 or Table 2.
-
Messy citations. Flow-GRPO is cited as Shao et al., 2024 (lines 151, 316), which is DeepSeekMath, the original GRPO paper. The actual Flow-GRPO paper isn't in the references at all. Similarly, "direct preference optimization" for diffusion and flow models (line 151) cites the LLM DPO paper instead of Diffusion-DPO. Core components the paper builds on, such as Qwen3-VL, FLUX.1-dev, Qwen-Image and LoRA, are not cited either.
Questions for authors
-
Can you add a baseline that converts Gemini's dimension-level scores into a per-image score with a rule like Eq. (7) and regresses a pointwise model directly, without the pairwise teacher? How does it compare with Pair2Point on Table 1 and in Flow-GRPO?
-
Can you compare against JRM, Z-Reward and RewardDance on both preference accuracy and downstream RL?