- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
With DPO, image pairs composed of a winner (preferred, to which the model must be stirred) and losing (less preferred) image are formed, then the model weights are adapted towards the whole winner image. Nevertheless, this is not optimal as the losing image might contain some parts which are better than the winner. The paper addresses this shortcoming. The framework starts by generating images from the same shared noise and thus aiming to obtain locally aligned images. Then, by leveraging GPT-5.6-Sol VLM, it assess each image on multiple failure criteria (e.g. object presence, counting, color etc.) on which image pairs can later be compared. A final verification step is done to make sure the same region is found in the two images. In the end, regional optimization is achieved employing a loss that takes into account the soft-masked region.
Critical strengths
The paper starts from an obvious problem when employing DPO (an image might not be fully better than another one) and proposes an automatic framework to resolve this. Each component is well-defined, with a clear motivation. The paper addresses the main objective with experiments on multiple benchmarks and two models.
Critical weaknesses
- The main weakness of the paper is the baselines in compares to. There are other region-aware DPO methods (a few examples found in Related Work are [1], [2], [3]) which are more suitable than a SFT baseline. Furthermore, when compared to method [2], the novelty is slightly incremental. This would also lead to a strong ablation study that isolates the proposed objective -> how is the performance when training with the default DPO loss on the mined samples (using a simple heuristic for selecting the winning sample i.e. larger number of preferred attributes) - this is potentially covered by Vanilla DPO baseline but there is no information how it was obtained
- Some results in Table 1 are very close to Vanila DPO -> in order to attest the method's performance, some statistical tests / multiple runs are required ~ Minor ~
- Table 4, Alighnment column: Full RePair is bold, but Uni-Directional Only has a higher score.
- Text could be simplified, few parts that were hard to follow, also due to wording e.g. "Since prevailing post-training paradigms Wallace et al. (2024); Liu et al. (2025) propagate a global preference to all semantic components."
- References are very inconsistent: some of them mention the journal/article, some of them not.
- Not enough information for reproducibility on VLMs calling
[1] - Xing, X., Saha, A., He, J., Hao, S., Vicol, P., Ryu, M., Li, G., Singla, S., Young, S., Li, Y. and Yang, F., 2025, June. Focus-n-fix: Region-aware fine-tuning for text-to-image generation. In 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 18486-18496). IEEE. [2] - Oh, Y., Kim, Y., Kim, H., Chi, D. and Kim, S., 2026. OSPO: Object-Centric Self-Improving Preference Optimization for Text-to-Image Generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 7620-7631). [3] - Zhuohan Liu, Wujian Peng, Yitong Chen, and Zuxuan Wu. Compositional text-to-image generation via region-aware bimodal direct preference optimization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 36604–36614, June 2026.
Questions for authors
- How were the SFT and Vanilla DPO baselines obtained?
- How does your method compared to other region-aware DPO methods?
- Do the results statistically stand?
2 comments
Response to Reviewer 4kw2 (2/2)
Response to Weakness1. Compared to OSPO, the novelty is slightly incremental
We thank the reviewer for highlighting this concern. Although both methods exploit object-level or regional information, their sources and construction of preference supervision are fundamentally different. OSPO constructs object-centric preference pairs through prompt perturbation, evaluates object-level quality using VQA, and applies object-weighted SimPO. In contrast, RePair directly mines regional preferences from naturally generated correlated rollouts, without artificially constructing prompt-level contrasts. Specifically, correlated generation produces comparable candidates, while VLM-based regional analysis and cross-image comparison identify complementary local successes and failures. RePair then uses a mixed set of region-specific preference signals, preserving their individual directions during optimization rather than reducing them to a single global ranking. The combination of correlated generation and multi-directional regional optimization is central to RePair's contribution. It provides a way to learn from the natural diversity of model-generated samples, making post-training better aligned with how generative models actually produce successes and failures.
Response to Weakness3-Weakness6
We thank the reviewer for pointing out these issues. We will address them in the revised manuscript as follows:
W3. Table 4. We will correct the bold formatting in the Alignment column to highlight the highest score.
W4.Clarity. We will revise the manuscript throughout to simplify lengthy sentences, replace ambiguous expressions, and improve overall readability. In particular, the highlighted sentence will be revised as follows:"Most existing post-training methods assign a single image-level preference to the entire generated image (Wallace et al., 2024; Liu et al., 2025)."
W5. References. The inconsistency arises from BibTeX entry types for arXiv preprints. We will correct these entries to ensure consistent display of publication information in the revised manuscript.
W6.Reproducibility. We will clarify the VLM calling protocol and provide the complete system prompts and user-message templates in the supplementary material.The system prompts and user-message templates are summarized below:
- Annotation — system prompt: Act as a strict image-quality auditor. Identify visible failures, group findings by semantic region, and return their bounding boxes, error types, descriptions, severity, and confidence in JSON format. Report only errors supported by visible evidence.
- Annotation — user message: Inspect the supplied image against the generation prompt and semantic target references, and localize the detected failures.
- Pairwise verification — system prompt: Act as an independent regional-preference verifier. Judge each proposed region against the prompt requirements, returning A-over-B, B-over-A, or tie, together with quality scores, confidence, and supporting evidence. Use tie for small or uncertain differences and keep the supplied bounding boxes fixed.
- Pairwise verification — user message: Compare images A and B within the proposed regions using the prompt, target requirements, and corresponding crops. Determine regional preferences independently, without access to provisional preference directions or previous failure descriptions.
Response to Reviewer 4kw2 (1/2)
Response to Question1. How were the SFT and Vanilla DPO baselines obtained?
We thank the reviewer for pointing out the insufficient baseline details. For SFT, we select the best generation from each rollout and use GPT-Image2 to correct its remaining errors, obtaining refined training samples optimized with the standard flow-matching loss.For Vanilla DPO, we use the exact same image pairs mined by RePair and assign global preference labels using the suggested heuristic. The image with more correctly rendered regions is preferred. If tied, we compare the sum of VLM-estimated error severities across incorrect regions. These pairs are then optimized using the standard Flow-DPO objective. This provides the controlled comparison suggested by the reviewer, isolating the benefit of region-specific preference supervision over a single global winner–loser label on identical image pairs. Both baselines follow the backbone and training configurations described in Appendix C.1. We will clarify these details in the revised manuscript.
Response to Question2. Compared to other region-aware DPO methods
We thank the reviewer for suggesting stronger region-aware baselines. As discussed in Related Work, existing methods differ from RePair in their supervision sources and preference construction strategies. However, existing methods are either tailored to specific architectures, making faithful adaptation to our flow-matching backbone challenging (e.g., OSPO targets autoregressive multimodal models), or lack publicly available implementations (e.g., Focus-N-Fix). We therefore select BiDPO, which provides open-source code and training data, as a representative region-aware baseline. We reproduce BiDPO using the same FLUX.2 backbone and evaluation protocol as RePair. The results are shown below:
RePair consistently outperforms BiDPO across all three benchmarks, demonstrating the advantage of our region-specific multi-directional preference optimization. We will include these comparisons in the revised manuscript.
Response to Question3 & Weakness2. Some results in Table 1 are very close to Vanilla DPO. Do the results statistically stand?
We thank the reviewer for this suggestion. We include Ideogram 4 to evaluate RePair on a recent, high-performing model. Its strong baseline performance (e.g., 0.92 in prompt alignment and 0.97 in text rendering) leaves limited room for improvement. Nevertheless, RePair improves all four evaluation metrics, whereas Vanilla DPO degrades three of them relative to the base model. To further check the reproducibility of these results, we repeated the Ideogram 4 evaluation once and observed consistent results. We also clarify that the four metrics in Table 1 are evaluated on four separate benchmarks, rather than subsets of a single benchmark. Moreover, experiments on the weaker SDXL[1] backbone demonstrate substantially larger gains (+0.10 GenEval and +5.23 DPG-Bench over Vanilla DPO**). These additional results support the robustness and cross-backbone effectiveness of RePair.
Reference [1] Dustin Podell et al. SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis. In The Twelfth International Conference on Learning Representations (ICLR), 2024.