acceptodds
Under review as a conference paper at ICLR 2027

Select2Adapt: Semantically Constrained Preference Transfer for Single-Sample Text-to-Image Generation

Abstract

Selecting a preferred image from multiple candidates does not, by itself, teach a generator to produce preferred outputs directly. We introduce Select2Adapt, a framework for transferring multi-candidate quality preferences to single-sample text-to-image generation through frozen-backbone conditioning adaptation. Our central principle is to make score-based semantic eligibility a prerequisite for quality-driven selection, rather than collapse alignment and quality into a scalar reward. An alignment-anchored teacher promotes a quality-preferred alternative only when predefined alignment-score, quality, and cross-template consistency checks pass; otherwise, it retains the alignment-selected reference. The resulting decisions supervise a bounded residual text-conditioning adapter, the only trainable component of an otherwise frozen diffusion model. A selector-supervised objective combines denoising on teacher-promoted and preservation targets with base-prediction consistency and residual regularization, while restricting the adapter’s intervention to the conditional branch. Multi-candidate selection is used to construct training supervision, whereas inference produces a single sample without candidate reranking. To distinguish the value of selection from the effectiveness of transfer, we specify an evaluation protocol that compares selectors on shared candidate pools, uses distinct selection and assessment models, and separately evaluates the adapted generator under single-sample inference. Select2Adapt reframes quality-aware selection from a terminal reranking step into semantically constrained supervision for parameter-efficient text-to-image adaptation.

Primary area:
generative models
Keywords:
Text-to-Image Generation, Preference Transfer, Quality-Aware Selection, Semantic Alignment, Parameter-Efficient Adaptation, Diffusion Models.

Reviews

Among:
Shape:
1234this paper, Bottom 1%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.00 over 3 reviews, above 0% of the others.
Reviewer_oCUAOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
2
Soundness
2
Read review
Paper summary

Select2Adapt aims to turn best-of-N selection preferences into a text-to-image generator that returns one sample without reranking. It has three stages:

  • (1) An offline teacher anchors on the candidate with the highest Qwen3-VL alignment score. It promotes an alternative only if that alternative passes absolute and anchor-relative semantic thresholds and beats the anchor by a blur-calibrated PickScore margin under two prompt templates; otherwise it keeps the anchor.
  • (2) A norm-bounded residual MLP on frozen PixArt text features, to be trained on promoted targets plus candidate-zero preservation targets.
  • (3) Single-sample inference with the adapter on the conditional guidance branch only.

Two elementary propositions bound selection under score error and sampling drift under bounded conditioning changes.

Critical strengths
  1. An unusually honest, auditable evidence boundary.

    • Fig. 1 (p. 3) labels each stage's status, e.g. "Specified; not trained or evaluated". The abstract says the results "do not establish semantic preservation or successful transfer".
    • The failed screen and an adverse promotion are reported rather than tuned away (Sec. 4.2, p. 8).
    • Every number I recomputed reproduces. Table 4's facet means give Table 1's +0.3973 MUSIQ and −0.0032 BLIP, and the colour case's −1.6207 / −0.4821 (p. 8). Table 3 equals differences of Table 1 rows. Table 5's macro scores recompute.

    This matters because in text-to-image alignment, reranking gains are often reported as model gains. This paper never does that, so its claims are checkable and its negative result is credible.


  1. Correct accounting for evaluating selection-to-transfer pipelines. All six arms select from the same 384 images (p. 6). The full-cohort estimand keeps unchanged prompts (Eq. 16, p. 8), and teacher and student effects are kept apart (Eq. 17, p. 9). This avoids two common inflations: reporting only changed prompts, and treating reranking as transfer. The Sec. 5 protocol is a sound plan for the missing experiment. These are good practices rather than new ideas, which limits their weight.
Critical weaknesses
  1. The method in the title is never trained or evaluated, and the evaluated stage does not characterize the supervision it would supply.

    • No transfer evidence.
      • "The present teacher study does not train this adapter or establish its latency, quality, or transfer performance" (Sec. 3.3, p. 5).
      • "this manuscript does not claim an end-to-end training run for it" (App. B, p. 16).
      • So contribution 2 (bounded conditioning adaptation) and the transfer half of contribution 3 have no empirical support.
    • The theory does not fill the gap. The paper itself calls its bounds "elementary" (p. 5), and ε_q is never estimated. For Prop. 2, "The constants have not been measured for our model", and it "does not certify the current multistep sampler" (p. 6).
    • The selection study evaluates a different object from the specified training data.
      • Table 1 scores the teacher with fallback to the alignment anchor x_a. Training instead uses candidate x0 as the preservation target on non-promoted prompts (Sec. 3.3, p. 4).
      • x0 differs from the anchor on 41 of 48 prompts, with ΔBLIP −0.2424 [−0.3437, −0.1426] (Table 1).
      • If this cohort's decisions were used (π = 8/48), the 1:1 sampler would also triple the weight of each promoted target (p. 5).
      • So even a passing screen would not have qualified the supervision the adapter would receive.

    This matters because an ICLR method paper needs evidence that its method works, or an informative analysis of why it does not. Candour about the gap does not substitute for that evidence, and a trained-adapter study is beyond the scope of a rebuttal.

  2. The only evidence, a 48-prompt selection study, is too thin to establish the eligibility-first design, and the design is close to uncited prior work.

    • Exploratory data. "Historical assessments and failures had already been inspected, so freezing the new rules does not make this a held-out or blind experiment" (Sec. 4.1, p. 6). The paper's own joint screen fails (p. 8).
    • The positive endpoint is small and concentrated.
      • All of the +0.3973 MUSIQ comes from the 7 texture promotions: Table 4 gives texture +1.293341, colour −0.101294, shape 0.
      • The pinned pyiqa 0.1.13 lists MUSIQ-KonIQ's range as roughly 0–100. The gain is therefore about 0.4 points, or about 2.4 per changed prompt by Eq. 16.
      • With 7 of 8 changes positive (p. 8), an exact sign test gives two-sided p ≈ 0.07.
      • There is no human check and no second quality assessor.
    • The BLIP noninferiority failure is one prompt. The colour promotion accounts for −0.4821 (p. 8). Without it, the cohort ΔBLIP computed from Table 4 would be +0.0068.
    • The premise is not tested.
      • On MUSIQ, the teacher is indistinguishable from preference-only (+0.1273 [−0.4752, 0.7256]) and scalar selection (+0.1885 [−0.2246, 0.6017]) (Table 3).
      • Only one fixed scalar rule is compared (p. 6).
      • In the paper's own GenEval record, a weighted sum (53.30) and VQAScore-form selection (55.13) beat the gated selector (51.35). App. D concedes these data do not support "the claim that hard constraints inherently outperform scalar selection" (p. 17).
      • In fairness, the gate does limit semantic loss relative to unconstrained PickScore selection: Table 3 gives ΔBLIP +0.2350 [0.1510, 0.3235].
    • Positioning.
      • DreamSync (Sun et al., NAACL 2025) samples several candidates per prompt and keeps those passing a VQA-faithfulness threshold and an aesthetics threshold. It keeps the most aesthetic of these, LoRA-fine-tunes on it, and evaluates the fine-tuned generator on benchmarks and with human raters.
      • Parrot (ECCV 2024) addresses the same reward-weighting concern through Pareto selection.
      • Neither is cited, and both predate the contemporaneity cutoff.
      • This narrows the teacher's novelty to anchor-relative gates, a fallback that the specified training does not use, and a margin taken as the minimum over two templates. It also weakens the claim that "The central transfer question remains open" (Sec. 6, p. 9) as a general statement.

    This matters because the selection rule is the paper's only evaluated contribution. As it stands, its value over simpler or published rules is not shown.

Questions for authors
  1. (Clarification.) Has any adapter been trained, either with this teacher or with the earlier four-candidate training cache (App. B, p. 16)? App. E refers to blinded "Base/Select2Adapt" files whose treatment mapping is unknown (p. 19). If any training run exists, positive or negative, please report it under your Sec. 5 protocol. This is the answer most likely to change my assessment.
  2. (Suggestion; requires only rescoring the existing 384 images.)
    • (a) A sweep of the scalar weight, including App. D's percentile-normalized rule, and of γ / η_r. Please show it as a ΔMUSIQ–ΔBLIP frontier at matched numbers of changed prompts.
    • (b) A random-eligible-alternative arm in the same 13 eligible pools. This would separate a PickScore effect from facet composition.
    • (c) ImageReward, HPS v2 and VQAScore-form selectors, plus a DreamSync-style threshold-then-aesthetics rule.
  3. (Suggestion; re-analysis of existing scores.) What are ΔMUSIQ and ΔBLIP for the actual training-target set, the 8 promoted targets plus x0 preservation targets under the 1:1 weighting? Please give them relative to x0 and to x_a. Why is x0, rather than the anchor, the preservation target?
  4. (Clarification.) How robust are the two verdicts?
    • (a) Eq. 15 together with pp. 7 and 15 appears to imply that γ = 0.288 comes from one of the two failing shape controls, on which PickScore prefers the blurred image. At γ's 10⁻⁴ floor, the shape alternative with gain 0.01932 (p. 8) would have been promoted. What are γ and the per-facet promotions without that control?
    • (b) Please give leave-one-prompt-out results, exact sign-flip tests and multiplicity-adjusted intervals for the 16 endpoints, plus a blinded human check of the 8 promoted pairs (especially "a yellow bicycle and a purple hairbrush").
    • (c) How, and when relative to inspecting the reused MUSIQ and BLIP files, was the −0.02 margin fixed?

What would move me to 2 (weak rejection):

  • convincing answers to Q2–Q4;
  • retitling and reframing the paper as a selection-and-protocol study.

Acceptance would require a trained adapter evaluated under the paper's own Sec. 5 protocol: frozen splits, paired base-versus-adapted single samples on held-out prompts, matched-capacity controls and an independent assessor. That is beyond the scope of a rebuttal.

Minor (no effect on my rating):

  • State the MUSIQ scale and the anchor's absolute MUSIQ and BLIP levels. Justify the −0.02 margin: on the full-cohort mean it allows −0.12 per promotion at m = 8.
  • Specify the Qwen3-VL gate: model, template and score range. If scores lie in [0, 1], max(τ_A, η_A·A_a) = 0.5 for every anchor, so the whole-prompt relative floor never binds.
  • State the source of the 48 prompts, and name the scorer behind the preceding teacher's 1–5 scale (p. 15).
  • App. D cites no source for its "previously reported" results, and its raw outputs are unavailable. Fig. 5's method identities are unknown. Neither can carry evidential weight.
  • Report the cost of candidate generation and scoring, given the efficiency motivation.
Reviewer_v2ndOpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

The work focuses on post-training text-to-image generation model, for better semantic alignment between image and text. They first selects preferred text-image pair in an offline way, by measuring semantic alignment and perceptual quality, using pre-trained VLM (e.g. Qwen3-VL) or reward models (e.g. PickScore). Then, using the combination of preferred pairs and original source pairs, they train a residual text encoder such that promotes generative trajectory to be more aligned with the preferred pairs. In the loss function, they use usual dsm loss, anchoring loss, and a regularizer loss of the residual prediction. They show some statistics after offline filtering, but I believe they do not show the result after doing post-training.

Critical strengths

Training a residual text encoder could offer a lightweight approach to post-train a text-to-image generative models, as controlling guidance from text token is one of the key degrees of freedom for improving text-to-image generation quality.

Critical weaknesses

While the work only shows statistics after offline filtering, it turns out to be not that effective since the BLIP score (semantic alignment) is actually decreasing. More importantly, the paper does not present experimental results from a student model, or a model after post-training that actually shows the improvement what authors motivated for. The writing is hard to follow, and the proposed method appears to offer limited methodological novelty.

Therefore, I believe this is an incomplete work that requires significant improvements in various ways.

Questions for authors

Described in the weaknesses section.

Reviewer_RQqDOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

The authors propose a method to improve reward alignement while satisfying some semantic constraints. To do so they train a residual adapter on top of a frozen text embedding

Critical strengths
  • Improving alignement while preserving some semantic constraints is a nice task.
  • I appreciate the authors honesty on certain failures
Critical weaknesses
  • The main method is never ablated.
  • The method look similar to « Don’t Drop your samples », CVPR 2024 and « MIRO: MultI-Reward cOnditioned pretraining improves T2I quality and efficiency », ICML 2026. The authors should cite them and compare to them especially given all the extra complexity they introduce without ablations. The idea of guiding with the rewards is already explored in both of this papers in the context of T2I
  • The paper don’t provide any images in the main paper. Usually not a good impression for a T2I paper
  • Overall the paper is poorly written and hard to parse. The authors should make an effort to rewrite it entirely, do all the needed ablations and make some presentation efforts. This feels very unpolished
Questions for authors

I don't think much will change my assessment. This paper is clearly unfinished and even lacks proper experimentation on the main method. This paper needs to be properly rewritten so i can only recommend to reject it.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.