- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies whether the placement of a quantitative target condition in the prompt affects the model's ability to learn that control during T2I fine-tuning. Across Qwen-Image, Z-Image, and FLUX.2 Klein, the authors compare matched Front- and Back-position training for angle, ellipse, and progress-bar control. The paper further analyzes Qwen-Image angle control, finding that an early condition propagates more broadly through the frozen causal text encoder and produces a stronger generator response. They propose Prefix fine-tuning, which repeats the target value at the beginning, and studies concept-learning dynamics in a controlled synthetic setting by varying prior concept exposure and fine-tuning progress.
Critical strengths
-
While inference-time positional bias is well known, the observation that target-field position can substantially change the acquisition of quantitative control under matched supervision is interesting.
-
By evaluating Front-trained models with Back prompts, they separate training-position effects from purely inference-time position effects.
Critical weaknesses
-
Front and Back prompts are explicitly not token-identical reorderings; grammatical adjustments are made between formats. Thus, the observed differences can reflect position together with wording, syntax, or tokenization and do not strictly isolate the effect of position. Additionally, evaluating only the extreme start and end points is limiting. A stronger test would use a fixed structured template with identical tokens and move the target field systematically across intermediate positions to demonstrate a clear, graded relationship between position and control.
-
The paper shows that early conditions spread through more contextual representations and that Prefix both increases this spread and improves control. However, Prefix simultaneously changes position, repetition, and prompt length, which the paper itself acknowledges. A critical missing experiment is testing a model with a bidirectional encoder (like T5), where later tokens can influence earlier ones. If the Front/Back performance gap persists in a bidirectional model, the causal-attention hypothesis would be invalid. Relatedly, Ask Twice, Look Twice [1] independently shows strong ordering effects in causal VLMs and resolves them by repeating the question before and after the image, which is particularly relevant to the paper's Prefix intervention and should be discussed.
-
The main Front/Back results in Table 1 do not appear to report variability across independent fine-tuning runs. Given the small training datasets, reporting results across different seeds, which the authors correctly did for their synthetic and Prefix studies, is essential to prove the stability of the central claims, I also could not find sufficient details on how the generated angle, ellipse dimensions, and progress-bar proportions are extracted from images. Since the main normalized-MAE metric entirely depends on these extractions, the reliability of the underlying measurement tool must be established.
[1] Abhinandan et al., Ask Twice, Look Twice: Prompt Echoing Resolves the Question-First Paradox in Vision-Language Models. eXCV Workshop at ECCV, 2026.
Questions for authors
- Could the authors move the target condition through several intermediate token positions, rather than only Front/Back, while keeping the prompt tokens otherwise identical? Does acquired control decrease systematically with later placement, and does this track contextual propagation?
- Does the effect reproduce with a bidirectional text encoder such as T5? This seems like a direct test of the proposed causal-attention mechanism.
- Could the authors report Front/Back results over multiple independent fine-tuning seeds for the main Qwen-Image experiments?
- How exactly are generated angles, ellipse dimensions, and progress-bar proportions measured, and what is the error/reliability of these evaluators on images with known ground-truth attributes?
- Since Front-trained models degrade when tested in Back format and Prefix-trained models degrade when the prefix is removed, would it be more precise to describe the learned capability as format-conditioned quantitative control rather than position-invariant concept acquisition? The paper does acknowledge this limitation, but I think the distinction is important for interpreting the result.
R3-1. Does control weaken across positions without rewriting? We added a five-position experiment using five unchanged clauses: "Use black lines on white." "Mark and label {a_label}, {b_label}, and {c_label}." "Place {b_label} at the vertex and {a_label} to its right." "Show a small arc at {b_label}." "Set ∠{a_label}{b_label}{c_label} to {angle_degrees}°." The measurement clause occupies M1-M5 (earliest to latest); the other four clauses are randomly ordered. We train a model per position and evaluate on unseen angles. This fixed-clause setting does not use the original held-out-template split.
Overall, later placement leads to poorer acquisition even with clause wording held fixed. Thus, the original grammatical rewriting is insufficient to explain the difference. In the original pre-SFT Front/Back probe at encoder layer 28, context spread is 0.038934/0.010405 (3.74x) and coverage is 50.36%/15.60%. These are two-position diagnostics, separate from the five-position experiment. The separate training-time attention-blocking experiment in R2-1 directly intervenes on propagation and provides complementary acquisition evidence.
R3-2. Does the effect persist with a bidirectional encoder? We added PixArt-Σ, which uses a bidirectional T5 encoder. Matched-format scores are:
PixArt-Σ does not reproduce Qwen's strong, consistently directed Front advantage. Angle BB exceeds FF throughout; ellipse ordering varies. Unseen-value control remains weak, so small gaps do not establish successful position-invariant control. This architectural comparison complements the within-Qwen intervention.
R3-3. How does Prefix relate to Ask Twice, Look Twice? Question echoing in Ask Twice, Look Twice is closely related to Prefix, but the research questions differ. Abhinandan et al. study input ordering at inference for a fixed VLM. We study how target-condition placement during SFT affects quantitative control learned by a text-to-image model; Prefix is used in both training and inference. We also recognize the shared use of repetition and information-flow interventions, and will discuss this methodological connection explicitly. We developed Prefix independently and will publicly release the corresponding checkpoints and original timestamped training logs to document when the experiments were conducted. We will cite and discuss this work in the final version.
R3-4. Are the main Qwen results robust across independent SFT seeds? For Qwen-Image-2512, we use training seeds 42/43/44 and generation seeds 1/2, averaging generation seeds within each run before computing training-run means and standard deviations. The three-seed robustness results are:
The mean FF-BB gaps are 0.6111, 0.7614, and 0.0905: the main task-dependent pattern remains after averaging independent training runs. We will report training variability separately from probe uncertainty. Multi-seed robustness results cover Qwen only; no corresponding claim is made for Z-Image or FLUX.2.
R3-5. How are attributes extracted and evaluator reliability checked? R1-2 details rule-based geometric extraction, Hough-based angle measurement, and constant-baseline scoring for unmeasurable outputs. Manual visual inspection confirmed consistency with human judgments. The remaining rule-based measurement procedures will be detailed in the final version.
R3-6. Is this format-conditioned control rather than position-invariant acquisition? We agree that the results do not establish position-invariant acquisition. Acquisition here means learning to control generated attributes according to requested values; unseen-value generalization and transfer across prompt positions are distinct. We will describe the demonstrated capability as format-conditioned quantitative control. Retaining the prefix at inference is part of Prefix; removal exposes its transfer limitation.