- Rating
- 1(−1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates which aspects of text representations are necessary for conditioning pretrained text-to-image models. The authors construct alternative embeddings by averaging contextual token representations across unrelated sentences. The BoT, BoW, and BoPTW variants progressively preserve token identity, constituent word identity, and absolute token position, while leaving the pretrained image generator unchanged.Experiments evaluate SD3, FLUX.1 Schnell, and FLUX.2 Klein-4B using VLM preferences, native GenEval scores, image-quality metrics, and a human study. Additional experiments examine long prompts and compare DiT with U-Net architectures. The central finding is that BoPTW preserves substantial generation capability in several settings, which the authors interpret as evidence that much of linguistic processing occurs within the image model.
Critical strengths
1.A relevant research question and a useful intervention. Distinguishing information encoded in text representations from information necessary for generation is important. The BoT–BoW–BoPTW progression provides an intuitive framework for studying word identity and positional information without modifying the pretrained generator. 2. Complementary empirical evaluations. The study includes multiple generators and prompt distributions, native GenEval scores, a human study, and explicit failure cases. These evaluations provide useful evidence beyond selected qualitative examples. 3. An interesting architectural comparison. The DiT–U-Net contrast is noteworthy. The synthetic experiment using the same frozen T5 encoder and approximately matched model sizes strengthens this observation beyond comparisons between independently developed systems.
Critical weaknesses
-
Text-representation quality should be analyzed jointly with inference budget and training regime.My central concern is that final-image performance captures only one aspect of the value of a text representation. A representation may support satisfactory generation under a particular sampling configuration while still affecting how efficiently the generator reaches that result and how successfully it can be adapted to a different generation objective.This concern is motivated by EMF [1], which reports differences in few-step semantic preservation between BLIP3o-NEXT and SANA-1.5, and links textual representation properties to the behavior of MeanFlow training. EMF also discusses the possibility of trajectory correction under multi-step sampling. These findings do not directly invalidate BoPTW, but they motivate examining whether endpoint robustness conceals differences that become important under tighter inference budgets.The present paper does not report the actual sampling steps, schedulers, or guidance settings for its main experiments, nor a systematic analysis of how the full-versus-BoPTW gap changes with sampling budget. Importantly, FLUX.1 Schnell and the non-Base FLUX.2 Klein-4B are themselves few-step-distilled models, so it would be incorrect to claim that few-step systems are absent. The unresolved issue is the scope and budget dependence of the finding.A matched comparison across supported sampling budgets would substantially strengthen the analysis. Iterative compensation should be treated as a possible explanation to test, not an established cause. Even if BoPTW is sufficient at a particular budget, that does not establish comparable efficiency or suitability for alternative training regimes.
-
Removing prompt-specific contextualization does not establish that powerful text encoders have limited value.The intervention retains averaged representations produced by large pretrained encoders. These vectors can preserve rich lexical semantics and representation geometry acquired during pretraining. Consequently, the experiments test whether prompt-specific contextualization can be replaced in a frozen pipeline; they do not directly test whether inexpensive word-level encoders would provide equally useful conditioning.More generally, the object of interest is the embedding actually supplied to the generator, which depends on both the encoder and the prompt. Prompt construction or rewriting can alter the information supplied to the model and how that information is represented. The current analysis does not establish how robust its conclusions are to semantically matched paraphrases, changes in instruction structure, or different levels of prompt detail. The degradation on DPG makes this boundary particularly relevant.The adoption of LLM-based conditioning in FLUX.2 and MLLM-based text encoding in HunyuanVideo [2] does not itself prove that larger encoders are necessary. It does, however, motivate distinguishing the benefits of contextualization from other benefits of pretrained representations and prompt processing. I would therefore narrow the practical implication from questioning the need for powerful encoders broadly to identifying circumstances in which their prompt-specific contextualization can be bypassed. Training a new simplified system is a reasonable future direction, not a prerequisite for publishing this analysis.
-
The quantitative evidence does not support a broad “on par” characterization.The reported “non-inferiority rate” is a descriptive win-or-tie fraction, not a statistical non-inferiority test. Counting ties toward both methods is legitimate, but high values do not establish comparable performance, particularly because Section B.3 explicitly permits a tie when both images are poor.For FLUX.2 on GenEval, Table 6 reports 3.1% BoPTW wins, 63.8% ties, and 33.1% full-embedding wins under Gemma. Thus, a 66.9% win-or-tie rate coexists with a substantial preference imbalance. Table 4 provides stronger task-level evidence: overall GenEval decreases from 82.3 to 71.3, two-object performance from 92.7 to 58.9, and attribute binding from 66.8 to 49.5.The corresponding overall results are much more favorable for FLUX.1, changing from 70.4 to 70.7, while SD3 changes from 66.0 to 63.9. This supports a model-dependent conclusion rather than uniform parity. DPG win-or-tie rates of 41.5–57.0% further restrict the long-prompt claim. The abstract and conclusion should reflect these substantial differences.
-
Behavioral sufficiency is not equivalent to non-use or a demonstrated mechanism.Successful generation after replacing full embeddings does not establish that the original model does not use contextual information when it is available. A generator can exploit contextualized embeddings while also being capable of reconstructing relationships from word identities and positions.Similarly, the progressive localization of attention in Figure 20 is consistent with internal semantic processing, but it does not by itself establish the claimed causal mechanism or show that positional tags are responsible for resolving the relationships. The paper’s repeated “do not use” and “proves” formulations are stronger than the evidence warrants. The findings more directly establish robustness to a particular intervention under particular conditions.
References [1].Zhao, Chenxi, et al. "Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representation." arXiv preprint arXiv:2604.18168 (2026) [2].Kong, Weijie, et al. "Hunyuanvideo: A systematic framework for large video generative models." arXiv preprint arXiv:2412.03603 (2024).
Questions for authors
1.What exact checkpoints, sampling steps, schedulers, guidance settings, seed-pairing procedures, and text-truncation policies were used in the main experiments?
2.Within each model’s supported sampling range, how does the performance gap between full and BoPTW conditioning change with the inference budget? Can the authors distinguish their inference-time findings from claims about the requirements of training or adapting efficient generators, as studied in EMF?
3.How stable are the findings across semantically matched paraphrases and controlled changes in prompt detail? Which benefits inherited from the original pretrained encoder remain in the averaged representations?
4.Can the authors provide prompt-level uncertainty estimates and absolute task-success comparisons, including results restricted to cases where full conditioning succeeds? How should “on par” be reconciled with the FLUX.2 results in Tables 4 and 6?
5.What evidence distinguishes “the generator can operate without prompt-specific contextualized embeddings” from “the generator does not use contextual information in full embeddings”? Could the mechanistic claims be qualified accordingly?
7 comments
Response to Reviewer DZr6 - part 2
Clarifying the "On Par" Claim (W3)
Our central finding is that, somewhat surprisingly, removing prompt-specific contextual information often preserves a large fraction of the image generation model's capabilities, even for prompts involving complex linguistic relationships. In the paper, we primarily evaluate this phenomenon using VLM-based comparisons across MS-COCO, DrawBench, and GenEval, measuring the frequency with which generations using BoPTW are not judged inferior to those using full embeddings. We use the term “on par” specifically to refer to the VLM-based evaluation across all three datasets (MS-COCO, DrawBench, and GenEval). This conclusion applies consistently across all experiments using this evaluation protocol. In particular, our results demonstrate near-complete sufficiency across most prompts for FLUX.1 and SD3 across all evaluated datasets, as well as for FLUX.2 across most evaluated prompt categories. We would also like to emphasize that, even when considering the GenEval benchmark (Table 5), FLUX.1 and SD3 achieve success rates with contextless embeddings that are close to those obtained with full contextual embeddings (63.9 vs. 66.0 and 70.7 vs. 70.4, respectively). For FLUX.2, the performance gap is larger (71.3 vs. 82.3), particularly for two-object generation and attribute binding. Nevertheless, BoPTW retains substantial capabilities even in this setting, achieving strong results in single-object generation, counting, and color fidelity single-object generation, counting, color, and position despite the removal of prompt-specific contextual information. We also acknowledge that the performance gap becomes more pronounced for long, complex prompts, as demonstrated by the DPG results. These findings indicate that contextual information can be important, particularly for certain models and tasks. To better reflect these findings and avoid overly broad claims, we have revised the abstract and main text, replacing blanket statements that the methods are “on par” with the more nuanced phrasing “usually on par.”
The reported “non-inferiority rate” (W3)
We focus on the question of when contextless embeddings are sufficient to generate images that adhere to the prompt. From this perspective, the non-inferiority rate is an appropriate metric, as it measures the proportion of prompts for which full contextual embeddings are not preferred, indicating that contextless embeddings are sufficient to achieve comparable prompt adherence. We would like to emphasize that a-priori, one would not expect the contextless embeddings to outperform the full embeddings on any prompt. In other words, one would expect the non-inferiority rate, which combines wins and ties, to be dominated by ties. The fact that in practice we observe a non negligible proportion of wins, is a surprising observation in its own right.
Behavioral sufficiency is not equivalent to non-use or a demonstrated mechanism (W4)
We agree with the reviewer on this subtlety. Our experiments demonstrate that replacing contextualized text embeddings with BoPTW representations preserves much of the generation performance across the evaluated models and benchmarks. This shows that rich, prompt-specific contextualization is not necessary to achieve this level of performance under the evaluated conditions. We agree, however, that this does not establish that the image generator does not exploit contextual information when it is available, nor does it reveal how the generator processes the different representations internally. In particular, the generator may leverage contextual information from full embeddings while also being capable of exploiting word identities and positions when contextualization is removed. Establishing whether, and how, the generator uses contextual information internally would require a separate investigation beyond the scope of our behavioral comparisons. To address this concern, we have revised the manuscript to distinguish between the sufficiency of BoPTW representations for generation and claims about the internal use or processing of contextual information. We have also moderated our wording to avoid implying that contextual information is never used by the image generator. Instead of the phrase "models do not use" we wrote "models are robust to the removal of prompt-specific context" and instead of "proves" we wrote "demonstrates that DiTs can reconstruct relational structure without context".
Response to Reviewer DZr6 - part 3
Interpretation of attention maps (W4)
We agree that the progressive localization observed in Figure 20 is consistent with internal semantic processing but does not establish a causal mechanism. Nevertheless, it illustrates that the image is progressively constructed across the denoising timesteps, even when conditioning on contextless embeddings. Accordingly, we replaced the word "proves" with the more cautious formulation "demonstrates that DiTs can reconstruct relational structure without prompt-specific contextualization."
Stability across semantically matched paraphrases and controlled changes in prompt detail (Q3)
We thank the reviewer for raising these points. To address this concern, we conducted additional experiments using semantically matched paraphrases by randomly sampling 100 prompts from the MSCOCO validation dataset and generating five context-preserving variations for each using FLUX.1 model. For instance, given the prompt “A group of stuffed animals and guinea pig sitting on a couch.”, the variations include “A fluffy guinea pig relaxing on a sofa alongside an assortment of colorful stuffed animals.”, “A cute guinea pig hanging out and cuddling with a collection of plush toys on a cozy couch.”, “Several plush animals and a real guinea pig lounging comfortably together on a living room couch, soft lighting.”, “A close-up shot of a live guinea pig sitting right in the middle of various stuffed animals on a fabric sofa.”, and “A comfortable couch occupied by a mix of stuffed animals and a guinea pig.” Then, we generated five images per variation across seeds using both the full embedding and the BoPTW contextless embeddings, applying the evaluation protocol established in the paper we get a non-inferiority rate of 68%.Specifically, in 32% of the prompts, the full embedding is preferred, at 45% in the prompts, equal preferences (ties) and for 23% of the prompts the contextless embedding is preferred. We also measured the absolute task-success. Using a VLM to judge whether the image is adhered to the text prompt or not, we got absolute task-success 75% for the full embeddings and 72% for the contextless embeddings. Using the Wilson test, we get confidence intervals of [71.%, 78.3%] for the full embeddings and [68.28%, 75.44%] for the BoPTW contextless embeddings.
Which benefits inherited from the original pretrained encoder remain in the averaged representations? (Q3)
The averaged representations remain in, or close to, the representation manifold learned by the pretrained text encoder, thereby preserving its pretrained semantic structure but nothing related to the context of the word or token. Please kindly note that once a token's embedding is taken from one prompt and transplanted into a different prompt, it is already "context-free" with respect to the new prompt. Namely, it no longer carries the context of the prompt it was originally embedded in. For example, if we take the embedding of the token "cat" from the prompt "The cat is black" and insert it in place of the token "cat" in the prompt "The cat and the dog", that embedding is now decoupled from its original context ("The cat is black") and carries no information about the new prompt's context ("The cat and the dog") either. And naturally, this holds in our case as well: we take the embedding of each token from at least 10 (in many cases from much more, above hundreds) different prompts (with their own distinct context) and use it within a different prompt that has an entirely different context from those we used to extract the embeddings.
Can the authors provide prompt-level uncertainty estimates and absolute task-success comparisons (Q3)
We thank the reviewer for this suggestion. We measured both prompt-level uncertainty and absolute success rates across all datasets and models. We used Gemma-3 as a judge to evaluate whether each generated image adhered to its corresponding text prompt. We added the meta-prompt used for this evaluation to the manuscript. For each model and dataset, we separately measured the number of successful and number of unsuccessful generations according to the VLM, using the same number of seeds per prompt as in the paper (5 for GenEval and DrawBech, 1 for MSCOCO). We then calculated the success and failure rates and reported the corresponding 95% confidence intervals using the Wilson method. See Figure 10. We can see that the gap between the contextless and the full embedding is on average ~7% in SD3, ~5% in FLUX.1 and ~13% in FLUX.2.
Response to Reviewer DZr6 - part 1
The influence of text embeddings on training (W1)
We thank the reviewer for this insightful point. We agree that text representation quality can fundamentally shape a model's training regime. Please note that we trained two conditional generative models of comparable capacity (30M parameters): a convolutional U-Net and a diffusion Transformer (DiT). Both models receive representations from a frozen T5-XXL text encoder (see section B.3.1 in the Appendix) and found cohesion with the results in the main paper. Actual sampling steps, schedulers, or guidance settings (W1,Q1) In all experiments we use the default configuration of the image model. All image-generation configurations are kept identical across our comparisons, including the number of sampling steps (28 for SD3, 4 for FLUX.1 and FLUX.2), sampling scheduler (FlowMatchEulerDiscreteScheduler), CFG scale (0.0 for FLUX.1, 1.0 for FLUX.2 and 7.5 for SD.3). We added it to the paper (Table 9).
The intervention retains averaged representations produced by large pretrained encoders (W2)
We thank the reviewer for the opportunity to clarify this important distinction. The reviewer is correct that BoPTW embeddings preserve contextual statistics associated with a word appearing at a particular position. As the reviewer notes, these statistics are independent of the specific input prompt and do not encode the relationships between words appearing together in that particular prompt. Rather, they reflect general patterns learned by the pretrained text encoder across different contexts. However, this does not imply that word-level encoders cannot provide such conditioning. Constant position-dependent statistical patterns can be captured by fixed, precomputed embeddings for each word at each position, without requiring prompt-specific contextualization. Therefore, they could potentially be learned by a word-level encoder with a positional encoding mechanism, if it is trained together with the image model. In fact, the patterns do not even require an encoder; they can be captured, e.g. by a fixed precomputed dictionary for each position (similarly to how we construct our embeddings). We would like to emphasize that we do not advocate for these approaches as practical solutions. We provide these examples only to illustrate that supplying the image model with fixed per-position patterns does not necessitate the contextualization mechanism of current text encoders.
Acknowledgment of sensitivity limitations (W2)
To address the reviewer’s prompt-sensitivity concern, we conducted additional experiments using semantically matched paraphrases by randomly sampling 100 prompts from the MSCOCO validation dataset and generating five context-preserving variations for each using the FLUX.1 model. For instance, for the prompt “A group of stuffed animals and guinea pig sitting on a couch.”, the variations include “A fluffy guinea pig relaxing on a sofa alongside an assortment of colorful stuffed animals.”, “A cute guinea pig hanging out and cuddling with a collection of plush toys on a cozy couch.”, “Several plush animals and a real guinea pig lounging comfortably together on a living room couch, soft lighting.”, “A close-up shot of a live guinea pig sitting right in the middle of various stuffed animals on a fabric sofa.”, and “A comfortable couch occupied by a mix of stuffed animals and a guinea pig.” For each variation, we generated five images with different seeds using both the full embedding and the BoPTW embedding. Applying the evaluation protocol established in the paper we get a non-inferiority rate of 68%. Specifically, for 32% of the prompts the full embeddings are preferred, for 45% of the two embeddings are equally preferred (ties) and for 23% of the prompts the BoPTW embeddings are preferred. We also measured the absolute success rates using a VLM that is tasked to judge whether each individual image adheres to the text prompt. The success rates were 75% for the full embeddings and 72% for the BoPTW embeddings. Using the Wilson test, we get confidence intervals of [71.%, 78.3%] for the full embeddings and [68.28%, 75.44%] for the BoPTW embeddings.