- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how attribute binding evolves during text-to-image diffusion sampling. It introduces the concept of binding crystallization, where attribute assignments become increasingly resistant to changes during denoising. Based on this analysis, the authors propose CrystalBind, a training-free attention guidance method that combines noun excitation, attribute attraction, and competitor suppression. Experiments show improvements in attribute binding and inference efficiency on SD v1.5 and SD v2.1.
Critical strengths
The paper provides extensive empirical analysis through counterfactual prompt switching, controlled perturbations, and trajectory-level measurements. These experiments offer a more detailed characterization of how attribute-binding sensitivity evolves during denoising, adding value beyond the proposed method.
Critical weaknesses
The central observation that semantic assignments become increasingly difficult to change during denoising is largely consistent with established diffusion dynamics. The analysis does not sufficiently establish a distinct binding-specific mechanism, while CrystalBind mainly builds on existing attention-guidance techniques. This limits the paper's contribution in both scientific understanding and methodological innovation.
Improvements over strong baselines such as CONFORM are modest, and the method is evaluated only on SD v1.5 and SD v2.1, what about more modern baselines such as Flux. Moreover, several T2I-CompBench categories are omitted, leaving potential trade-offs with other compositional abilities unexplored. These limitations make it difficult to assess the method's practical value and generalizability.
Questions for authors
What new mechanistic understanding does binding crystallization provide beyond the established observation that semantic structures become increasingly difficult to modify during denoising?
How can the authors demonstrate that binding crystallization reflects a binding-specific mechanism rather than general semantic commitment? Comparisons with object identity or spatial relationships could help.
What are the essential methodological differences between CrystalBind and existing attention guidance methods such as D&B and CONFORM? More controlled comparisons could better isolate the contributions of the proposed objectives and guidance schedule.
The evaluation omits several T2I-CompBench categories, including spatial relationships and numeracy. Could the authors report the full benchmark results to assess whether improvements in attribute binding come at the expense of other compositional abilities and to clarify the method's broader applicability?
How well do the proposed findings and guidance method generalize to modern diffusion architectures such as FLUX, SD3, or other DiT-based models?
Q1
Thank you for raising the question of whether our findings and method extend to more recent large-scale image generators.
We have not completed the requested comparisons on FLUX.2, Z-Image, or Stable Diffusion 3.5 Large during this rebuttal. We prioritized the controlled SynGen comparison because it directly addresses the central novelty concern. CrystalBind currently uses explicit cross-attention maps. Applying it to a different attention architecture requires adapting attention extraction and text-token mapping, then evaluating the resulting spatial targets and guidance schedule. This requires method development beyond replacing the checkpoint, even though the method does not require training.
The submitted analysis examines assignment changes on Stable Diffusion version 1.5, Stable Diffusion version 2.1, and PixArt-alpha, covering convolutional and transformer-based diffusion models. The guidance method is evaluated on the two Stable Diffusion models, with the objective, normalized step size, and intervention window transferred to version 2.1 without retuning.
These results establish the measured behavior on the tested models. The statement that binding is a “non-existing problem” requires quantitative evidence on the named newer models. Improved final-image performance also leaves a separate scientific question: why changing the requested assignment has less effect later in denoising, even while the model responds to the changed text. Our paper addresses that process directly.
Q2
We appreciate your suggestion to consider joint image–text attention, which helps clarify how the method depends on the model architecture.
A possible extension is to extract the part of joint attention in which image queries attend to text keys. Each noun or attribute token would then have an attention map over image tokens. Reshaping these image tokens to their spatial patch grid and aggregating the text tokens belonging to each word would provide the maps required by the overlap objective. Noun targets could remain fixed during each update and be recomputed afterward, as in CrystalBind.
The main architectural difference concerns normalization: joint attention distributes probability over both image and text keys, while conventional cross-attention normalizes over text keys. The selected maps therefore need to be evaluated for their spatial meaning and usefulness for guidance. Attention layers, token mapping, and the intervention window also require model-specific evaluation. We have not implemented or evaluated this extension during the response period; the construction above describes how the method could be adapted.