- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper asks which internal attention signals affect the t2i generation in sd3/3.5 mmdits. The authors find that some highly attended padding and special-token positions have a substantial effect on the final visual semantics like shape and layouts. These findings identify some influential text positions in the tested setting, but do not solidly explain what information they carry or why their role is distinctive.
Critical strengths
- The authors conducted extensive analytical experiments and presented massive details
- The manuscript carefully acknowledges the limitations of its controls and evidences.
Critical weaknesses
- The experiments show that influential attention signals are concentrated at dynamically selected structural text positions, but do not explain what information these positions carry or why they are distinctive. While the authors do acknowledge this limitation, the lack of an explainable mechanism makes it difficult for the community to learn useful insights from this work.
- The semantic preservation is insufficiently tested under more complex prompts. Tests on, for example, GenEval2/HPSv3 prompts, are crucial for validating the findings in real-world complex needs.
- The verified primary evidence is concentrated on sd3 / flux.1 (older mmdits in 2024). More results on modern backbones like flux.2 klein (newer mmdit) / z-image-base are needed.
- The presentation is bad. For example, the main text relies heavily on tables and prose, with only two figures and little visualization.
Questions for authors
- Why are these positions referred to as "routing" roles rather than high-impact contextualized representations?
- What does Proposition 1 explain or predict beyond a general perturbation argument. I don't quite understand the point of presenting this mathematics.
Thank you for providing additional clarifications and experimental results. While the author provided extensive revisions:
While the authors provide extensive experimental results throughout the paper, the main claim remains hard to get based on current version of manuscript. While the experimental results shows some interesting aspects and ablations, the manuscript not yet provides the clear takeaway or answer for specific research question they would like to discover. This would require major revision on presentation and organization of the manuscript. Thus I'm keeping my original rating.