- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Early Spatial Guidance (ESG), a training-free method for improving spatial relations in text-to-image generation. ESG estimates object centers from native joint attention and uses their relative positions to guide latent updates during early sampling. The objective combines pairwise directional relations without specifying absolute object coordinates. Updates are normalized relative to the latent norm, and gradient computation uses only the transformer prefix needed for the selected attention readout. The paper analyzes readout sensitivity, interactions between relation gradients, and the limits of translating attention-level improvements into correct image layouts. Experiments on SD3 and SD3.5 cover GenEval position, T2I-CompBench spatial relations, unseen object pairs, and controlled multi-object scenes. The reported results show improved spatial alignment at competitive inference cost, supported by comparisons with existing controllers, time-matched native sampling, and matched objective controls.
Critical strengths
-
ESG provides a simple, training-free approach to spatial control without requiring user-specified object coordinates. Normalized latent updates and gradient computation through the selected transformer prefix make the method practical, with reported improvements even from a single early intervention.
-
The empirical evaluation includes paired comparisons under common computation budgets, time-matched native sampling, and controls that change only the spatial objective. These experiments provide meaningful evidence that the improvements go beyond simply spending more time on generation.
-
The paper carefully distinguishes attention-level behavior from final image correctness. Its analysis identifies limitations of combining relation gradients, while the experiments report both average relation accuracy and all-relations success, alongside object-count and image-quality diagnostics. This makes the benefits and limitations easier to assess.
Critical weaknesses
-
The paper does not adequately discuss related training-free layout-control methods, including BoxDiff, Layout Guidance, Attention Refocusing, R&B and MAC. Their relevance should be clarified, including whether a representative comparison is feasible under matched input and computation budgets.
-
The multi-object absolute-position control can assign conflicting targets to shared objects, making it difficult to separate the benefit of relative constraints from weaknesses in the comparator’s construction.
-
The summed relation objective cancels intermediate object coordinates in collinear chains. Although acknowledged, this limits direct control over individual relations; the experiments do not compare against an objective that specifically targets unsatisfied relations.
Questions for authors
-
How does ESG relate to BoxDiff [1], Layout Guidance [2], Attention Refocusing [3], R&B [4], and MAC [5]? Could a representative method be compared using layouts derived from the same relation inputs and a comparable computation budget?
-
Does ESG retain its advantage when the absolute-position control uses globally consistent targets for shared objects, with the same readout and update procedure?
-
How does cancellation of intermediate coordinates affect chain compositions? Would an objective that specifically targets unsatisfied relations improve all-relations success under the same update budget?
Reference:
[1] Jinheng Xie et al. BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion. ICCV, 2023.
[2] Minghao Chen, Iro Laina, and Andrea Vedaldi. Training-Free Layout Control With Cross-Attention Guidance. WACV, 2024.
[3] Quynh Phung, Songwei Ge, and Jia-Bin Huang. Grounded Text-to-Image Synthesis with Attention Refocusing. CVPR, 2024.
[4] Jiayu Xiao, Henglei Lv, Liang Li, Shuhui Wang, and Qingming Huang. R&B: Region and Boundary Aware Zero-shot Grounded Text-to-image Generation. ICLR, 2024.
[5] Huancheng Chen, Jingtao Li, Weiming Zhuang, Haris Vikalo, and Lingjuan Lyu. Training-Free Layout-to-Image Generation with Marginal Attention Constraints. CVPR Workshops, 2026.