- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper addresses the computational overhead of traditional Classifier-Free Guidance (CFG), which requires both conditional and unconditional predictions, as well as the lack of a directional theoretical explanation for existing attention-space guidance methods. It proposes Directional Attention Guidance (DAG), a training-free guidance method. Based on Modern Hopfield retrieval theory, the method analyzes the discrepancy between sparse and dense attention and selectively amplifies the component aligned with the sparse retrieval direction through projection to improve image generation quality. Experiments across different architectures, including SDXL, FLUX, and Qwen-Image, as well as multi-step and few-step sampling regimes, demonstrate that DAG generally achieves better performance than the baselines and PLADIS on the GenEval text–image alignment benchmark and several human-preference metrics.
Critical strengths
-
To address the lack of a directional theoretical explanation for existing attention-space guidance methods, this paper proposes DAG. The method requires no additional training or modifications to model weights, performs guidance within a single model forward pass, and can be combined with existing guidance methods.
-
The authors evaluate the proposed method across various model architectures and sampling-step settings. DAG consistently improves GenEval scores on all tested models, while also achieving overall improvements in several human-preference proxy metrics.
Critical weaknesses
-
Although the paper emphasizes that DAG does not require an additional full model forward pass, it still introduces extra computations for attention and projection. In Table 2, DAG consistently incurs higher inference latency than both the base sampler and PLADIS.
-
The evaluation coverage is still limited. The experiments primarily focus on GenEval and MS-COCO, without evaluations on other commonly used benchmarks covering more diverse prompt types, such as DrawBench (Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding), PartiPrompts (Scaling Autoregressive Models for Content-Rich Text-to-Image Generation), and Pick-a-Pic (Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation). Furthermore, comparisons with some relevant methods are missing, such as ADG (Angle Domain Guidance: Latent Diffusion Requires Rotation Rather Than Extrapolation). ADG and DAG are closely related in their research motivations. ADG investigates angular alignment in the model prediction space, whereas DAG studies directional geometry in attention space. Although ADG is cited in the Introduction, the paper does not provide an experimental comparison with it.
-
The theoretical analysis has significant shortcomings.
- The claim regarding the common attractor in Corollary 1(b), does not hold and can be disproved by a simple two-pattern Hopfield counterexample. Consider a one-dimensional system with two stored patterns:
In a neighborhood of , sparse retrieval has already reached the collapse threshold, so
Therefore, for any finite ,
For any ,
-
The authors interpret the projected component as a theoretically justified convergence-accelerating direction. However, Theorem 1 establishes directional alignment for the full residual, which does not directly guarantee that the component retained after DAG's projection remains a convergence-accelerating direction. Moreover, orthogonality in the attention probability space does not guarantee orthogonality in the output space after the Value mapping.
-
In real attention layers, Keys and Values are typically obtained through separate linear projections, whereas the underlying Hopfield model in this paper uses the same pattern matrix for similarity computation and retrieval output reconstruction. The authors should further clarify how independent Key and Value projections affect the retrieval error, directional alignment, and fixed-point conclusions.
Questions for authors
Please see the weaknesses.