- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
Existing interventions choose the perturbation operator by trial-and-error such as blurring, masking, shuffling, or replacing attention. Instead, this paper investigates the statement 'Can training-free diffusion guidance be improved by replacing heuristic attention perturbations with principled, energy-minimizing dynamics?' They propose to use a PDE inspired by Landau–de Gennes (LdG) theory a free-energy framework for fields with directional order. On MS-COCO, the method improves over SDXL and SEG.
Critical strengths
-
the paper proposes a new theory, possibly more principled, the method is complicated, but the authors do reasonable job in motivating and explaining the proposed method. The division in anisotropic and isotropic parts which are separately operated on by the PDE seems plausible.
-
results on COCO and especially those on quantized networks show improved results with respect to SEG (NeurIPS 2024) (I need however more clarifications (see below) to value these results)
Critical weaknesses
-
The quantitative results are few, the authors only compare with SEG; in the introduction the method is explained to compete with self-attention guidance, perturbed-attention guidance , smoothed energy guidance and more recent token-level perturbation methods (TPG) but in the end they only compare to SEG. Can the authors explain why, and/or add more results. Could a comparison with just CFG be added? And similarly as the TPG paper, could you include results for conditioned and unconditioned (which showed superiority of CFG for conditioned) ?
-
The work is written for people with knowledge of SEG, PAG research line. However these are not highly cited works. For the more general DM-research community, I think the paper presentation could still be improved of multiple points (see comments below). Clear impact statement, scope (models trained unconditionally), further analysis of limitations of current methods (problem statement).
Questions for authors
In the SEG paper it is clearly stated that the focus is on unconditional models; in your paper the word unconditional only shows up in the conclusion. This should be clear from early on in the paper if that is the scope.
The motivation why 'Classifier-free guidance' remains an important research topic could be improved.
I think that a better explanation or analysis how 'Gaussian blur used in prior attention-smoothing approaches treat all directions uniformly and can attenuate useful anisotropic structure, producing overregularization, flat texture, and weaker spatial coherence when guidance is strong. ' could still strengthen the paper. The paper says a few times it is doing similar as other methods but more principled, which I think is fine, but I think it is stronger if you can also improve the analysis why other methods potentially fail (problem-> solution structure).
minor: The authors say 'We propose to act on the attention tensor....' , this statement seems to suggest that also other choices could have been made. What other locations could have been chosen ?
Could the authors elaborate on this 'This view also aligns with recent stochastic-thermodynamic perspectives on generative modeling...'.
5 comments
4. Why CFG-related guidance remains important
Thank you for the suggestion. CFG requires a conditional model and a second, unconditional pass, it degrades at high guidance scales, and it is not available for guidance-distilled models. Attention-perturbation guidance avoids all three: it needs no conditioning, it adds to CFG at every scale, and it works on guidance-distilled models. On FLUX.1-dev, where true CFG is not used, LdG lowers FID from 26.62 to 25.88 and improves ImageReward, Aesthetic, PickScore and HPSv2. We have added this motivation to the introduction.
5. Why Gaussian blur falls short
This is a good point, and we have restructured the introduction and Sec. 4. SEG blurs the attention queries, and its guidance is strongest when σ→∞. In that limit every query is replaced by the global mean, which removes all spatial structure in the perturbed branch, not only the unstable part. The LdG step, by contrast, is local: it damps high-curvature components and keeps the large-scale layout. The data support this directly. With the same extra branch, replacing SEG's blur by the LdG step improves every metric in every setting we tested:
| SEG → LdG | FID↓ | ImageReward↑ | Aesthetic↑ |
|---|---|---|---|
| without CFG | 27.64 → 26.72 | -0.088 → 0.239 | 5.704 → 5.791 |
| with CFG (w=3) | 16.55 → 16.48 | 0.482 → 0.543 | 5.548 → 5.551 |
| INT4, without CFG | 27.10 → 23.93 | -0.215 → 0.179 | 5.575 → 5.721 |
| unconditional | 86.98 → 82.24 | – | 5.763 → 5.805 |
We have added this comparison next to Fig. 4.
6. Other locations where guidance could act
Thanks for the question. Guidance can act at several places: on the score or latent (CFG), on intermediate features (SAG, which blurs the regions selected by its attention mask), on the attention map (PAG, which replaces it with the identity), on the tokens (TPG, which shuffles them), or on the attention queries (SEG and LdG). We act on the attention field because it is a spatial field over image positions. The Laplacian and the energy then have a direct meaning there, and the update is cheap. We have added this to Sec. 3.
7. The stochastic-thermodynamics sentence
We thank the reviewer for asking us to elaborate. Recent work (e.g. Welling et al., 2026) views diffusion sampling as a non-equilibrium process organized by free-energy dissipation and gradient-flow structure. Our update is a gradient flow of a free energy on the attention field, so it fits this view at the level of internal representations. The method does not depend on this connection, and we have rephrased the sentence to present it as context rather than a claim.
8. Presentation and impact statement
We appreciate the reviewer's comment about presentation. We have added a short list of contributions and the scope at the end of the introduction, and a brief impact paragraph in the conclusion. We have also made the problem statement on isotropic smoothing (point 5 above) explicit. We believe this will make the paper more accessible to the broader diffusion-model community.
If the clarification(s) above address the reviewer's concerns, we will promptly upload the revised PDF, which incorporates all of these changes marked in blue.
Dear Reviewer, we thank you again for your time and valuable feedback. As the discussion period is coming to an end, we wanted to check whether our responses have addressed all your concerns. We would be grateful for any further feedback, and we are happy to clarify anything that remains unclear.
Dear Reviewer,
We thank you for taking the time and effort to review our work and providing valuable feedback. We appreciate the positive view of the formulation and of the quantized results, and seek to clarify the concerns. A summary of all new results, with the exact references for every baseline, is in our general response. Unless stated otherwise, all new results are on MS-COCO with 10K images, with identical captions and seeds across methods.
1. Comparison beyond SEG, including CFG
Thank you for the suggestion. We now compare against SAG, PAG, SEG, TPG and CFG, with every method's scale chosen from the same 1K sweep.
Without CFG, LdG is best on CLIP, ImageReward, Aesthetic, PickScore and HPSv2. For example, its ImageReward is 0.239, against -0.088 (SEG), -0.170 (PAG), -0.129 (TPG) and -0.703 (SAG). Under 4-bit quantization it is best on all six metrics. With CFG (w=3):
LdG gives the best ImageReward, PickScore and HPSv2. More importantly, CFG and LdG are two different forms of guidance, one along the text condition and one along the spatial structure of attention, and they combine well. For every CFG scale from 1.5 to 7.5, adding LdG raises ImageReward, Aesthetic, PickScore and HPSv2. For w ≤ 3 it also lowers FID, from 63.00 to 51.71 at w=1.5 and from 54.65 to 50.24 at w=2.
2. Conditional and unconditional results
Following the TPG protocol, we also ran the unconditional setting with an empty prompt:
LdG gives the best Aesthetic score and reduces FID by 35% over no guidance, second only to TPG.
With this, LdG now covers conditional generation without CFG, conditional generation with CFG, and unconditional generation. As the TPG paper also observed, CFG remains strong for conditional FID. LdG adds to CFG rather than competing with it.
3. Scope and Contributions of the paper
We agree, and thank the reviewer for this. We have made the scope and the contributions explicit at the end of the introduction and in Sec. 6. The paper makes two contributions. First, LdG is a principled guidance mechanism: it perturbs the attention of a pretrained diffusion model along the descent direction of a Landau–de Gennes free energy, rather than by a heuristic blur, mask or shuffle. It applies to text-conditional generation with and without CFG and to unconditional generation, on UNet, MMDiT and guidance-distilled models. Second, as a practical application, LdG is especially effective for 4-bit quantized models: under INT4 it is the best method on all six metrics, and it loses the least quality from FP16 to INT4 on every metric. We have also corrected the phrase "unconditional guidance strategies" in the conclusion (L477), which should read "attention-perturbation guidance strategies".