- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a training-free self-guidance method for diffusion transformers. It obtains weaker predictions by applying the model’s shared output head to cached intermediate residual states, thereby avoiding repeated transformer-block computation. In its lite variant, the differences between the final and intermediate predictions serve as depth-based guidance directions, while the agreement between two depth probes adaptively modulates guidance across denoising timesteps and spatial tokens. The full version additionally incorporates a block-dropped width probe, combines the depth and width directions through norm matching. Both methods apply an orthogonal projection to the resulting gated correction. The paper motivates its agreement-based gating mechanism through a conditional error model and evaluates the method on various image and video generation tasks using multiple DiT backbones. Experiment results show consistent improvements over CFG and existing training-free guidance methods, while the Lite variant achieves a favorable quality–cost trade-off with only a small inference overhead.
Critical strengths
-
The observation that cached intermediate residual states can be decoded into useful weak predictions is both interesting and practically relevant. It enables HARMONY-Lite to construct self-guidance signals without repeating transformer-block computation or training an auxiliary model, resulting in a favorable quality–cost trade-off.
-
Extensive experimental validation is presented across different models and tasks, including class-conditional image generation, text-to-image generation, and text-to-video generation. The consistent improvements across DiT, SiT, SD3, FLUX, and Wan backbones, together with the component ablations, controlled study, latency analysis, and human evaluation, provide broad empirical support for the proposed method.
Critical weaknesses
-
Some important recent diffusion guidance methods [1-3] are neither discussed nor compared against. This is particularly important for Internal Guidance [3], which also constructs guidance from intermediate and final diffusion-transformer predictions.
-
The width probe is closely inherited from the stochastic block-dropping mechanism of S²-Guidance. Although the appendix provides partial ablations of the direction combination and gating components, it does not present a fully component-matched progression from the original S²-Guidance implementation to full HARMONY. Consequently, the novelty and empirical contribution specifically attributable to the depth probe and cross-probe agreement are not completely isolated.
-
The method appears to have limited generalizability to U-Net-based, few-step models, or shallower diffusion models. This is exacerbated by a range of heuristic design choices in the method. These factors undermine the practical applicability of the method.
-
A minor comment is that it is unclear how the method name “HARMONY” was derived. Clarifying whether it is an acronym or simply refers to the agreement between hierarchical probes would improve presentation.
[1] Hyung et al. “Spatiotemporal Skip Guidance for Enhanced Video Diffusion Sampling”. CVPR 2025.
[2] Zhang et al. “Guiding a Diffusion Model by Swapping Its Tokens”. CVPR 2026.
[3] Zhou et al. “Guiding a Diffusion Transformer with the Internal Dynamics of Itself”. CVPR 2026.
Questions for authors
-
Given that the width probe of the full method is closely related to S²-Guidance, could the authors provide a progressively component-matched ablation starting from the original S²-Guidance implementation? This would clarify how much of the improvement is specifically attributable to the depth probe and cross-probe agreement rather than to the other modifications.
-
On real diffusion models, does the agreement score correlate with the actual reduction in prediction error on forward-noised validation samples, where the target noise or velocity is known? Such an analysis would materially strengthen the central motivation of the method.