- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes an inference-time method to improve the generation diversity of distilled single- and few-step diffusion models. It injects spatially coherent noise to the intermediate features by projecting the noise onto the principal components of the model’s activations. Experiments are conducted on the MM-DiT-based FLUX.1-schnell and SD3.5 Large Turbo models across diverse datasets, demonstrating that the proposed method successfully improves the diversity of generated images and largely preserves the text alignment capability, while requiring no additional training or model forward passes.
Critical strengths
-
The paper investigates a practical setting in which distilled single- and few-step diffusion models can be guided at inference-time for improved generation diversity. The method is well-motivated, intuitive, and simple by design.
-
Extensive empirical evaluations are presented across different models and datasets. Thorough ablative analyses and computational cost reports are also provided.
Critical weaknesses
-
The authors describe the PCA subspace of spatial patches as the “learned feature manifold” or “local tangent space”, but what these subspaces really mean semantically remains unclear and is not supported by further evidence.
-
Some related methods, such as [1-3], are not discussed. TPG is described as a close neighbor, but its perturbation mechanism is not included in the evaluation. SSG [4] is another close neighbor to STRIDE but is neither discussed nor evaluated.
-
The choices of layers and steps at which to apply STRIDE appear highly heuristic, which limits the generalizability and applicability of the method.
-
The computational cost does not appear favorable, despite the method requiring a single model forward pass. Section 4.2 and Table S11 show that the configurations used for the main experimental results may incur up to 150-200% latency increases. This would call the practical significance and the “single-forward-pass” efficiency claim into question.
[1] Park et al. “Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometry”. NeurIPS 2023.
[2] Mo et al. “FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition”. CVPR 2024.
[3] Kwon et al. “Breaking the Lock-in: Diversifying Text-to-Image Generation via Representation Modulation”. ICML 2026.
[4] Zhang et al. “Guiding a Diffusion Model by Swapping Its Tokens”. CVPR 2026.
Questions for authors
-
Could the authors evaluate the effect of token shuffling, as used in TPG, and token/channel swapping, as in SSG, as alternative perturbation mechanisms?
-
How well does the proposed mechanism generalize to U-Net-based diffusion models?
-
Why do Tables 1/S17 and S13/S10 report notably different diversity and CLIP results for the seemingly similar FLUX settings?