- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates how denoising guidance contributes to compositional creativity in diffusion models. The authors analyze late-stage deterministic DDIM sampling and connect denoising dynamics to conditional PCA and power iteration on the denoiser Jacobian. Experiments on a pretrained ImageNet DiT model are presented to illustrate how switching class conditions during denoising can alter semantic content while preserving parts of the intermediate image structure.
Critical strengths
The paper investigates an interesting question regarding the relationship between denoising dynamics and compositional creativity. Connecting local denoiser geometry with class-dependent semantic adaptation offers a potentially useful perspective for understanding diffusion models.
Critical weaknesses
-
A gap between the theoretical analysis and the claimed guidance mechanism. The paper motivates its contribution through classifier-free guidance and creative generation, but the central conditional PCA analysis is derived for the ideal denoiser with guidance weight . It is therefore unclear whether the proposed theoretical interpretation extends to classifier-free guidance with nonzero guidance scales. Moreover, the power-iteration analysis relies on a local approximation whose validity depends on the Jacobian remaining sufficiently stable along the trajectory. The paper should clarify these assumptions and provide stronger evidence that the theoretical conclusions apply to the actual guided sampling process.
-
Insufficient comparisons with existing methods and analytical baselines. Although the paper includes comparisons between standard and time-frozen denoising, it lacks systematic comparisons with existing guidance-switching and compositional generation approaches. Prior methods investigating condition switching and time-dependent semantic control are discussed, but their behaviors are not directly compared under consistent experimental settings. Additional comparisons with fixed switching schedules, different guidance strengths, and existing concept-switching methods would help establish whether the observed behavior represents a distinctive mechanism rather than a previously known consequence of conditional denoising.
-
Insufficient quantitative evaluation of the central creativity claim. The experimental evidence relies heavily on visual examples, Jacobian eigendirections, projection measurements, and a limited ResNet-50 classification experiment. These analyses provide some support for the proposed geometric interpretation but do not directly establish that guidance produces more creative or compositionally novel images. In particular, classification accuracy only measures whether the generated image resembles the target class; it does not quantify whether semantic information from the original class is preserved or meaningfully combined with the new class. More direct metrics for compositional novelty, structural preservation, semantic integration, and human-perceived creativity are needed.
-
Limited experimental generalizability. The empirical investigation is primarily conducted on a single ImageNet-trained DiT model, with several analyses focusing on a small number of class combinations, such as dogs and eagles. It remains unclear whether the identified conditional PCA and power-iteration behavior generalizes to modern text-conditioned diffusion models, different architectures, or more complex multi-concept compositions. Furthermore, the paper does not sufficiently analyze how switching time, guidance strength, and semantic similarity between source and target classes affect the proposed mechanism.
Questions for authors
See weakness
4 comments
Dear Reviewer,
Thank you again for your great work on reviewing this paper submission to ICLR 2027.
The authors have now submitted their rebuttal. The open reviewer-author discussion phase will end soon, on November 18 at 11:59 PM AoE.
Please read the authors' responses, determine whether any further clarification is needed, and respond to the rebuttal at your earliest convenience. Please be sure to acknowledge the authors' responses and update your review accordingly.
Best regards, Your AC
I appreciate the authors' addition of quantitative experiments and Table 1, which I have carefully reviewed. However, the theoretical analysis still mainly revolves around w=0, and the stability of CFG and Jacobian is not fully explained; the comparison with existing switching methods is also too interpretive and lacks a systematic approach; more importantly, I haven't seen many more combinatorial innovation results like those in Fig. 6 in the updated PDF. My core concerns remain, so I apologize, but I still prefer to retain the original rating.
Update
We have extensively revised the manuscript to address your concerns. In particular, Figures 4-5 in the main text and Figures 8–12 in the appendix present several new experiments. We hope you will reconsider your evaluation in light of these updates. Thank you.
Rebuttal
Thank you very much for your time reviewing the submission. To address your concerns, we uploaded a revision with changes highlighted in dark blue.
We provided a quantitate definition of creativity with experiments on 1000 generated images from 61 image classes of Image Net in the revised Section 2.
The preserved part from the original class (source class) is term y which is obtained by denoising guidance of the source class. Our theoretical result in line 349 (of the revised pdf) are surprising: the emerging creativity are obtained by summing up a noisy image from one class a PCA from another class. These images are can be classified as target class T with nearest neighbor from source class S; see Table 1.
Please check the proposed metric in the revised Section 2 and let us know if this metric is convincing enough for blending two image classes. Note that there is no consensus on the notion of creativity. Here, we are studying specific notion of creativity: generating images classified as a target image class T with nearest neighbor training image from the source class S. Our motivation is that switching guidance can generate such images as shown in Figure 2 (and Table 1).
Our theoretical analysis shows that the bound holds for any model satisfying the Lipschitz conditions in Appendix C.1 and C.2. Although the analysis is motivated by our experiments, it goes beyond them: it gives sufficient conditions under which the same result holds, so it is not tied to the specific models we tested.
Prior work is often model-specific as well. For example, Kadkhodaie et al. (2024), an ICLR 2024 award-winning paper, and Bonnaire et al. (2025), a NeurIPS 2025 best paper, each focus on a single model setting. Thus, studying a single model in depth is well accepted by the community, as the two works with this limitations awarded best paper awards in ICLR and NeurIPS. Our work offers this depth and, in addition, a general analysis that extends beyond the models we tested.
Our added more experimental results on 1000 images from 61 image classes in the revised Section 2. We analyzed the semantic similarity between source and target in Section 6, switching time is the focus of our analysis as we discussed in Proposition 4.1.
We analyzed the guidance switch mechansim proposed in prior studies (Liew et al., 2022; Choi et al., 2024): It starts from denoising toward source class S and the switch to the target class T. Our question is why this specific denoising mechansim generates images from class T whose closest training images from S (see Figure 2). Note that w=0 is often used for improving FID score and guide samples towards a single image class. What we argue here is that we can mix images from different classes with the guidance switch mechansim. The goal of original classifier-free guidance paper was not mixing images from different classes. We added results in Table 1 confirming that without switching denoising does not combine different image classes.
We are not proposing a novel method, we are analyzing the guidance switch mechansim and explain how it generates images that combines elements from two different image classes. The switch mechansim is studied in prior works (Liew et al., 2022; Choi et al., 2024). Our claim is not that the guidance switch is the best or a better method to encourage creativity. Here, we explain how it works and generate images combining two classes. We provide extensive comparisons to related works studying the origin of generalization and creativity in diffusion models in Section 5.