- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies interactions between text and spatial conditioning through matched four-condition interventions during different denoising windows. A smaller SDXL experiment shows that removing text harms adherence when spatial control is present but improves it when control is absent, reversing the schedule ranking predicted by adding separate ablation effects. The paper also examines temporal dependence and distinguishes spatial adherence from perceptual distance to the fully conditioned output.
Critical strengths
- The counterintuitive observation was supported across multiple control configurations.
- The factorial comparison connects interactions to an actual decision error. The paper clearly distinguishes the direct joint-removal advantage from the factorial interaction and from a conditional sign reversal.
- The comparisons match scenes and initial latents, and the bootstrap resamples scenes while retaining their repeated generations together.
Critical weaknesses
-
Emptying text makes the conditional and unconditional branches coincide, eliminating classifier-free guidance extrapolation as well as prompt information. Section 6 acknowledges this issue, but the key control of retaining the original prompt at guidance scale 1 is not reported. This matters because prior work already finds early guidance detrimental in other diffusion settings (Kynkaanniemi et al., 2024, https://arxiv.org/abs/2404.07724). The observed ordering is credible under the stated intervention, but its explanation and significance as text-spatial competition remain uncertain. Comparing empty text against retained text at scale 1, with spatial control both present and absent, would help establish what drives the conditional reversal.
-
The four main configurations share an SD1.5 host, one 30-step DDIM protocol, and fixed guidance and control scales. The clearest sign reversal is demonstrated on only 50 development scenes in SDXL. That comparison also changes the control checkpoint, output resolution, and empty-conditioning convention together (Section 4). Moreover, the interaction interpretation was developed after inspecting outputs, as disclosed in Section 3.3. These facts do not invalidate the reported paired differences, but leave uncertainty about how reliably the central finding extends beyond the explored settings. A held-out SDXL replication and sensitivity to interruption length or sampler choice would substantially strengthen the evidence.
Questions for authors
-
Regarding Weakness 1, could you compare three early-window settings: the original prompt at guidance scale 7.5, the original prompt at scale 1, and empty text, each with spatial control present and absent? Please keep the continuation unchanged. Does removing prompt information still improve adherence once extrapolation is disabled? This targeted control could materially change the interpretation of the main result.
-
Regarding Weakness 2, please clarify when the 50 SDXL development scenes and the sign-reversal analysis were selected relative to inspecting the outputs. Is there a replication on held-out scenes under a fixed protocol? If available, reporting the two conditional effects and reversal frequencies on that set would materially strengthen confidence. Testing additional denoiser families would be useful future work, but is not essential to answer this question.
-
Most of the figures in the article are probably AI-generated, which I don't find very intuitive. Could you please create them manually to make them more visually appealing?