- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates instability in training-free energy-guided spatial control for rectified flow models. The authors observe stronger early-stage anisotropy in the latent-feature Jacobians of the evaluated RFMs compared with score-based diffusion models, and identify it as a potential contributor to unstable guidance. They propose ScFlow, which introduces two inference-time corrections: channel-wise whitening of guidance gradients and prompt embedding reweighting. Experiments on ImageNet-R-TI2I across multiple spatial conditions and model backbones, supplemented by component ablations, sensitivity analyses, and human evaluation, demonstrate improved spatial and textual alignment over the uncorrected FreeControl baseline.
Critical strengths
-
Simple corrections with substantial empirical support. The proposed components are straightforward and require no additional model training. The experiments demonstrate improved spatial and textual alignment over FreeControl and favorable trade-offs against other training-free methods. The comparisons, component ablations, sensitivity studies, and human evaluation collectively support the method’s practical usefulness.
-
Clear and easy-to-follow presentation. The paper progresses logically from observed control failures to spectral analysis and then to the proposed corrections. The mathematical formulation and figures make the problem setup, motivation, and implementation accessible, helping readers follow the reasoning and assess the empirical evidence.
Critical weaknesses
-
Limited insight into the origin of the spectral differences. While the paper documents stronger early-stage Jacobian anisotropy in the evaluated RFMs, it provides limited explanation of why their spectra differ from those of score-based diffusion models. In particular, the connection between the observed phenomenon and rectified-flow training or rectification remains unclear. It would be nice that if the authors can provide a more insightful explanation of this phenomenon to strengthen the contribution.
-
Limited benchmark coverage. The quantitative spatial-control evaluation is primarily conducted on ImageNet-R-TI2I, a relatively small benchmark. Although multiple condition types and model backbones are evaluated, these experiments largely reuse the same underlying images, and the prompt-variation studies are also derived from the original evaluation set. This limits the evidence for generalization to more diverse scenes and conditions. Evaluation on an additional spatial-control benchmark, such as the prompt-driven conditional generation dataset released with Ctrl-X, would strengthen the empirical conclusions. I would be happy to raise my score if the authors provide convincing results on an additional benchmark that address the generalization concern,.
Questions for authors
-
Figure.6 presents results with C1 and C2 combined. It would be interesting to see how C2 performs on its own and whether it already brings improvements over the baseline. I am also curious about how much C2 helps with more complex prompts, such as the long descriptive and multi-object prompts explored in the appendix.
-
It would be useful to compare whitening with simpler alternatives, such as global gradient normalization or per-channel standardization. Could these methods achieve similar improvements with appropriately tuned guidance strengths? This would help clarify whether accounting for correlations between channels provides additional benefits.