- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes CLOSER, a training-free inference-time scaling method for frozen diffusion/flow models with evaluator access. At one or a few fixed sampler positions, CLOSER (i) computes the gradient of a differentiable proposal objective by back-propagating through the exact remaining sampler and decoder, (ii) builds a small candidate set by moving the intermediate state along the normalized gradient with a fixed set of step sizes, (iii) completes each candidate with the unchanged suffix and scores the final image with a terminal selector , optionally subject to a preservation guard , and (iv) accepts the best feasible candidate or rolls back to the incoming state, recomputing the gradient after each acceptance. The authors separate proposal (J), selection (V), preservation (H), and reporting (M) roles. On SD3.5-Medium and Z-Image, CLOSER achieves the best scores on GenEval, DPG-Bench, and OneIG-EN. Controlled studies on SD3.5M analyze the role of each component and argue that early interventions favor structural changes while late interventions favor preference refinement.
Critical strengths
-
Strong empirical results. CLOSER ranks first in all six backbone–benchmark settings, with large margins on GenEval and DPG-Bench (Table 1), and the paired confidence intervals against Standard are all above zero (Fig. 4d).
-
Interesting position analysis. The link between intervention position, response frequency, and local directional reliability (Figs. 6–7) is an informative observation about where gradient-based corrections are trustworthy.
Critical weaknesses
-
Missing baselines. Particle-based (SMC) steering and path-search methods (e.g., FK steering [1], SVDD [2], DAS [3], and the search-over-paths variant of [4]) are not compared, so the benefit of closed-loop correction over alternative ways of spending the same compute remains unclear for me.
-
Limited generality. Positions, iterations, step-size menus, proxies, and selection rules differ across benchmarks and backbones (Tables 6–9), while baselines use one frozen setting, and the selection procedure is not described for GenEval and DPG. The intervention position must be chosen by the practitioner and does not transfer across backbones (Table 8), and this calibration cost does not appear to be included. Moreover, the method requires a differentiable proxy well aligned with the evaluator and white-box access to the generator, which limits its applicability compared with gradient-free approaches.
-
Cost reporting. Only wall-clock time is reported (up to ~50× on DPG, Fig. 3). NFE, peak memory, and per-prompt cost distributions are missing, even though the method back-propagates through the DiT.
-
Clarity. The paper packs many experiments into brief main-text descriptions, so they are hard to follow.
[1] R. Singhal et al. A General Framework for Inference-time Scaling and Steering of Diffusion Models. ICML 2025. arXiv:2501.06848.
[2] X. Li et al. Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decoding. NeurIPS 2025. arXiv:2408.08252.
[3] S. Kim et al. Test-time Alignment of Diffusion Models without Reward Over-optimization. ICLR 2025. arXiv:2501.05803.
[4] N. Ma et al. Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps. CVPR 2025. arXiv:2501.09732.
Questions for authors
- Could the authors compare against particle-based or path-search methods (e.g., FK steering, SVDD, search-over-paths) at matched compute?
- Could the authors report performance against NFE, peak memory, and per-prompt cost distributions?
- CLOSER’s gains depend strongly on how well the proxy J aligns with the selector V (Table 20). Could the authors evaluate a setting where J is weakly aligned with V (e.g., the mismatched pairs in Table 20) against gradient-free methods such as SMC-based steering at matched compute?
- Best-of-K uses the benchmark evaluator for reranking, yet its score decreases with K on SD3.5M GenEval (Fig. 3) and Best-of-4 falls below Standard on SD3.5M DPG (Table 1). Is there an explanation for this?