- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SDESteer, a training-free test-time scaling method for instruction-based image editing. It branches multiple SDE trajectories from a shared noise, and the VLM built into the editing model scores and prunes the branches at intermediate steps. The surviving branches are steered by adjusting the CFG scale based on that score, which gives the trajectory a direction, unlike existing tree search that restarts with random noise. The core design is to use the editing model's own VLM as the verifier instead of an external reward model, and the authors claim this removes the judgment mismatch with external models and the cost of an additional model.
Critical strengths
S1. The method is simple and practical. It reuses the VLM that already exists in the editing model as the verifier, and no additional model is needed. The shared-prior branching and score-based CFG control are also easy to implement. If the results hold, this method can be used directly for test-time scaling in image editing.
S2. The reported effect is large and the evidence points in the same direction. The success rate is higher than Best-of-N on the same backbone, and this gap appears consistently across the VLM judge, human evaluation, ablation, and all eight editing types. If the gap survives the comparisons requested in W1, it would be a strong result.
Critical weaknesses
W1. There is no comparison or analysis that supports the novelty and superiority of the main claims. All of the paper’s contributions are comparative claims of being better than existing methods, but on the same backbone the only comparisons are a single ODE run and Best-of-N, whose final selection criterion is not defined. The remaining baselines are separate editing models run with their own official implementations and base models. None of the tree search methods the authors criticize are in the comparison. Also, this is a test-time scaling method, but compute costs such as wall-clock time, number of forward passes, number of VLM calls, and API cost are not reported. More model calls will of course help. The question is whether this method uses them better than Best-of-N or tree search at the same budget, and the paper does not show this.
It has been shown in several studies that the initial noise strongly affects the result [1, 2, 3], but this paper starts all branches from a single noise and gives up initial noise diversity. If diversity among branches is low, the search can become inefficient. There is no analysis of whether independent initialization is actually worse or whether initialization variance ever helps. The novelty of the steering is also unclear. Gradient guidance methods such as DPS [4] and FreeDoM [5] actively steer by changing the drift directly with the reward gradient, and FK steering [6] and DAS [7] guide the search with reward-weighted resampling. The paper groups existing TTS into either passive filters or random restarts. Gradient guidance belongs to neither category, and reward-weighted resampling is not blind guessing. There is no explanation of how adjusting the CFG scale with verifier scores differs from them, and without this it is hard to judge the novelty of the core contribution.
W2. The design rationale of the method and the evaluation design do not support the conclusions. First, it is hard to tell how reliable the spatial attention mask M is. There is no description of how it is extracted or how accurate it is. As in the Figure 2 example, it may work well for localized edits, but the behavior may differ when a larger object has to change or when the global style or background has to change. I am concerned that the method targets too narrow a type of editing. In fact, of the nine types in EdiVal-Bench, the authors selectively report only eight, excluding background change, the only global edit.
Second, there is no rationale or analysis for why Eq. 6, 8, and 9 are designed this way, and they feel heuristic. The ablation is also insufficient. Table 3 consists only of three variants that each remove one component, with a single seed and no variance. Given my concern about the reliability of the VLM score, the score differences look marginal. Design choices such as the shared prior versus independent initialization, the form of the equations and hyperparameter selection, and the choice of verifier VLM are hard to accept based on the current results alone.
Third, the evaluation is measured only with a single VLM (gemini-3.1-pro), and its rubric has the same IF/BP/IQ structure as the method’s internal verifier. I cannot rule out that outputs preferred by the internal verifier are carried directly into the external judge’s score. The authors did not use the official EdiVal-Agent metrics. The human evaluation is small, with eight tasks, and the number of images, the selection procedure, and significance testing are not reported.
[1] Guo et al. InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization. CVPR 2024.
[2] Zhou et al. Golden Noise for Diffusion Models: A Learning Framework. ICCV 2025.
[3] Ma et al. Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps. CVPR 2025.
[4] Chung et al. Diffusion Posterior Sampling for General Noisy Inverse Problems. ICLR 2023.
[5] Yu et al. FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model. ICCV 2023.
[6] Singhal et al. A General Framework for Inference-time Scaling and Steering of Diffusion Models. ICML 2025.
[7] Kim et al. Test-time Alignment of Diffusion Models without Reward Over-optimization. ICLR 2025.
Questions for authors
- What is the final selection criterion of Best-of-N? What are the wall-clock time and the number of forward and VLM calls for Baseline, Best-of-N, and SDESteer? Can you compare against Best-of-N at the same budget, and against one of the tree search methods you cite (DTS, FK steering, DAS, etc.) on the same backbone?
- Is there a comparison between the shared prior and independent initialization? How does adjusting the CFG scale with verifier scores fundamentally differ from gradient guidance or reward-weighted resampling?
- How is the mask M extracted, and how accurate is it?
- What happens when an external VLM is used as the verifier? If an external VLM is unreliable as a verifier, why is gemini reliable as a judge?
- Please report how the final output of SDESteer relates to the capability of the verifier VLM, the design rationale of Eq. 6, 8, and 9 with comparisons to alternatives, and the number of images and the selection procedure of the human evaluation.
- The paper uses only Qwen-Image-Edit-2511 as the backbone. Results on other editing models would make the method’s generality clearer.