- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces PreviewDiff, which is a test-time scaling method. PreviewDiff differs from previous test-time scaling methods for diffusion models in some respects:
- Unlike Best-of-N, they preview intermediate diffusion generation particles and evaluates on them.
- The method uses a multimodal judge to score and critique, and utilizes resulting natural-language feedback to improve prompts
- The method uses tree search to choose promising particles
The method shows better scalability than Best-of-N, EvoSearch, and Particle-Sample on three image-generation benchmarks and also performs better on video generation. The main contribution of this paper is to demonstrate that multimodal feedback is most useful not only as a final verifier, but as an active controller inside the denoising process.
Critical strengths
- The authors conducted experiments on both image and video generation across five base models, and they showed that the proposed method beats three or four baseline test-time alignment methods in 4 candidate settings.
- The main message of the paper (multimodal feedback is most useful not only as a final verifier, but as an active controller inside the denoising process) sounds promising for inference-time scaling of multimodal generation.
- The paper also provided human evaluation results on image and video generation, which show that the gain from the proposed method is not just quantitative, but also qualitative.
Critical weaknesses
- Comparison of inference-time scaling may be insufficient.
- Table 1 and Table 2 show comparisons with baseline methods, but the computational cost settings for the proposed method and the baselines are not obviously shown. The paper should show scaling-efficiency comparisons (like Figure 2) for all baseline methods. Baselines may beat the proposed method when the computational cost scales.
- Scaling on wall-clock time should be shown. A multimodal judge for intermediate latents may take a lot of time, and the proposed method may not be efficient in wall-clock time. Although the authors note this limitation in the paper, it remains a critical concern for real-world use.
- Previewing the intermediate latent does not seem to be a novel idea.
- Previewing latent reward has already been discussed in previous works [1,2,3]. The authors should discuss how their proposed method differs from these previous works.
- The novelty seems to lie in the use of a multimodal judge and prompt modification.
[1] Yeh et al. Training-free Diffusion Model Alignment with Sampling Demons. ICLR 2025.
[2] Oshima et al. Inference-Time Text-to-Video Alignment with Diffusion Latent Beam Search. NeurIPS 2025.
[3] Wang et al. Image Diffusion Preview with Consistency Solver. CVPR 2026.
Questions for authors
Please see Critical Weakness and address the concerns. If the authors address the concerns sufficiently, I will consider raising the score.
4 comments
Thank you for the response. W2 is addressed, but W1 is not sufficiently addressed.
I believe that in the inference-time alighment/scaling field, what matters is whether performance scales better than other methods with the compute spent. However, the response narrows the wording instead of showing this.
Therefore, I will keep my score.
Thank you. Apologies for the delay, we needed additional time to run an experiment on wall-clock time, leading us to initially narrow our positioning on the scaling experiment. We have now added a wall-clock scaling comparison using SDXL and Gemini on a single NVIDIA H100. For each PreviewDiff configuration in Figure 2, we measured its per-prompt runtime. For example, 86 aggregate denoising steps correspond to 2.77 seconds. We then used the measured Best-of-N runtime to determine the candidate count corresponding to that time budget, rounding N upward to the next integer. This approximately matches the latency budgets, with upward rounding allowing Best-of-N additional computation. Both methods execute serially under the same single-GPU allocation. PreviewDiff achieves higher mean Gemini scores at every evaluated budget, including approximately 2.86 versus 2.78 at the largest budget. This directly extends the evaluation from denoising-step scaling to quality under measured wall-clock budgets. We include the figure here. We will include this for our video model setting as well in the final submission but we believe this provides strong evidence for the superior scaling of PreviewDiff.
Thank you for the additional experiment and response.
However, Best-of-N (BoN) is the simplest and most naive baseline; demonstrating scalability only against BoN is insufficient to establish your method's scalability advantage over existing inference-time scaling approaches.
Currently, all existing baselines except BoN are evaluated only at a single fixed compute budget. To adequately demonstrate your claims, you must plot scaling curves for all baseline methods and evaluate these comparisons not only against compute budgets (e.g., denoising steps) on the horizontal axis, but also against wall-clock time.
Because these thorough analyses and discussions are missing, I believe the paper does not yet meet the bar for a top-conference work on inference-time alignment. Therefore, I will maintain my current rating.
We thank the reviewer for their thoughtful comments. We are glad the reviewer appreciated our numerous experiments across image and video models, the message of our paper, and the human evaluation.
Figure 2 evaluates scaling against Best-of-N, whereas Tables 1–2 compare additional search methods at selected budget settings. We agree that these results do not establish dominance over every baseline across all compute budgets, and have narrowed the wording accordingly.
We also report end-to-end latency over 295 NarrLV prompts on one NVIDIA H100 using LTX-Video and Gemini-3.1-Flash-Lite. Timing includes generation, decoding, critic requests, and required media transfers. Model loading and five warm-up prompts are excluded. Best-of-3 uses two sequential generation passes and up to two concurrent critic requests. Values below are mean ± standard deviation in seconds per prompt.
PreviewDiff is slower at these configurations but improves results substantially. These measurements make the end-to-end latency tradeoff explicit. The protocol, results, and scope of these comparisons are highlighted in blue.
We agree that intermediate previewing and VLM-based evaluation are not themselves novel. Sampling Demons [1] controls denoising noise using reward feedback, including VLM-derived rewards. Diffusion Latent Beam Search [2] uses lookahead reward estimates to select latent trajectories. ConsistencySolver [3] improves low-step preview quality and consistency for preview-and-refine workflows. Our focus is using a critic's natural-language diagnosis to construct corrective conditioning updates within the active diffusion trajectory. Positive and negative updates are combined with local re-noising to create candidate continuations, which are then evaluated and pruned. The contribution is this integration of semantic corrective actions with latent search, not previewing or multimodal scoring alone. We have expanded Section 2 to make these distinctions explicit.