- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes a method for refining an already-sampled Euler trajectory of a flow matching model by selectively adding additional function evaluations to improve the results. The method works by (1) scoring the error by looking for velocities from adjacent steps with large changes (2) evaluating those top-M intervals at their midpoint and (3) inserting a "correction" to the trajectory given this additional evaluation. The paper provides evaluations on different models (Flux.1-dev, SD3, SD3.5) by comparing the refined trajectories compared to their original trajectories on ImageReward and CLIP.
Critical strengths
The interval scoring is an interesting idea about where extra evaluations can help. In the placement ablation of Table 4, the proposed velocity-based selection beats random interval and uniform-time insertion baselines. For long trajectories (a>13 steps), refinement of b steps outperforms using a+b steps uniformly to begin with (although this does not hold for other values of a+b).
Critical weaknesses
First, I am unsure about the practicality of the problem and chosen problem setting, and the experiments do not address this. In what settings would one have a whole trajectory saved off and wish to refine it, vs. simply devoting those resources towards using those steps to sample to begin with? This paper never describes a situation in which this would be used. Furthermore, because this setting is not justified, the post-hoc (rather than online) application is an unnecessary burden. That is, why would one not use an online sampler and adaptively adjust the steps, and then not worry about having to propagate changes to already-sampled future steps? The paper does not address this baseline.
My second critical concern is regarding the results, both qualitatively and quantitatively.
- Qualitatively, even though this paper is about text to image generation, there is a single visual result (Figure 2) and then no visual results until page 36 in the supplementary material. Looking at those images, I see almost no difference at all in their quality.
- Quantitatively, most of the results appear to be negative. That is, using a+b (a original sampling; b refinement) typically underperforms simply using a+b sampling steps to begin with, for many values. This is not well-presented but can be read from Tables 1 & 2 on the diagonals. Figure 4 plots only a>=14 for FLUX, omitting the range where refinement loses. Direct sampling beyond 18 steps is never reported, so most points in Figure 4 have no equal-NFE comparison at all.
- There is a lack of baselines. The tables compare just to Euler sampling as the baseline, without any adaptive sampler, such as DPM-Solver which the paper cites. It also takes effort for the reader to get the proper baseline of a+b Euler steps, as referenced in the previous bullet point.
Taken together, with a questionable problem setting along with what seem to be negative results. I believe this paper is currently not ready for publication.
Questions for authors
Please clarify the problem setting that is chosen (why a post-hoc method). What actually changes in the images after refinement that make it higher quality? Please tabulate the equal-NFE difference (a+b original sampling vs a sampling+b refinement) explicitly for direct reporting.
Thank you for the review. We agree that equal-NFE comparisons should be clearer and that qualitative evaluations and baselines should be strengthened. However, these limitations do not establish that the problem is unjustified or that the results are generally negative.
Our method addresses refining an existing cached trajectory with additional computation, which differs from sampling from scratch or adapting steps online. The review itself acknowledges improvements in some equal-NFE settings and the effectiveness of interval selection. Failures at low initial step counts delimit applicability rather than negate those findings. Moreover, Table 3 includes STIR+STORK experiments, so the characterization of the evaluation as “Euler-only” is inaccurate. Although reference-based stopping limits this evidence, it should not be overlooked.
We therefore ask that presentation weaknesses, incomplete evidence, and methodological invalidity be assessed separately rather than conflated.