- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies an empirical observation in Flow Matching: scaling the predicted velocity during sampling often improves generation quality. Previous work attributed this improvement to MSE training underestimating the velocity magnitude, but the authors show both theoretically and empirically that MSE does not necessarily create such a velocity deficit. Instead, they identify state–time mismatch as a key mechanism, where sampled states at a given model time resemble training states from an earlier time. They introduce a probe to measure this mismatch and show that both shifting the model time backward and scaling the velocity can reduce it.
Critical strengths
- The paper provides a solid theoretical analysis showing that MSE training does not cause a systematic velocity deficit, and identifies state–time mismatch as a new explanation for why velocity scaling improves generation.
- The proposed explanation is supported by careful and well-designed experiments. The authors validate the time probe using along-path and perpendicular perturbations, show that model-time correction improves FID without scaling the velocity, and use frozen-field and radial controls to isolate the role of the changed-state response. The results are also tested across multiple SiT sizes, REPA-SiT, an ADM U-Net, CIFAR-10, different NFEs, and different solvers. These experiments make the proposed explanation much more convincing than a correlation-only argument.
Critical weaknesses
None.
Questions for authors
- Can velocity scaling and model-time correction be applied jointly? For example, after applying a lag-based velocity gain, one could measure the remaining time lag and adjust the model-time input accordingly. Have the authors tested whether this combined correction provides additional improvement over either method alone?
- Although the paper provides extensive experiments on earlier flow-matching image models such as SiT, do the authors expect state–time mismatch to also exist in more recent and stronger flow-matching models, for both image and video generation? If so, would velocity scaling still be effective in these settings? A discussion of the authors’ view would be sufficient, while any preliminary experimental evidence, if available, would be even more helpful.
Thank you for the constructive discussion
We would like to sincerely thank all three reviewers for their thoughtful reviews, constructive engagement, and positive final assessments. Your willingness to engage in discussion made the review process particularly enjoyable and productive.
We thank ZVvC for suggesting independent validation of the population time lag measurements. This motivated the new spectral checks, which significantly strengthen the evidence presented in the paper.
We thank 5iRd for initiating an interesting discussion about model errors at intermediate sampling states, their relationship to population time lag, and the distinction from the proposed velocity deficit. We particularly enjoyed thinking through these questions, and the discussion helped us articulate these distinctions more clearly.
We thank Xw7Q for suggesting the combined velocity-scaling and model-time correction experiments, as well as investigating newer generative models. These experiments yielded interesting additional findings.
We look forward to incorporating these experiments and insights into the final manuscript.
Thank you again for making this a constructive and engaging discussion. We're happy to answer any further questions or clarify anything else.