acceptodds
Under review as a conference paper at ICLR 2027

SpecFlow: Fast and Lossless Speculative Sampling for Flow Matching

Abstract

Flow Matching (FM) has emerged as a leading framework for high-quality image and video generation, yet inference remains expensive because ODE integration requires sequential network evaluations. Existing acceleration methods either require additional training or rely on approximations, generally without exact distributional guarantees. We ask whether FM can instead admit the lossless acceleration of speculative decoding, where draft quality affects efficiency but not correctness. A direct extension is challenging because deterministic FM transitions are degenerate (Dirac) and lack the densities required for exact probabilistic verification. We address this by performing speculation on a marginal-preserving stochastic realization of the FM probability flow, whose Gaussian transitions enable exact verification and correction of draft proposals. We obtain the required score directly from the FM velocity, requiring no auxiliary model or additional network evaluations. Building on this, we introduce SpecFlow, a training-free speculative sampler that exactly reproduces its chosen discretized stochastic target sampler for any valid draft; making SpecFlow lossless. We further introduce a curvature-adaptive drafting strategy that jointly adapts prediction order and speculative horizon to improve efficiency. Across image generation, image editing, and video generation, SpecFlow achieves inference speedup while maintaining the target sampler's quality.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.