acceptodds
Under review as a conference paper at ICLR 2027

Geoshrink: Accelerating Diffusion Transformers with Two Lines of Code

Abstract

Diffusion transformers incur substantial inference cost through repeated model evaluations along a sampling trajectory. We introduce GeoShrink, a training-free acceleration method that retains the original solver grid while evaluating the model only at a prescribed set of anchors. At skipped stages, GeoShrink predicts the solver-facing output by adding a geometrically retained fraction of the latest observed innovation to the most recent exact output. We derive this rule from chordal tangent transport and round-trip line projection, and establish a geometric anchor-spacing principle that minimizes the largest adjacent gap expansion under fixed coverage and first span. The analysis characterizes the geometric closure and propagation of prediction errors without assuming access to future model outputs. Experiments cover image, video, motion, and audio generation, together with adapted 3D backends. At approximately acceleration, GeoShrink improves FLUX PSNR by  dB over the strongest listed baseline. On HunyuanVideo, it achieves a reported speedup and improves ChronoMagic-Bench-150 PSNR by  dB over the strongest listed fidelity baseline. Comparisons at fixed evaluation budgets further show substantial gains on Motion, Audio, Music and 3d generation.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.