Three-Body Scattering for Generative Modeling
Abstract
An energy-distance field provides direct sample-level supervision for one-step generation, but sparse source interactions suffer from high noise. We propose Three-Body Scattering Modeling (TBSM), which learns a fake-to-real correction field via an online tracker that dynamically adapts to the evolving generated distribution. Under TBSM, each generated projectile is simultaneously attracted toward a real source and repelled from an independently generated source. At the exact energy-distance endpoint, the conditional expectation of this interaction coincides with the -Wasserstein gradient-flow velocity of . The online tracker approximates this expectation, while frozen-target regression transfers the estimated corrections into the generator, which is deployed standalone during inference. Theoretically, our analysis characterizes the regime where tracking provably reduces supervision error, establishing stationarity and convergence guarantees under explicit conditions. Computationally, each event conditions on a single real reference, requiring only sample interactions for a batch size of . Leveraging frozen image features, TBSM trains one-step generators on ImageNet-256, achieving an with pixel-space PixelDiT-XL and an with latent-space DiT-XL at . Finally, we provide a unified design map relating this learning paradigm to diffusion supervision, drift dynamics, and GAN-like objectives.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.