- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Three-Body Scattering Modeling (TBSM), a method for training one-step generative models through sample-level interactions. The method constructs a correction field by attracting generated samples toward real samples and repelling them from other generated samples. To reduce the noise in these interactions, the authors introduce an online tracker that learns a smoother correction field for generator training. The paper establishes a connection between the proposed interactions and the Wasserstein gradient flow of the energy distance. It also provides theoretical analyses of tracking errors and distributional identifiability under specific conditions. Experiments on ImageNet and text-to-image generation demonstrate competitive one-step generation performance across different model architectures.
Critical strengths
- Well-motivated method design. The paper identifies the high variance of sparse sample interactions as an important challenge in distribution-based generative modeling. The proposed online tracker provides a practical way to obtain more stable supervision while maintaining one-step inference. This design directly addresses the identified problem.
- Meaningful theoretical analysis. The paper establishes a connection between three-body interactions and the Wasserstein gradient flow of the energy distance. It also analyzes when tracking can reduce supervision errors and provides distributional identifiability results. These findings offer useful theoretical support for the proposed approach.
- Strong experimental performance. The method is evaluated on different generator architectures, including JiT, PixelDiT, and DiT. The results show competitive one-step generation quality on ImageNet, with additional experiments demonstrating applicability to text-to-image generation. The representation-space ablations further support the practical effectiveness of the method.
Critical weaknesses
- Limited theoretical justification for the practical training dynamics. The paper establishes a connection between three-body scattering and the Wasserstein gradient flow of the energy distance. However, the main gradient equivalence result in Theorem 1 applies to the exact energy-distance setting with . In practice, several of the reported experiments use , which changes the underlying distributional objective and may shift its optimum away from the target distribution. Furthermore, the practical method relies on learned trackers, corridor-based queries, and frozen feature representations. Although the paper provides separate theoretical analyses of tracking errors and full-corridor identifiability, these results do not directly establish the convergence or distributional consistency of the complete practical training procedure. This gap makes it difficult to determine how well the theoretical analysis explains the empirical improvements, particularly for the configurations that achieve the strongest results.
- Insufficient evaluation of the tracker under matched computational budgets. The online tracker is a central component of TBSM, and the ablation studies demonstrate clear improvements over instantaneous scattering supervision. However, the comparisons mainly match the number of generator updates rather than the total training cost. The tracked variants require additional network optimization and feature-space computations, which introduce extra computational overhead. More importantly, the paper does not sufficiently compare the learned tracker with simpler variance reduction strategies, such as averaging multiple independently sampled scattering vectors or using moving-average estimates. These alternatives could also reduce the noise in the supervision signal without requiring a separate learned correction network. A comparison under matched GPU time or computational budgets would help determine whether the improvements come specifically from learning the conditional correction field or from using additional training resources. This is important for assessing the practical benefits of the main methodological contribution.
Questions for authors
- The paper discusses the methodological differences between TBSM and Drift, particularly the use of sparse three-body interactions and an online tracker. However, the practical advantages of these differences remain unclear. In Table 2, Drift reports better FID than TBSM, although the results are obtained with different architectures and training settings. Could the authors provide a more direct comparison with Drift under matched generator architectures and computational budgets? In particular, it would be helpful to clarify whether TBSM offers advantages in training stability, convergence speed, computational efficiency, or generation quality, and which of these benefits can be attributed to the online tracker.
- Could the authors further clarify which theoretical properties remain valid when and the tracker is trained using corridor-based queries? In particular, is it possible to characterize the stationary points or distributional bias of the resulting practical training dynamics? It would also be helpful to discuss how tracker approximation errors affect convergence when the generator distribution changes throughout training.