- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 3
Read review
Paper summary
This paper analyzes finite-particle drifting models with conservative drifting (Gaussian kernel and score difference) and non-conservative drifting (Laplace kernel, conditional mean difference). For both cases, this paper studies a continuous-time model on particle movements, and derives time derivatives of the KL divergence between smoothed particle distribution and smoothed data distribution. Moreover, this paper provides the convergece rates of time-averaged velocity moments, especially with respect to the number of particles . At the end, numerical experiments are done to visualize the theories.
Critical strengths
- The problem itself is meaningful, as understanding the finite-particle behavior is very useful for drifting models.
- The convergence results for velocity bounds is clear, and the dependence on dimensions and the number of particles is well established.
Critical weaknesses
-
The story line is not clear. There are many technical points in the main content, but it is difficult to recognize which results are main contributions, and which are the intermediate steps. Moreover, the implications of theorems and propositions are not obvious, but the paper have few discussions for it. As a result, I have not understand why the results are actually related to practice. Suggestion: Please consider using several sentences to identify the purposes of the results before directly writing the formulas.
-
The paper does not directly show how the results are related to distributional convergence or generation quality, while this might be the main concern of drifting models.
-
The word "convergence rate" is a bit misleading. If I have understood it correctly, this refers to the convergence rate of time-averaged velocity moments in Theorem 3.2 and 5.2. However, the word itself makes me to expect a result showing the particle distribution approaches the target data distribution.
-
The notations are too complex and difficult to follow. Suggestion: Please consider summarizing the notations in a separate paragraph or section, possibly in the appendix.
Questions for authors
- Can you summarize your main contributions more concretely? How is your theory related to the generation quality or distributional convergence? (See also weaknesses.)
2 comments
Thanks for the response. I find the presentation clearer after the revisions and have updated my score accordingly.
response 1
Response to Reviewer d9MQ
Weakness 1 and Question 1 — Main contributions and their purpose
Question: What are the main contributions, which results are supporting steps, and why are they relevant?
Answer: The revised opening identifies two finite-particle mechanisms: the reciprocal-KDE self-interaction correction for conservative drifting, and data–model scale mismatch for Laplace drifting. Theorems 3.2 and 5.2 turn these mechanisms into residual bounds. The added empirical and Gaussian examples then verify all terms of the localized conservative argument in concrete regimes. Section 3 explains the initialization, self-interaction, and quadrature contributions before the examples; the supporting estimates and proofs are in the appendices. Exact frozen-target regression gives the particle Euler update, identifying the connection to training and its idealization.
References: Abstract and §1 (pp. 1–2); Theorem 3.1 (p. 3), Theorem 3.2 and Eq. (8) (p. 4); Theorem 5.2 (p. 7); Theorems J.3 and L.1 (pp. 51 and 57); Appendix I, Eq. (111) (p. 48).
Weakness 2 and Question 1 — Distributional convergence and generation quality
Question: What connects the results to distributional convergence or generation quality?
Answer: The conservative analysis separately controls smoothed Fisher discrepancy. The added Corollary 3.3 uses an LSI to obtain smoothed KL and empirical Wasserstein bounds (with finite second moments), and Poincaré to obtain smoothed TV control. Both concrete examples also have terminal distributional guarantees. For the Gaussian example, root mean squared empirical W2 is O((logN)−3/20) at a uniformly sampled time and O((logN)−A) at the terminal time for every fixed A>0, with T=(logN)3/10.
References: §3.1, Corollary 3.3 (p. 5); Theorem J.3, Eqs. (123)–(124) (p. 51); Corollary L.4 (pp. 59–60); Appendix M (pp. 60–61); §7 (p. 10).
Weakness 3 — Meaning of “convergence rate”
Question: Does “convergence rate” refer to residual velocity rather than the particle distribution approaching the target?
Answer: For the original Theorems 3.2 and 5.2, it refers to time-averaged residual quantities. We changed the title to “Finite-Particle Residual Bounds for Conservative and Non-Conservative Drifting Models” and distinguish these bounds from the additional distributional results. Small velocity alone is insufficient: the manuscript gives a non-target stationary Gaussian configuration. The new distributional and terminal statements have their own hypotheses and proofs.
References: Title and abstract (p. 1); definitions in §2, Eq. (4) (p. 3); Theorems 3.2 and 5.2 (pp. 4 and 7); Corollary 3.3 (p. 5); “Stationarity and scope” (p. 60); Appendix M.3 (p. 61).
Weakness 4 — Notation
Question: Can the notation be collected and made easier to follow?
Answer: Section 2 collects the common quantities, and Appendix D.1 gives their detailed definitions. The main distinction is:
The Laplace-specific notation is introduced separately in §5.1–5.2; Appendix D.1 provides the detailed conservative notation reference.
References: §2, Eqs. (3)–(4) (p. 3); Appendix D.1, Eqs. (27)–(33) (pp. 16–17); §5.1–5.2, Eqs. (15)–(19) (pp. 6–7).