- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The authors extend the mean-field underdamped Langevin dynamics to the distributional minimax optimization setting. They show (1) while the overdamped (mean-field) system converges, the underdamped system does not generally converge, (2) they extend prior analysis using an anchored best-response framework to the underdamped setting, and (3) they provide analysis for the finite-particle, discrete-time setting.
Critical strengths
- The problem setting is novel, and the paper is generally well-written.
Critical weaknesses
- The work as written, feels kind of incremental; it seems the main ideas for the algorithm is a suitable combination of Fu & Wilson, (2024) and Kim et al., (2024). The authors should highlight the technical novelties and/or the theoretical innovations compared to prior work.
- One place that seems to improve upon prior work is that the authors seem to provide propagation of chaos/quantify the bias of the particle-discretization in Theorem 4 in the appendix (this seems to be novel for the anchored best-response type algorithm), but the rates suffer from the curse of dimensionality.
Questions for authors
- The problem in eq (1) is strictly a subcase of the Kim et al. (2024); they allow arbitrary reference measures. Can the authors also analyze this setting? Can the authors discuss where their analysis requires the Gaussian reference measures is used? This seems to be a limitation of their work compared to this prior work.
- In Section 5.4, why do we need to take uniformly selected particles at outer steps? This seems to be the cause of the curse of dimensionality issue. Also, I'm curious why there is not the usual propagation of chaos term, e.g. see the first term in Corollary 1, [N24].
Other comments:
- The authors do not motivate why we should study the underdamped dynamics, instead of just using the overdamped dynamics.
[N24] Nitanda. Improved Particle Approximation Error for Mean Field Neural Networks. NeurIPS 2024.
Reviewer-Author Discussion Phase is Ending
Dear Reviewers,
Thank you for your service in the review process. Now that we are approaching the deadline of the author-reviewer discussion period. Please take time to read authors' responses and let them know if it addresses your concerns. Thank you.
Best,
Area Chair