- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper examines the convergence of primal-dual Lagrangian-based methods in random games. The basic question is how the presence of budgets affects convergence in games, and what's the mechanism that causes non-convergence. One of the findings in the paper is that damping provides a remedy to non-convergence.
Critical strengths
On the positive side, I believe that the paper studies an important and well-motivated problem. There has been a surge of research recently that examines learning in the presence of budgets. This is motivated by a number of central applications, such as autobidding. The paper can be viewed as part of this line of work. It also provides some new insights about the effect of budgets in the convergence of primal-dual methods. To my knowledge, these insights are new and somewhat informative.
Critical weaknesses
I'm afraid the paper has several critical issues:
- The first issue is that the writing quality is really poor. Even though I'm an expert in this area, I was really struggling to follow the basic logic in each sentence. Among others, the paper casually uses terms that are non-standard (as if a reader is supposed to know them), and the writing is extremely terse. In my opinion, using AI is perfectly fine, but the paper is supposed to be read by humans, experts or otherwise. At the current stage, the writing quality is far below what's expected in a top-tier conference. I strongly recommend revising entirely the writing.
- The theoretical results do not go far enough and are very preliminary. The main body contains a single mathematical statement, which is a straightforward lemma. The appendix contains more results, but those are not exposed properly and not adequately discussed in the main body. What I expect to see is not a series of mathematical statements, but rather a discussion on their significance and how one should interpret them.
- The experiments are conducted on random games, which is a major limitation. Random games are by no means indicative of what happens in representative strategic interactions. So the takeaways from the empirical section are brittle and not convincing. I would recommend conducting experiments in benchmark games (see for example the OpenSpiel library). This would make any conclusions far more interesting.
Overall, the authors are examining an interesting question and some of the insights look promising. However, the current manuscript is not in shape for publication. I believe there are concrete steps the authors can take in a resubmission to significantly strengthen the paper.
Questions for authors
Another suggestion would be to elaborate more on autobidding, since that provides strong motivation for the results of this paper. The authors could also consider expanding their discussion on related work in the online learning literature in the presence of budgets.
Summary of the author response and of the changes in the revised PDF
We thank the three reviewers. This comment summarizes our replies and lists the changes in the revised PDF, where new text is in blue.
(a) Points the reviewers state
(b) Concerns raised by more than one reviewer
(c) Changes in the revised PDF