- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies the effect of changing the meta-solver in double oracle and PSRO. The authors propose to use an anchored quantal-response equilibrium (QRE), where the anchor mixes the previous meta-solution with a uniform distribution.
The main theoretical result shows that this approach reduces the exponential worst-case number of rounds to O(k) on a particular family of zero-sum games, even under adversarial tie-breaking. The paper also analyzes why anchoring only to the previous solution causes deadlock, and establishes stability and finite-sample guarantees under noisy meta-game payoffs. Experiments on several games support the theoretical results and compare the proposed method with existing meta-solvers. The results are generally encouraging, although the method does not consistently outperform simpler alternatives.
Critical strengths
-
This paper has a clear and interesting theoretical result. The strongest contribution is showing that a relatively simple change to the meta-solver can avoid a difficult known construction. The case of adversarial best-response tie-breaking makes it more interesting.
-
The experimental analysis are relatively careful.
Critical weaknesses
-
The theoretical guarantee is narrow. The O(k) bound applies to a particular lower-bound construction and assumes exact QRE computation and exact best responses. The extension to approximate best responses for QRE requires a small error tolerance, which limits what the current analysis establishes for practical PSRO with learned oracles. The experiment using a DQN oracle is also too limited to resolve this concern.
-
The benefit of adaptive anchoring over simpler alternatives is not entirely clear. Uniform-anchor QRE and Nash mixed with uniform exploration already avoid the zero-support problem. I want to understand more clearly when using the previous meta-solution as an anchor is actually beneficial, rather than simply using uniform regularization.
Questions for authors
-
How sensitive is the escape guarantee to approximate best-response oracles in practice? The sufficient error bound for QRE becomes extremely small under the theoretical temperature schedule. Is this mainly an artifact of the proof, or does the method actually require very accurate oracles on harder instances?
-
What is the main practical advantage of adaptive anchoring compared with uniform-anchor QRE? Since the latter already provides full support and stability, and sometimes performs better experimentally, it would be helpful to clarify which settings specifically benefit from using the previous meta-solution as an anchor.
Reviewer–Author Discussion Period Ending Soon
Dear Reviewers,
With the discussion period coming to a close, I encourage you to revisit the authors’ responses and let us know if you have any further comments.
Thank you for your careful reviews and engagement in the discussion!