- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This authors argue that in many real world games agents are treated asymmetrically in that a computed agent has imperfect recall as they use abstractions that merge information sets or that they cannot communicate with teammates (unlike their oponents). They provide a certificate (a convex sum-of-squares solver) that when run after any solve guarantees that the best possible value given the current abstraction is just an epsilon above the computed value. They do this by assuming the opponent is replaced by a polynomial “response map”.
From this they motivate an issue with exploitability where it combines abstraction error with error from the solver. They then show this can matter by considering two Kuhn-poker games where the exploitability are equivalent but in one the abstraction limits further improvement while in the other the solver has just not converged.
Critical strengths
- The examples are simple, but clean and clear showing why these different sources matter
- the theory is nice in terms of establishing a bound on both sources of error via the SOS
Critical weaknesses
- The paper in its current form is very challenging to read, above and beyond the technical assumptions. New terms are regularly introduced without being defined for existing standard objects. Sentences are intensely “compressed” in meaning and large leaps of logic are left unexplained.
- The only way I was able to understand what was going on at all was by using a LLM to read the paper which found the compressed material clear. To a human it is not and likely a result of using a LLM to polish the text plus the existing technical material.
- It is not clear to me how the bound relates to prior work, if any. It is also not clear to me that in modern systems like ReBeL, where they use only extremely limited forms of action-abstraction if this critique raised in the paper about agents forgetting still applies.
- Realistically, I think the paper has to be rewritten before it can be accepted. The ideas are good, but they are not easily understood in the current approach.
Questions for authors
- What would you identify as the main innovation of the paper.
- For something like ReBEL do the abstraction bounds identified still apply?