- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work considers in multi-agent setting for market, asymmetric training evaluation may have issue with agents are unfrozen. This work prosed to model this by introducing a restoration audit with all update channels are resumed. In a controlled testbed the author shows, with careful statistics, that the audit does show some traits for this particular cases, including testbed shift and the overstated stability for frozen persistence.
Critical strengths
This work introduces an clean separation conceptually: frozen persistence and co-adaptive response stability. Such an idea is neat and should be encouraged.
The experiment design is clean, rigorous, and comes with with strong statistics results. This is really good.
Critical weaknesses
That said, this work also have issues that prevents acceptance in its current form.
For presentation, this work seems to be hard to follow given the high density of information (which are sometimes not necessary). The writing requires significant effort in parsing.
The proposed method is for a widely acknowledged issues, but without proper comparison with prior works addressing such issues. As the authors admitted, issues with frozen evaluation is a consensus in multi-agent RL. There are a range of prior works dealing with that. This paper mentioned some of them (Shoham et al., 2007, Foerster et al. 2018(the manuscript mistakes it for year 2017), Lanctot et al. 2017, and Timbers et al. 2022), but only briefly in discussion without actual comparison the proposed method with them. This missing strongly limits the contribution of this work.
The proposed method's generalizability is questionable. No cross domain analysis beyond the toy testbed environment is conducted. To justify the proposed method as general, at least some cross domain experiments are expected. Furthermore, while the manuscript is good at establish statistically strong estimation, it does not produce an analysis of mechanism. Prior works like HAPPO/A2PO (the manuscript cites them) already show some insights into the mechanism, thus we expect this work should also provide insights to some degree.
Domain (market-making) specific contribution is also limited. Many market mechanisms important for studying market making, such as those related to limited order book, are missing from the testbed. This does not really handles market making well from first principle. Furthermore, although this work identifies widening spreads, it does not show from a market making point of view who benefit from the spread, i.e. the welfare, an import topic for market making.
Questions for authors
None