- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies the benefits of a shared world-model in a multi-agent reinforcement learning setting. The authors aim to answer whether a shared world model could serve as a negotiation mechanism.
Critical strengths
Assessing multi-agent interaction with world models is a timely problem.
Critical weaknesses
- the writing of the paper is confusing at times, e.g., "4 channels" (l.146) and "a six-dimensional channel" (l.147): why not just call the latter "6 channels" which is much cleaner and shorter. Because of the authors use of "a six-dimensional channel" I don't even know exactly whether what I think they are referring to ("6 channels") is correct.
- the submission remains unclear at times, e.g., "a six-dimensional channel" (l.147) contains 1) neighbor's position and 2) heading as well as 3) declared future position and 4) declared future heading. How do these 4 aspects amount to a six-dimensional channel? This wasn't explained in the main paper.
- the submission uses terminology that isn't well introduced, e.g., "two arms differ only in this channel" (l.148): the concept of an arm hasn't been introduced prior to l.148 and when reading this sentence I have no idea what the authors are referring to. A search for "arm" reveals only one prior occurrence in l.82 which also doesn't explain its meaning in the paper's context
- similarly, the "why not recorded data" section (l.153ff) continues to assume that I know the environment which a reader may not. The following paragraph then describes a simulator but doesn't explain how this simulator relates to the environment. At least I was not able to understand this.
- Why is LPIPS a useful metric here? No motivation is provided in l.203. Only later when reading l.236 did I understand that the authors are trying to assess planning quality?
- A single synthetic environment seems to be investigated which makes it hard to judge generality.
Overall, in its current form the paper is not very well organized and the main message that the authors try to convey is lost.
Questions for authors
see above