- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
this paper tries to study such a problem: whether we can learn communication topology purely from agent-generated content, without explicitly conditioning on task outcome. The authors propose a method that uses goal-conditioned relevance and content novelty for weak supervision, instead of relying on task reward / outcome / calibration.
Critical strengths
the paper includes many good points such as well written, good presentation and relatively extensive experiments. But I find no substantive strength that can very strongly support a clear acceptance.
Critical weaknesses
there is a very critical concern before we try to study this problem: during the discussion stage, we actually can not reduce the risk of leakage of traditional task reward from the content of agents (because you can not change the generated content from agents but they may talk about such information), and I cautiously believe that the target problem is ill-defined.
the reported robustness/adaptability of MERIT-MAS seem to be generated by a fundamentally different training protocol from the baselines.
Questions for authors
None
thanks for the response. I will maintain my score.