- Rating
- 4(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces a persistent directed bond graph for multi-agent coordination. Bonds are updated online through reward-modulated social plasticity and are used during RL fine-tuning for reward diffusion and experience sharing, or during inference for social deliberation. The method is evaluated in WIRE, a five-stage embodied curriculum, with experiments on performance, social cues, and partner transfer.
Critical strengths
The paper explores an interesting and useful design direction: maintaining an explicit, inspectable relationship state across episodes rather than rebuilding coordination from scratch for each task.
Critical weaknesses
-
The learned bond does not clearly distinguish interaction frequency from useful cooperation. Equation 7 allows repeated co-firing to strengthen a bond without reward, while the eligibility trace credits recent co-actors based on correlation rather than counterfactual contribution. Consistently, Table 2 and Figure 8 show that communication produces the strongest bonds but relatively poor cooperative completion. It is therefore unclear whether measures valuable relationships or mainly repeated interaction.
-
The source and reliability of the reported gains remain unclear. Reward diffusion, experience sharing, and social deliberation are not separately ablated; the main results lack significance tests and clear per-condition seed counts; and the evaluation uses only a self-built curriculum that enforces co-location. The reversed Gemma-E4B MAPPO result in Table 1 further suggests that the mechanism is not consistently beneficial.
Questions for authors
-
Can the authors separate the effects of interaction frequency and successful contribution, for example by ablating the association floor and adding a counterfactual contribution test?
-
What are the separate contributions of reward diffusion, experience sharing, and social deliberation? Why does the Gemma-E4B MAPPO setting degrade?
-
How many independent seeds were used, are the main differences statistically reliable, and does the method still work when co-location is not enforced?
Thank you for the detailed response and additional experiments. Your replies and evaluations to my questions and the other reviewers have helped clarify my concerns. The corrected per-agent adapter address my question on the MAPPO results. My remaining concern for relative bond strength would still correlate to interaction frequency, and they determine whose rewards and experiences each agent learns from e.g. in the embodied settings that the paper motivates on, where a unhelpful agent that communicates frequently could therefore gain influence that then diverges on communication and physical contribution. However, learning relationships between agents using their framework is an interesting direction that future research can build on, and I will therefore maintain my original evaluation.