- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper re-visit the white-box multi-agent communication protocols by going through an LLM model first, answering few questions by evaluating the llm-assisted communication effects, then it concludes that using LLM as the supervisor to guide the white-box communication first then use the learned communication policies could improve the performance.
Critical strengths
-
The writing of this paper is clear, and it separate lots of sections to re-visit the white-box communication and guide readers to its targeting research problems. Easy to follow the authors' thoughts.
-
This paper could be a good position paper about how the LLM could help the white-box multi-agent communication research when hand-designed communication protocols are needed.
Critical weaknesses
First, this paper's central ideas are not new, for the multi-agent communication, the pre-defined protocol can be transferred since the rules are fixed. This is a well-known conclusion.
Second, the papers conclusion is using the LLM-assisted white-box communication to guide the learning of comm policies. I don't see enough novelty with this idea, since using LLM as high-level planner for later primitive learning is not new, this is a widely-used method. And this paper uses very long texts and some experiments to get to this idea and sometimes the improvements of using the white -box communication are little.
Third, the only thing newly defined by this paper is the WB-Direct and WB-Train in section 4, then the paper begins to do evaluations to get conclusions that has been concluded by this community.
Questions for authors
-
Is the communication protocol generated by the final combined method emergent? Or still require pre-defined rules? Can the learned communication protocols transferred over different tasks?
-
The topology communication network mentioned in line 410 might be more interesting to illustrate and could be expanded more, instead of using long texts to introduce what scenarios or multi-agent tasks requiring white-box communication.
7 comments
W2: Second, the papers conclusion is using the LLM-assisted white-box communication to guide the learning of comm policies. I don't see enough novelty with this idea, since using LLM as high-level planner for later primitive learning is not new, this is a widely-used method. And this paper uses very long texts and some experiments to get to this idea and sometimes the improvements of using the white -box communication are little.
Response. We thank the reviewer for the feedback. However, we respectfully disagree with the reviewer's characterization that "the paper's conclusion is using the LLM-assisted white-box communication to guide the learning of comm policies," as it does not accurately reflect the scope and contributions of our work.
First, we would like to clarify the positioning and contributions of our study. As explicitly stated in Lines 17–19 and 80–94 of the original paper, our work is positioned as a comprehensive study rather than a method-oriented paper. With recent advances in LLMs substantially reducing the cost of constructing explicit communication protocols, our objective is to systematically revisit white-box communication by investigating four research questions:
(1) How Effective Is White-Box Communication?
(2) What Makes LLM-Generated White-Box Communication Effective?
(3) Where Are the Capability Boundaries of White-Box Communication?
(4) Can White-Box Knowledge Guide the Learning of Communication Policies?
Importantly, the first three parts are independent research investigations, rather than preliminary experiments designed to motivate the final framework of LLM-guided communication learning. These investigations provide several important findings, including the effectiveness of white-box communication under appropriate training settings, the influence of LLM capabilities on protocol quality, and the limitations of feedback-driven protocol refinement. Using white-box communication knowledge to guide neural communication learning constitutes only the fourth part of our study, rather than its central contribution. Therefore, the reviewer's characterization that "this paper uses very long texts and some experiments to get to this idea" overlooks the independent research objectives and findings of the first three parts.
Second, we respectfully disagree with the reviewer's novelty assessment based on the argument that "using LLM as high-level planner for later primitive learning is not new." LLM-assisted RL encompasses a broad range of research directions, including high-level planning, reward design, policy guidance, and communication. These directions address distinct research problems, and the existence of prior work on LLM-assisted planning does not, by itself, establish that the research questions investigated in our study have already been addressed. Specifically, our work investigates explicit communication protocols in MARL, systematically examining their effectiveness across what, when, and whom to communicate, the sources of their effectiveness, their capability boundaries, and their potential value for learned communication. While previous studies have explored LLM-generated communication mechanisms, our contribution lies in this comprehensive investigation rather than merely applying LLMs to generate communication rules or guide policy learning.
Third, regarding the reviewer's observation that performance improvements are sometimes limited, we emphasize that our study does not aim to demonstrate that white-box communication universally outperforms learned black-box communication. Rather, an important finding is that white-box protocols can achieve comparable coordination performance while retaining explicit and interpretable communication decisions. In particular, our additional WB-Train (Own Obs) experiments further demonstrate competitive performance under the same observation constraints as the black-box counterparts. Moreover, the additional ablation experiments in Section 7 demonstrate that both white-box supervision signals contribute to neural communication learning. These findings support the effectiveness and potential value of white-box communication, even when the performance improvements are modest.
In summary, our central contribution is a systematic investigation of the effectiveness, sources of effectiveness, capability boundaries, and potential value of white-box communication for learned communication policies. We therefore believe that the reviewer's conclusion that "I don't see enough novelty with this idea" is not well justified when the paper is evaluated primarily as a proposal for LLM-guided communication learning. We respectfully encourage the reviewer to reconsider the assessment in light of the paper's actual research objectives and findings.
W3:Third, the only thing newly defined by this paper is the WB-Direct and WB-Train in section 4, then the paper begins to do evaluations to get conclusions that has been concluded by this community.
Response. As clarified in our response to W2, the reviewer's statement that "the only thing newly defined by this paper is the WB-Direct and WB-Train in Section 4" does not accurately reflect the positioning and contributions of our work. As explicitly stated in Lines 17–19 and 80–94 of the original paper, our work is positioned as a comprehensive study rather than a method-oriented paper. WB-Direct and WB-Train are experimental settings designed to systematically investigate white-box communication, rather than the primary methodological contributions of our study.
More importantly, we respectfully disagree with the reviewer's characterization that our experiments merely reproduce conclusions already established in the community. Our study provides several distinct empirical findings:
(1) White-box communication effectiveness depends critically on its compatibility with MARL policy learning. Directly replacing learned communication with white-box protocols causes substantial performance degradation, whereas training MARL policies with fixed white-box protocols achieves performance comparable to learned black-box communication, even under the same observation constraints.
(2) The effectiveness of LLM-generated protocols depends on the underlying LLM capabilities and the specific communication problem. Stronger LLMs generally generate more effective protocols, while different communication dimensions exhibit different capability requirements, with what-to-communicate appearing more demanding than when or whom to communicate.
(3) The limitations of white-box communication are more closely associated with coordination complexity than team size alone. Increasing agent heterogeneity and reducing the explicitness of coordination-relevant semantics pose substantial challenges. Moreover, feedback-driven protocol refinement during MARL training remains unstable and does not reliably outperform fixed protocols.
(4) White-box communication knowledge can effectively guide neural communication learning. Despite the difficulties of directly evolving white-box protocols, their explicit communication decisions can serve as supervision for neural communication policies, improving learning efficiency while allowing further optimization through RL.
Collectively, these findings provide a systematic understanding of when and why white-box communication works, where its capability boundaries lie, and how its knowledge can benefit learned communication policies. Therefore, we believe that evaluating our study solely based on WB-Direct and WB-Train overlooks its broader research questions and empirical contributions.
W1: First, this paper's central ideas are not new, for the multi-agent communication, the pre-defined protocol can be transferred since the rules are fixed. This is a well-known conclusion.
Response. We thank the reviewer for the feedback. However, we believe that the assessment is based on a misunderstanding of our research motivation and contributions, which we would like to clarify below.
First, we respectfully disagree with the reviewer's statement that "for multi-agent communication, the pre-defined protocol can be transferred since the rules are fixed. This is a well-known conclusion." This assertion conflates the fixed nature of predefined rules with their cross-task transferability, which are fundamentally different properties. In fact, communication protocols are often closely coupled with task-specific observation semantics, agent configurations, and coordination requirements. For example, a white-box protocol designed for the SMAC scenario 1o_2r_vs_4r cannot be assumed to transfer effectively to 5z_vs_1ul, where different unit types and coordination requirements may necessitate substantially different communication decisions. Therefore, the fact that communication rules are fixed does not inherently guarantee their cross-task transferability, nor is such transferability a well-established conclusion in MARL.
Furthermore, as explicitly discussed in Lines 48–71 of the original paper, our motivation for systematically revisiting white-box communication stems from two key observations: (1) white-box communication offers advantages in interpretability and controllability over mainstream black-box communication approaches; and (2) recent advances in LLM capabilities have substantially reduced the manual effort required to construct and refine explicit communication protocols. Our motivation is not based on any presumed superiority of white-box communication in cross-task transferability. Neither white-box nor black-box communication policies can be assumed to transfer directly across different tasks without additional adaptation or task-specific considerations. Cross-task transferability constitutes a separate research problem and falls outside the scope of this study.
More importantly, the central contribution of our work is a comprehensive study that systematically revisits white-box communication from four perspectives: its effectiveness, sources of effectiveness, capability boundaries, and potential value for learned communication policies. These research questions are distinct from cross-task protocol transfer and collectively provide a broader understanding of the capabilities and limitations of white-box communication.
Therefore, we believe the reviewer's conclusion that "this paper's central ideas are not new," based on the presumed transferability of fixed communication protocols, is not well justified, as it does not accurately reflect the motivation, research objectives, or contributions of our study. Finally, given the reviewer's characterization of protocol transferability as a "well-known conclusion," we would appreciate it if the reviewer could provide relevant references or evidence supporting the claim that predefined communication protocols are inherently transferable across tasks simply because their rules are fixed.