- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
MUTE reduces communication after training a fully communicative MARL policy. It evaluates messages through counterfactual changes in the joint critic, trains an attention-based message-value estimator, and penalizes low-value messages while anchoring individual Q-values to a frozen teacher. The paper provides a conditional performance bound and evaluates ten scenarios across five environment families.
Critical strengths
- Separating cooperative policy learning from communication reduction is well motivated. The training-budget study supports establishing a capable policy before reducing communication.
- The experiments cover ten scenarios and report five seeds with confidence intervals. The results suggest promising performance–communication trade-offs.
- The appendix includes useful ablations on anchoring, message-value estimation, regularization, and training schedules, alongside gating/penalty controls and computational-cost measurements.
Critical weaknesses
-
Novelty and baseline coverage remain unclear. CMVC (IEEE TSMC: Systems, 2025) already learns counterfactual message values for selective communication, but is neither discussed nor evaluated. IMGS-MAC (ICRA 2023) and ReSCOM (AAMAS 2025) provide related lossless sparsification and curriculum approaches; both are cited but not compared. The incremental benefit of MUTE's broadcast attribution and anchoring needs clearer justification.
-
Return preservation is insufficiently justified. As written, Equation 7 feeds the same current messages to teacher and student. If their receiver networks remain identical, the anchor loss stays zero even when removing essential messages changes their original behavior. The teacher's inputs therefore need clarification. Moreover, agreement between learned Q-networks does not establish preserved returns, and greedy discrete actions complicate the theorem's smoothness assumption.
-
Message magnitude is not a sufficient measure of communication savings. L1 shrinkage does not necessarily reduce transmitted bytes. The send/no-send rule, communication-rate metric, and deployment role of MVE—which consumes all agents' messages—need clarification.
-
The evaluation does not fully establish selectivity. Dropout robustness can reflect policy adaptation rather than accurate message valuation. Figure 4 appears to compare different final communication rates; matched-rate controls would be more informative. The main-text MMM2 result of 94% also needs reconciliation with 0.86 ± 0.05 in the appendix.
-
Minor comments. Reconcile λμ_MVE with λ in the algorithm and theorem, and distinguish stopping TD updates from freezing policy parameters.
Questions for authors
- How does MUTE differ from CMVC and prior lossless or curriculum-based communication reduction, and can a focused comparison establish the benefit of the proposed combination?
- Could you clarify the teacher's message inputs during anchoring and explain how the theoretical assumptions correspond to the implemented policy?
- Could you clarify the deployment protocol and communication metric, and strengthen the evidence for selective suppression and preservation at comparable communication rates?