- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
Existing latent communication approaches for multi-agent systems (MASs) do not jointly optimize communication with multi-agent reasoning. This paper proposes DiffMAS, a training framework that treats latent communication as a learnable component of multi-agent systems. Across five backbones and six benchmarks, DiffMAS consistently matches or exceeds single-agent inference, text-based multi-agent systems, and prior latent communication methods.
Critical strengths
S1. The proposed approach is well-motivated and technically interesting.
S2. Extensive empirical studies demonstrate the effectiveness of the proposed approach.
Critical weaknesses
W1. The approach requires training different task-specific adapters.
W2. It remains unclear whether the proposed approach can work with agents based on different model backbones.
Questions for authors
Did you observe any training instability issues? Do you have learning curve figures for better understanding the training dynamics?
2 comments
Thank you for your response. I don't have further questions. I'll keep my current rating.
Response to Reviewer XF9F
We appreciate your positive assessment of our work and your constructive suggestions for clarifying its applicability and training behavior. We have considered your concerns about adapter specialization, different backbones, and training stability, and address each point below.
W1. Adapter specialization and cross-domain transfer.
We would like to clarify that the adapters are trained by domain and reused across benchmarks. We train three adapters per backbone—one each for math, code, and commonsense—using 210 MATH problems, 50 HumanEval problems, and 700 CommonsenseQA traces, respectively. For example, the same MATH-trained adapter is used on AIME24, AIME25, and GPQA-Diamond. Its +20.2-point gain over the single-agent baseline on GPQA-Diamond with Qwen3-8B shows transfer from mathematical training data to graduate-level science questions. We hope this clarifies that a separate adapter is not needed for every benchmark. Training a single adapter jointly across domains would be a useful next step toward broader reuse.
W2. Compatibility across different backbones.
For the setting evaluated in this paper, the agents share a backbone and compatible KV layouts. Your question points to a useful extension: connecting agents with different backbones would require a differentiable mapping between their KV spaces. That mapping could be trained jointly with the adapters using the same final-answer objective. We will make the shared-backbone requirement clearer in the revision and explain how such a mapping could extend the approach to heterogeneous agents.
Q1. Training stability and learning curves.
We did not observe divergence or loss spikes in our training runs, which use gradient clipping at 1.0 and a cosine learning-rate schedule with 3% warmup. We agree that learning curves would make the training behavior easier to assess, and will include the training-loss curves in the appendix.