- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a collaborative learning framework that replaces a single large language model with several smaller, heterogeneous models under a comparable parameter budget. The method combines protocol distillation and step-level supervision to train models to reason collaboratively, decide when to hand off tasks, and revise previous outputs. Experiments across five benchmarks show improvements over single-model and multi-agent baselines.
Critical strengths
-
The experimental results are promising, with consistent improvements across multiple tasks and comparisons against various multi-agent baselines.
-
The ablation studies and analysis of collaboration patterns provide useful evidence for the effectiveness of the proposed training framework.
Critical weaknesses
-
The technical novelty is limited. The proposed framework mainly combines existing techniques, including heterogeneous multi-agent collaboration, knowledge distillation, and step-level reward optimization. It is unclear what fundamentally new methodological contribution is introduced beyond their integration.
-
The efficiency evaluation relies mainly on model invocations and parameter-weighted token counts. Actual inference latency and computational costs are not sufficiently evaluated.
-
The experiments do not fully isolate the benefits of model heterogeneity from differences in model capacity and training. Stronger controlled comparisons would help establish whether heterogeneous collaboration is essential.
Questions for authors
How does the proposed framework compare with a single large model under the same inference compute budget?
Thank You for Your Feedback — We Look Forward to Further Discussion
Dear Reviewer Dmpa,
Thank you again for your thoughtful comments. We wanted to follow up on your questions about what the models learn through collaboration and how CL compares with a single large model at comparable inference cost.
Methodological contribution (
Q1). Under the shared protocol, each collaborator learns both how to advance the reasoning and when to hand off or stop. After training, the 4B model more often revises and hands off answers on MuSiQue, while it more often provides the final answer on GSM-Hard.Model capacity and heterogeneity (
Q3). We added a homogeneous three-8B control trained under the same settings as CL. With the largest collaborator matched in size, CL scores higher on eight of ten metrics while using 42.92% fewer total parameters.Inference cost and single-model comparison (
Q2,Q4). We reported TFLOPs for both input processing and output generation. On GSM-Hard, CL and the SE-RL 14B baseline use 63.67 and 64.85 TFLOPs, respectively. At this comparable cost, CL achieves 3.79 percentage points higher accuracy and 1.48 points higher F1.We would be grateful if you could consider these results in your final assessment. If any aspect of the method or the compute comparison merits further clarification, we would welcome the opportunity to discuss it.
Warm regards,
The Authors