- Rating
- 4(+1)
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper addresses the issues of insufficient role specialization and the difficulty in effectively converting cross-agent collaboration information into training supervision in existing multi-agent systems by proposing the MAS-OPD framework. MAS-OPD uses Role-Advantage Specialization to compare the differences in teacher scores for the same token under target and non-target role conditions, thereby enhancing role-specific capabilities while preserving shared capabilities. At the same time, it employs Privileged Attribution for Coordination to attribute conflicts between agents using reference solutions and validation results from the training phase, and provides this attribution information exclusively to the teacher, thereby generating more coordinated token-level supervision. Experiments were conducted on six benchmarks using Qwen models. The results show that this method achieved the highest average scores across benchmarks.
Critical strengths
S1: The paper break down the challenges of training multi-agent systems into two problems, which are role specialization and cross-agent collaboration, and provides targeted solutions for each. S2: Role-Advantage Specialization is well-designed, by comparing differences in teacher ratings for the same token under different role conditions, MAS-OPD construct signals of role-specific strengths to help agents develop complementary professional competencies while retaining shared capabilities.
Critical weaknesses
W1: MAS-OPD treats differences in token probabilities across different roles as role advantages, but these differences may reflect the model's sensitivity to prompts instead of representing true functional complementarity. W2: PAC uses conflict attribution information, which is invisible to students, to guide teacher in generating supervision signals. However, students may not be able to reproduce the instructors' judgments based solely on their own visible interaction history.
Questions for authors
Q1: How do the authors verify that role-conditioned token probability differences reflect genuine functional complementarity? Q2: How does PAC ensure that students can learn reliable collaboration strategies from the supervisory signals generated by teachers based on privileged attribution information? Q3: Do the performance gains of MAS-OPD persist under a matched teacher-inference and computational budget Q4: When multiple agents have partially correct judgments, or when the source of the conflict is ambiguous, is PAC’s attribution mechanism still reliable?