- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces a large-scale controlled benchmark setting for multi-agent collaboration with unreliable sub-agents or colleagues. The UnCoBench benchmark introduces failures in the sub-agents via misaligned, incomplete, and missed settings. Under these failure and unreliable multi-agent settings, the authors study the impact on the main agent. The experiments show that comparable performance under reliable collaboration do not translate to comparable performance in the unreliable multi-agent collaboration setting.
Critical strengths
- The paper studies an important problem of unreliable collaboration in a multi-agent system which is an underexplored area.
- The authors’ approach of creating or simulating unreliable collaboration that incorporates misaligned, incomplete, and missed settings seem principled and realistic.
Critical weaknesses
- Some experimental results need to be explained or clarified (see question section below).
- Missing code and dataset which prevented me from assessing the quality of the benchmark which is the core contribution of this paper.
Questions for authors
- Figure 6 shows an additional bar where multiple colleagues can be unreliable at the same time. I assume the “mixed” bar plot consists of sub-agents or colleagues that demonstrate multiple types of unreliable behaviors. In this paper, do the authors also consider scenario where for a single specific unreliable setting (eg: misalignment), we have multiple roles or sub-agents that demonstrate the same type of unreliable behavior? In Line439, the authors described that for the other experiments, except for the “mixed” experiments, they involve only a single role agent (I assume a single sub-agent or single colleague). Can you clarify whether the unmixed setups consist of only a single unreliable sub-agent or it can also consists of multiple unreliable sub-agents for a given type of unreliable setting?
- Follow-up suggestion: For each type of unreliability, how does the performance of the main agent change as the number of unreliable sub-agents or colleagues increases for a given type of unreliability.
- In Figure 3, we see for LLMs and tasks, that they can transition from reliable (wrong) to unreliable (correct) setting, i.e., the blue region. Can the authors clarify this strange observation as I expect the overall task success to worsen as we make the sub-agents or colleagues in the multi-agent system to be unreliable.
- In the experiments, how many trials the agent was ran for every test case? Literature usually use multiple trials of agent runs.
- There is a similar work [1] that is missing in the references. Please discuss the differences between the proposed benchmark and prior work [1].
[1] Huang, J. T., Zhou, J., Jin, T., Zhou, X., Chen, Z., Wang, W., ... & Sap, M. (2024). On the resilience of llm-based multi-agent collaboration with faulty agents. arXiv preprint arXiv:2408.00989.
6 comments
Response to reviewer GoxG (2/3)
W3. Why do some tasks transition from Reliable (wrong) to Unreliable (correct) in Figure 3?
Figure 3 compares outcomes from separate executions of the same underlying tasks. Although unreliable collaboration reduces aggregate accuracy, individual trajectories can occasionally improve because the altered interaction elicits additional checking or follow-up. Reliable evidence also does not guarantee that the main agent will integrate it correctly in every execution.
For example, in task_598, Qwen3.8-27B incorrectly returned “Do not deploy” after two rounds under Reliable, despite having the required evidence. Under Misaligned, an optical measurement referred to Firmware Build 3.8 instead of the required Build 4.2. The agent explicitly requested the record directory, retrieved the correct version-specific evidence, and returned the correct decision and numerical result after four rounds.
Similarly, in task_147, Gemma 4 31B returned an incorrect fuel-consumption average of 14.17 under Reliable, despite receiving all three numerical inputs. Under Incomplete, a missing safety-related value prompted an additional query; after obtaining it, the agent returned the correct average of 14.30. Both successful trajectories finished within the five-round Reliable budget. These cases illustrate how additional verification can accompany a successful trajectory, although they do not establish a universal explanation for every wrong-to-correct transition.
These individual gains coexist with substantially larger losses. For Qwen3.8-27B under Misaligned, only 4 tasks transition from wrong to correct, compared with 702 transitioning from correct to wrong. For Gemma 4 31B under Incomplete, the corresponding counts are 10 and 268. Thus, the blue regions reflect occasional improvements in individual executions, while the overall performance degradation remains clear.
W4. How many trials were run for each test case?
Our main evaluation used one complete agent trajectory per task for each model-setting combination, covering 1,000 paired task groups. This design balanced broad task coverage against the substantial cost of repeated multi-turn evaluations, particularly for API-based models. While the large task set improves the precision of aggregate performance estimates, repeated evaluations provide complementary evidence about variability on the same tasks.
To directly assess this variability, we conducted eight repeated evaluations on the same fixed subset of 100 task groups for Qwen3.8-27B, Gemma 4 31B, and Mistral Small 4-119A6B across Reliable, Misaligned, Incomplete, and Missed. We retained the original evaluation settings and prompts, yielding 9,600 complete task executions.
Accuracy (%) is reported as mean ± SD across eight runs of the same 100-task subset. SD is measured in percentage points.
| Main agent | Reliable | Misaligned | Incomplete | Missed |
|---|---|---|---|---|
| Qwen3.8-27B | 85.4 ± 1.3 | 6.0 ± 1.9 | 49.6 ± 2.6 | 82.8 ± 1.6 |
| Gemma 4 31B | 94.4 ± 0.7 | 11.9 ± 2.1 | 65.9 ± 2.5 | 92.4 ± 1.1 |
| Mistral Small 4-119A6B | 61.7 ± 4.0 | 12.9 ± 2.9 | 49.0 ± 4.1 | 56.0 ± 3.3 |
The table above reports the mean and standard deviation of accuracy across these eight runs. The results show modest variation in aggregate accuracy: SDs range from 0.7 to 2.6 percentage points for Qwen and Gemma, and from 2.9 to 4.1 for Mistral. All three models retain the mean accuracy ordering Reliable > Missed > Incomplete > Misaligned. The mean Reliable-Misaligned gaps range from 48.8 to 82.5 percentage points, substantially exceeding the observed run-to-run SDs. These repeated evaluations support our main qualitative finding on the tested models and subset: strong task-solving performance with reliable evidence does not ensure effective recovery from unreliable collaboration.
Response to reviewer GoxG (3/3)
W5. How does UnCoBench differ from Huang et al.'s work on faulty-agent resilience?
We thank the reviewer for highlighting this relevant work, which helps contextualize our study. We would like to clarify that the ICML 2025 version of Huang et al.’s work is already cited in our submission (line 582 in our original submission and line 628 in our revised manuscript). Their MAS-Resilience benchmark measures how well communication architectures and defense mechanisms preserve downstream performance in the presence of faulty agents. In MAS-Resilience, a single agent can in principle solve the task using the original inputs, while in UnCoBench the facts needed to determine a unique answer are distributed across role agents’ private records. The main agent must therefore obtain evidence from those agents. UnCoBench therefore evaluates whether the main agent can identify problematic replies from role agents, recover the necessary evidence through targeted follow-up, and use it to reach the correct decision.
Reference:
Huang, J.-T., Zhou, J., Jin, T., Zhou, X., Chen, Z., Wang, W., Yuan, Y., Lyu, M., and Sap, M. (2025). On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents. Proceedings of the 42nd International Conference on Machine Learning, PMLR 267, 26202-26226.
We have revised the manuscript to incorporate the additional results and discussions presented in these responses.
Response to reviewer GoxG (1/3)
We thank the reviewer for the careful reading and questions about the experimental protocol and reproducibility. Below, we clarify the failure settings, explain the wrong-to-correct transitions through case studies, and discuss the relationship to prior work. We also provide an anonymous code and dataset repository and additional results on multiple unreliable roles and repeated evaluations.
We provide the code and full benchmark dataset in an anonymous repository to support assessment of the benchmark’s quality and reproducibility.
Anonymous code and dataset repository of UnCoBench
We thank the reviewer for the suggestion to examine multiple unreliable colleagues. In the original Misaligned, Incomplete, and Missed settings, exactly one necessary role exhibits the designated unreliable behavior, while the other roles remain reliable. We chose this controlled design to examine whether the main agent can detect and repair an evidence failure. This directly probes the implicit assumption that colleagues provide trustworthy evidence. Mixed instead assigns the three different failure types to three distinct necessary roles.
To examine how performance changes as more colleagues become unreliable, we have extended each individual setting to two and three unreliable roles, comparing k = 1, 2, and 3 across five models from different families and scales, with 1,000 tasks per configuration. These experiments specifically test multiple colleagues exhibiting the same type of unreliability, complementing the heterogeneous failures in Mixed.
k is the number of roles exhibiting the same failure type. Each configuration contains 1,000 tasks. Cells report accuracy (%) with mean interaction rounds in parentheses.
The table above shows distinct patterns across failure types. Under Misaligned, accuracy decreases monotonically across all five models: Gemma 4 31B falls from 11.6% to 3.5% and 0.2%, while GLM-5.3-Flash falls from 35.1% to 29.1% and 24.3%. Under Incomplete, Mistral Small 4-119A6B drops from 43.7% to 26.3% and 11.8%, although GLM-5.3-Flash remains robust. Under Missed, GLM-5.3-Flash declines from 96.2% to 86.6% and 70.3%, with mean rounds increasing from 3.61 to 4.33 and 5.07 within the same six-round budget.
These results reinforce our finding that task-solving strength with reliable evidence does not guarantee sustained verification and coordinated recovery. As failures accumulate, the main agent must track unresolved requests and integrate corrected evidence across interactions. This extension examines the number of affected roles; it does not constitute an exhaustive study of error frequency or severity.