- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This work studied information neglect in LLM multi-agent systems. A receiving agent may fail to use relevant information communicated by another agent, even when that information is necessary to complete the task. The authors propose Trust Framing (TF), a fixed preamble that introduces the partner’s message using source and reliability cues, optional task-specific guidance, and an instruction to integrate the message with the receiver’s own information.
The method is evaluated on three question-answering benchmarks with distributed evidence and on the cooperative environment Collab-Overcooked. The authors report aggregate improvements of 9.5 percentage points in QA F1 and 7.6 percentage points in task-completion rate. Through component ablations and experiments with corrupted messages, they argue that effective collaboration requires appropriate reliance on partner information.
Critical strengths
-
The motivation and beginning of the paper are quite interesting. I found the introduction compelling, particularly the sociological discussion on trust. Additionally, In relation to the where information or capabilities are distributed across agents, the failure to integrate a partner’s contribution can undermine the purpose of collaboration is also interesting. The human audit substantiates this problem and distinguishes receiver-side neglect from sender errors and other plausible failures.
-
The paper reports substantial and significant aggregate gains for a simple intervention. The QA evaluation covers all 36 directed combinations of six model endpoints, and the evaluation in Collab-Overcooked provides evidence of past question answering tasks. The reported aggregate improvements are statistically significant, and the component ablations characterize which parts of the adaptor contribute to the performance. The method is also straightforward and simple to implement and requires no model training or additional search.
Critical weaknesses
-
I find the presentation of the experiments difficult to assess. Although the setup is described across the main text and appendix, it takes substantial effort to mentally reconstruct a complete trial and understand the differences among the main experiment, component ablation, and corruption studies. In particular, the paper defines the corruption categories but does not show examples of original and corrupted messages. These examples are important for judging the severity of the corruptions and understanding what successful selective reliance is. The Collab-Overcooked results would similarly benefit from a worked example showing the kitchen state, each agent’s observations and available actions, the exchanged messages, and the resulting state transitions. Table 11 provides a short textual example, but it does not make the comparison sufficiently transparent. A consolidated summary of the experimental settings and a matched rollout visualization would substantially improve the presentation.
-
The evidence for the narrow interpretation in terms of trust could be more clearly demonstrated. The “trust” component combines several elements, including partner provenance, exclusive access to information, and a reliability claim. The factorial ablation supports the usefulness of this combined block, but it does not fully distinguish the proposed interpretation from alternatives such as clearer source attribution or clarification that the partner holds missing evidence. More closely matched controls separating these elements, or narrower wording of the mechanistic claims, would make the conceptual contribution clearer.
-
A minor presentation issue is the residual narrow text wrapping at the top of page 6, apparently carried over from Table 1 on the preceding page.
Questions for authors
-
Could the authors provide representative clean and corrupted messages for each condition, together with the relevant construction and validation rules? It would also help to provide the complete condition-by-condition results for the separate primary corruption experiment, since Table 2 reports the exploratory PT/IF/TF comparison.
-
Could the authors clarify how the task and evaluation budget are matched in Table 11? The passthrough example reports an 80-step timeout, while the TF example reports 14 completed orders over 623 steps. A comparison with the same initial state, recipe, action budget, and success criterion would make the coordination improvement easier to interpret.
-
What motivated using Qwen3.5-35B-A3B as the sole adaptor model for the L1–L3 baselines? Wouldn’t Gemma or OLMo models have different trust capacity? How sensitive might the negative results for message rewriting be to that choice? Please also explain the selection of the three endpoints used for Collab-Overcooked.
-
What evidence most directly distinguishes the proposed trust mechanism from neutral source attribution or an explicit reminder that the partner has access to missing information?
-
It would be interesting to test whether prompt or context optimization using task-success feedback—for example, GEPA https://arxiv.org/abs/2507.19457 or CORE https://arxiv.org/abs/2605.28742—can discover similar instructions for using partner information without being initialized with TF. Evaluating the resulting prompts on held-out tasks and model pairs would help determine whether TF can emerge naturally through optimization and whether it provides additional benefit after optimization.