- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates social vigilance in LLM agents across three realistic tasks, web navigation, online commerce, and code merging. Experiments with six models show that malicious advice substantially reduces task performance, while helpful advice generally improves it. The authors further find that models can often evaluate suggested actions correctly despite being influenced by malicious advice. To address this issue, they propose a Bayesian vigilance harness that combines independent action evaluation, baseline decisions, and advisor utility estimation. Experimental results demonstrate improved resilience to malicious advice.
Critical strengths
-
Important research problem. The paper investigates how LLM agents respond to helpful and malicious advice, addressing a relevant challenge for reliable multi-agent systems.
-
Useful experimental evaluation. The paper evaluates six LLMs across three different task environments under both helpful and malicious advice. The results provide useful insights into how external advice affects agent performance across different scenarios.
Critical weaknesses
1.Limited novelty and insufficient validation of the proposed method. Prior work has already investigated LLM vigilance toward motivated communication [2] and attacks through inter-agent communication [3], both of which are cited in the submission. More directly, [1] studies benevolent and malicious advice in Sokoban and reports that task performance and vigilance are dissociable. This closely overlaps with the supplementary Sokoban evaluation in the submission, yet [1] is neither cited nor discussed. Although the authors extend the evaluation to three additional task environments and introduce a Bayesian vigilance harness, the incremental contributions remain insufficiently established. Specifically, the harness achieves an aggregate success rate of 66.9% under malicious advice, below the unadvised baseline of 71.2%. Under benevolent advice, the success rate decreases from 91.1% without intervention to 73.9% with the harness. While the method improves performance relative to the unprotected malicious advice condition, its advantage over simpler alternatives remains unclear. The paper lacks direct comparisons with simple value based gating strategies, as well as ablation studies isolating the contribution of Bayesian trust updating. These limitations weaken the evidence supporting the novelty and practical effectiveness of the proposed method.
[1] Under the Influence: Quantifying Persuasion and Vigilance in Large Language Models. arXiv preprint, arXiv:2602.21262, 2026.
[2] Are Large Language Models Sensitive to the Motives Behind Communication? NeurIPS 2025, Main Conference.
[3] Red-Teaming LLM Multi-Agent Systems via Communication Attacks. Findings of ACL 2025.
2.Limitations in experimental design and result reliability. The evaluation includes only four Web Navigation tasks and ten tasks each for Online Commerce and Code Merging, with GPT-5 serving as the sole advisor. This limited setting raises concerns about generalizability across different advisors and attack strategies. Furthermore, the experimental protocol is insufficiently documented. For example, Table 1 reports a 58.3% success rate for Grok 4.5 on four Web Navigation tasks, suggesting repeated trials, but the number of repetitions and sampling configurations are not clearly specified. Additionally, Table 1 reports a standard deviation of 0.016 for benevolent performance across models, whereas the six reported model averages yield approximately 0.106. The paper also lacks reported executable security tests validating the ground truth labels in Code Merging. These issues raise substantial concerns about the reproducibility, statistical reliability, and validity of the experimental conclusions.
Overall Presentation. Much of the manuscript, particularly its figures and tables, gives the impression of being directly AI-generated without sufficient manual review or refinement. The overall presentation lacks polish, and the authors should carefully review and improve the formatting, visual consistency, and readability of these materials.
Questions for authors
Code availability and reproducibility. The ICLR 2027 Author Guidelines explicitly encourage authors to submit source code as supplementary material and strongly encourage efforts to ensure reproducibility. Given the experimental nature of this work, access to the source code, evaluation datasets, and implementation of the proposed vigilance harness is particularly important for independently verifying the reported results.
3 comments
Thank you for your detailed responses and additional experiments. I appreciate the authors' efforts. While some of my concerns have been addressed, others remain insufficiently resolved.
The overall presentation and writing quality also remain below the standard expected for an accepted paper, particularly in the clarity and organization of the writing, as well as the quality, consistency, and readability of figures and tables. I encourage the authors to refer to exemplary research papers and further improve the manuscript's overall quality in future revisions.
I will maintain my original score.
Please clarify what writing can be improved?
Can you please refer us to a paper that you consider to have "exemplary" writing and readability? We have extensively checked the writing and readability of the paper, and it is well within the standards that we have seen in other papers accepted at ICLR.
Official Comment by Authors
Thank you for your feedback! We are happy to hear you think this is an important research problem, and that we provide “useful insights into how external advice affects agent performance across different scenarios.” We addressed your comments below, but please let us know if you have any further questions or comments.
W1: Novelty of Results
Paper [1] explores vigilance in an extremely simple puzzle environment, and provides no harness. For papers [2] and [3], while we agree that these both study vigilance, neither of these works overlap with our existing work. Paper [2] explores vigilance with experiments from cognitive science to see how LLM behaviour overlaps with humans. Their experiments 1 and 2 use highly-controlled vignettes to study these behaviours, and their experiment 3 does not involve social interaction or agency, but instead involves LLMs passively viewing YouTube videos. This differs largely from our real-life, agentic task domains. Paper [3] does not explore vigilance within individual agents, but instead by seeing how herd behaviour of multi-agent systems can be steered by intercepting messages. Finally, paper [2] only includes a prompt intervention (similar to the awareness prompt that we compare our vigilance harness against) and paper [3] does not include any intervention.
W2: Advantage over Simpler Alternatives
Because multiple reviewers asked a similar question, we addressed this in-depth in (2) of our summary comment, so please see this above. In short, our harness acts similar to value-based gating in one-step environments (e.g., Code Merging or Online Commerce). However, because in multi-step environments (e.g., Web Navigation) the harness should use information about the advisor agent from previous states to inform its estimate in the current state, we track λ over multiple steps, rather than simply gating it at each step. We demonstrate this with an additional experiment in the Appendix (see Figure 12).
Additionally, our harness does not provide much benevolent improvement for models, as the relative τ of most frontier models is already quite high. However, for weaker models, where listening to advice is more beneficial, our harness improves their performance under benevolent influence. To verify this, we ran an additional experiment with several simpler models, and we find that the vigilant harness improves the performance to ceiling under benevolent influence (see Figure 9).
W3: Generalizability of Experiments
We selected our three environments as they cover a wide variety of common agentic tasks, such as web crawling, purchasing items, and coding. Within each of these environments, we additionally offer a wide variety of variance, such as a breadth of potential dangers within Web Navigation (see Figure 14 for examples) and different scams within Online Commerce (see Figure 15 for examples). Despite this variance, we find very consistent behavioural patterns from all 6 models across these environments. This suggests that our environments are a sufficient testbed for understanding how these behaviours generalize to other domains (as further supported by our supplementary environment in Appendix B, which varies even more from the existing tasks, yet sees similar results).
Additionally, we selected GPT-5 as the advisor agent as we broadly observed that the choice of advisor agent, for all sufficiently capable LLMs, made little impact on the results (i.e., all frontier LLMs are similarly persuasive). To empirically verify this, we ran an additional experiment in the Appendix with two other advisors, Qwen3.8-27B and Claude Opus 4.8, and found little to no consistent difference across advisors (see Figure 7).
W4: Documenting Experiments
For Grok’s 58.3% (7/12) solve rate in the Web Navigation tasks, this is because we ran each model over 3 trials in the baseline case to better calibrate our estimate of τ. We agree this was not well communicated and have updated the manuscript.
For the standard deviation reported in Table 1, this is a typo between 0.016 and 0.106, and we have updated this.
Thank you for pointing these out to us.
W5: AI Usage
Because another reviewer mentioned this, we also addressed this in-depth in (1) of our summary comment, so please see this above. In short, we did not use AI to generate or assist in the generation of any figures in the paper, or assist with writing or editing the manuscript. We included a link to the Figma file where the first author created all the figures, and we encourage you to check it out. Additionally, all the authors manually wrote and edited the manuscript in a shared Overleaf. Besides this, it would help us if you could elaborate on what other parts of the paper require polish.
Q1: Code Availability
We are happy to and plan to make all code public after the double-blind review process is complete, such as the ground truth labels in the Code Merging dataset.