- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The core problem which the paper is trying to address is the fact that AI agents nowadays assume something which is actually not true in reality and end up performing an action which should not have been performed. The example which the authors take is that of an AI agent overwriting an existing file which should not have been overwritten. In order to counter this problem, the authors propose a framework which consists of three layers: failure, identify + resolve, and preserve. Evaluation is performed on two datasets: one which the authors build themselves, and the second one is the existing Webarena verified benchmark.
Critical strengths
The identified problem is timely, relevant, and interesting.
Critical weaknesses
First of all, the paper is very, very difficult to read. There is hardly anything understandable in the paper, probably because the authors have used too much AI to write the paper (authors can confirm this). If thats the case, request the authors to write the first draft themselves, and then, of course, they can use AI to improve the grammar and presentation of the paper.
Also, I'm not really positive about this paper. Although the problem identified is relevant and interesting, the proposed solution does not seem to be general enough to be applied in any agent setting. At the end of the day, the ultimate problem is to identify what is a safe action and what is not a safe action, and it ultimately depends on the instructions given by the user, etc. An easier solution might just be to check with the user if something is safe or not before actually executing that action. That's why we see that in today's agents, Claude Code, Codex, etc., they have different kinds of permissioning modes. Depending on the criticality of the task and the environment, the users can choose the permissioning mode.
Is it possible to ground the proposed solution or idea more firmly in existing work? Was not able to understand from the related work what the state of the art is in this area.
Questions for authors
See weaknesses.