- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper addresses the problem of the knowing-doing gap in LLM agents. It reviews the prevalence of the gap and proposes a method for addressing it, through a decomposition of a process into specific agentic roles.
Critical strengths
- The knowing-doing gap is a significant problem in LLM agents. The many references to prior work show how this problem has been observed in many circumstances.
- The idea of decoupling task correctness from "knowing-doing failure" is a nice idea. The insight that these can be separated is a potentially valuable insight.
Critical weaknesses
- The paper is significantly over-length and yet is completely missing any results in the main text. The experiment and results section say what will be done, but it's not clear anything was done.
- The description of the approach is not clear. There is a lot of text in the paper that does not help get to the point of exactly what the approach is.
Questions for authors
- What is the exact, precise implementation of the approach? Math notation can be useful here. As is, the paper in several places describes what the approach is not. It would be more clear to say what the approach exactly is.
- Does the approach behave as expected? What were the results?