- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces AgentDriftBench, a benchmark that evaluates how LLM agents adapt to dynamic changes in tool environments, using controlled schema drift and recovery-oriented metrics to assess adaptation capabilities across different models and prompting strategies.
Critical strengths
None.
Critical weaknesses
-
Poor writing! The paper reads more like a report than a research paper and appears to be AI-generated (e.g., a brief introduction and excessive use of bullet points). The paper even includes the name of code files directly in the main text. (Page 9)
-
The evaluated models are outdated and limited to the 0.5B–7B range, which is insufficient to support the paper's broader conclusions about agents' adaptation capabilities, the effects of memory, and responses to drift notices.
Overall, I believe this paper need to be carefully revised or even be desk-rejected.
Questions for authors
See Weaknesses.