- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ErRsi, a framework for low-cost agent self-improvement without updating model weights. It combines context-aware error localization, error history organization, and targeted behavioral revision with conditional guidance and paired evaluation. Experiments on Who&When, WebShop, and ALFWorld demonstrate improvements in error localization, task success, and token efficiency.
Critical strengths
- The paper addresses a practical and relevant problem: improving agents through execution feedback while controlling the cost and potential interference of accumulated experience.
- The framework provides an end-to-end pipeline connecting error diagnosis with behavioral revision, and the use of conditional executable guidance is a practically useful design.
- The experiments cover multiple benchmarks and model scales, with encouraging results in token efficiency and task performance.
Critical weaknesses
- Limited methodological novelty.
The proposed framework appears to be largely a combination of existing techniques and engineering designs, rather than introducing fundamentally new methods. For example, Elastic Error Localization mainly switches between full-trajectory inspection and active investigation based on context limits, while Dual-View Attribution combines two LLM-based reasoning perspectives with a simple arbitration mechanism. While the overall integration may be practically useful, the paper does not clearly establish what constitutes the key methodological innovation beyond these existing components.
- Potential overclaiming of "Elastic Error Localization" and "Recursive Self-Improvement."
The terminology and framing appear stronger than what the proposed methods and experiments substantiate. The "elastic" mechanism is essentially a threshold-based switch between two evidence acquisition strategies, rather than a substantially new localization algorithm. More importantly, the claimed recursive self-improvement is evaluated with only two candidate revision rounds in the main WebShop experiments. This limited setting does not sufficiently demonstrate sustained self-improvement, long-term experience accumulation, or scalability over multiple iterations.
Questions for authors
N/A