- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
ReGE turns records from multiple attempts at the same task into guidance for a fresh run. Its main variant, ReGE-Syn, summarizes the attempts together in one model call. The same base model generates the attempts, writes the guidance, and executes the task, without parameter updates. Results show improved task success and lower guidance-construction costs in some comparisons.
Critical strengths
-
The method is simple and practical. It preserves useful details such as commands, paths, and mistakes to avoid, and is evaluated across four benchmarks.
-
The compression results are convincing. On the matched BrowseComp-Plus subset, ReGE-Syn produces much shorter guidance than direct history or separate summaries. It also uses far fewer construction tokens than adapted AggAgent, with similar observed success.
Critical weaknesses
-
The cost comparison needs care. The main efficiency analysis excludes ReGE’s initial attempts, while Reflexion’s cost includes all its trials and reflections. This comparison therefore does not show that ReGE costs less overall. Table 2 provides estimates that include the initial attempts, but success under equal total token budgets remains unclear.
-
The benefit of joint synthesis over simpler reuse methods is less clear. ReGE-Sel is competitive, and direct history achieves the same success rate as ReGE-Syn on the matched BrowseComp-Plus subset. These results support compression more strongly than an accuracy advantage from combining trajectories.
-
The evaluation focuses on repeating the same task from a reset environment. It does not test whether the guidance remains useful when the environment changes or cannot be reset, or whether experience transfers to other tasks. The practical conclusions should reflect this limited scope.
-
The distinction from earlier experience-summary methods needs to be clearer. Summarizing trajectories together in one call is simple and inexpensive, but stronger evidence is needed to show that combining complementary information adds value beyond reusing an existing answer or a good trajectory.
Questions for authors
-
What are the exact SQL grading rules, and how was the BrowseComp-Plus answer judge validated?
-
Can the authors report actual token usage for the initial attempts, guidance construction, and final execution, and compare methods under equal total budgets?
-
Can the main success-rate comparisons include confidence intervals or repeated runs?
-
Does the guidance remain effective when the initial state changes or when it is applied to a related task?