- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2(+1)
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes VetEx, a training-free experience-reuse framework for frozen LLM agents. VetEx constructs corrective experience by contrasting successful and failed trajectories on the same task, incorporating successful trajectories from donor models when the receiver has no observed success for that task. It also retrieves successful trajectories, removes redundant or unsupported actions, and validates the cleaned trajectories through environment replay. The resulting corrective experience and reference trajectories are injected into the receiver's initial context. Experiments demonstrate the effectiveness of VetEx.
Critical strengths
VetEx demonstrate consistent improvement over competitive experience-learning baselines. Across three benchmarks and three receiver models, VetEx achieves higher scores than the strongest selected external baseline in all nine settings. These results provide empirical support for the effectiveness of the overall framework across different models and task domains.
Critical weaknesses
W1. Overstated positioning and insufficient differentiation with prior work.
1-1. Oversimplified characterization of prior work.
The manuscript contrasts VetEx with existing methods that focus on "how available evidence is extracted and organized" to establish the gap in positive evidence coverage from experience organization. However, I think this framing oversimplifies some work. ExpeL already addresses this issue through Reflexion retries: it obtains successful trajectories for previously failed tasks and uses them to construct same-task success-failure contrasts. The main differences in corrective experience construction appear to be how missing successful trajectories are obtained (same-model retries versus donor successes) and how success-failure contrasts are organized into uniform construction units. Thus, the paper's positioning overstates its conceptual differentiation from prior work, making the paper's actual contribution difficult to identify.
1-2. Insufficient evidence for the claimed distinction.
The core question is: which approach is more effective at filling positive-evidence gaps on tasks without successful receiver trajectories, ExpeL's same-model reflection retries or VetEx's donor successes? Although ExpeL is included as a baseline, the comparison in Table 2 varies multiple components simultaneously, making it difficult to isolate the benefit of donor-based gap filling. I cannot find controlled comparison that answers this question.
W2. Limited and insufficiently justified benefits of the trajectory cleaning pipeline
2.1. Limited support for the claimed benefits of trajectory cleaning.
The paper motivates trajectory cleaning as an independent solution to the misleading or redundant behaviors contained in successful trajectories. In Table 6 (without corrective experience), however, 'Clean-only' performs slightly worse than 'Raw-only' on average (-0.31%p), improving only 4/9 settings. Notably, the largest performance change is -4.47%p on (ALFWorld, Qwen3.6-27B), and all three ALFWorld results show degradation. So, there is limited evidence for trajectory cleaning as an independent solution to the problem the authors argue it addresses ("gap in how it prepares task references"), with its benefits primarily with corrective experience added.
2.2. Limited gains even when combined with corrective experience.
In Table 6 (when combined with corrective experience), cleaning yields an average improvement of +2.73, but the gains are uneven. Some shows marginal improvements: +1 on (ALFWorld, Qwen3.6-27B) and +0.33 on (HotpotQA, Qwen3.6-27B). One shows regression: -0.49 on (ALFWorld, GLM-5.1). Notable gains are concentrated on WebShop: +4.71 on average. Thus, even in the joint setting where cleaning improves average performance, its contribution is often modest and varies considerably across benchmarks and receivers.
2.3. Unclear contribution of replay validation.
The paper presents replay validation as a key component of trajectory cleaning, which aims to remove misleading behaviors while preserving action-observation dependencies (lines 80-85). However, replay only verifies terminal success on the source task; it does not explicitly check whether the actions are supported by preceding observations or whether the cleaned trajectory provides a better reference for future tasks. Furthermore, the paper does not evaluate 'cleaning without replay' or report replay stats (e.g., reply pass rates and raw-fallback frequencies). Consequently, it remains unclear whether replay validation meaningfully filters harmful cleaning or contributes to the observed downstream gains.
W3. Limited practical applicability due to replay
VetEx validates cleaned trajectories by replaying the selected original actions in the source-task environment. This assumes that past task environments can be reproduced and their actions can be safely re-executed. This may be impractical in real-world agent deployments. Moreover, the cleaning prompt potentially requires irreversible actions to be repeated solely for validation. When replay is unavailable, the described raw fallback mechanism can reduce VetEx to VetEx-Exp+RT, eliminating the reported benefits of trajectory cleaning.
Notes
In Table 6, the "External baselines" header spans not only Ext. but also Raw-only and Clean-only. According to Section 4.4, Figure 6(b), and Table 16 that treat Raw/Clean Trace-only as the paper's own trace-preparation configurations, I interpret Raw-only and Clean-only as internal ablation conditions, and W2 is based on this interpretation. If my interpretation is correct, the header should be corrected to clearly distinguish external baselines from internal ablation conditions.
Questions for authors
Please see weaknesses.
10 comments
W1-1. Oversimplified characterization of prior work.
Thank you for pointing out the imprecise characterization of prior work. Your comment has helped us clarify both our positioning and our contribution.
We agree that ExpeL actively acquires successful trajectories through Reflexion retries and uses same-task success–failure comparisons to extract corrective experience. Our original description of existing methods as focusing on “only extracting and organizing available evidence” did not adequately acknowledge this active acquisition process. We have corrected this characterization in the Introduction and Related Work (Sections 1–2).
Our work investigates what kinds of experience are useful to a receiving agent, the mechanisms underlying their effectiveness, and the conditions under which they help. We address this question through methodological designs concerning experience sources, extraction, and use, together with controlled experiments examining their practical effects. Our contribution therefore encompasses both the design of VetEx and empirical findings about experience effectiveness, including the value of targeted evidence supplementation, the complementarity between corrective experience and concrete task references, and the dependence of their utility on task requirements and execution context. We build on prior work in success–failure comparison and do not claim to have originated this technique.
Regarding the specific issue of successful-evidence acquisition raised in your comment, VetEx and ExpeL share the use of same-task success–failure comparisons, but differ in how successful evidence is acquired and admitted. ExpeL uses the receiver’s own Reflexion retries to seek successful trajectories. VetEx supplements the receiver’s history with same-task donor successes through a gap-gated admission policy: when a task has an observed receiver success, only receiver successes are used to construct Self pairs; a donor success is admitted to construct a Peer pair only when the receiver has a failure but no observed success on that task in the available history. This makes targeted supplementation of missing successful evidence one concrete mechanism through which we investigate experience effectiveness.
We evaluate successful-evidence acquisition and coverage in Section 4.3 and Appendix C.5 (Tables 12–13), and examine targeted admission through the matched-count random-admission comparison in Section 4.4 and Appendix C.7 (Table 16). These experiments distinguish the value of obtaining external successful evidence from the value of selecting it according to the receiver’s observed evidence gaps. We discuss the acquisition and coverage results in detail in our response to W1-2 below.
W1-2. Insufficient evidence for the claimed distinction.
Thanks for your constructive comment.
We agree that overall comparisons that change multiple components simultaneously cannot adequately establish the specific benefits of filling evidence gaps with external sources. To address this concern, we conducted strictly controlled experiments across three benchmarks and three receiver models, together with an analysis of successful-evidence coverage, to examine both the downstream utility and the complementarity of external evidence. These experiments and analyses have been incorporated into Section 4.3, Figure 5, and Appendix C.5, Tables 12–13 of the revised manuscript.
First, we compare different sources of successful evidence while holding the experience-construction pipeline and downstream configuration fixed. We compare two ways of filling gaps in successful evidence:
- Retry (ExpeL’s native mechanism): Uses ExpeL’s native Reflexion retry mechanism to fill gaps in successful evidence, then generates corrective experience using the same experience-construction pipeline as VetEx.
- VetEx-E: Uses successful trajectories from a prespecified donor to fill gaps in successful evidence and construct corrective experience.
Both arms use exactly the same experience-construction pipeline, experience-extraction model, and downstream evaluation configuration. Both adopt the experience-only setting: only the constructed experience is injected, without task-reference trajectories, downstream Reflexion retries, or online recovery.
Each benchmark–receiver combination was evaluated over three runs. The mean scores are reported below, with differences calculated as VetEx-E minus Retry. Table 12 in Appendix C.5 additionally reports the sample standard deviations.
| Benchmark / Receiver | Retry | VetEx-E | Difference |
|---|---|---|---|
| ALFWorld / DeepSeek-V3.2 | 72.39 | 75.87 | +3.48 |
| ALFWorld / Qwen | 87.06 | 91.30 | +4.24 |
| ALFWorld / GLM | 91.54 | 90.80 | −0.74 |
| WebShop / DeepSeek-V3.2 | 52.60 | 53.66 | +1.06 |
| WebShop / Qwen | 58.28 | 59.54 | +1.26 |
| WebShop / GLM | 56.54 | 60.45 | +3.91 |
| HotpotQA / DeepSeek-V3.2 | 44.00 | 47.67 | +3.67 |
| HotpotQA / Qwen | 43.33 | 45.00 | +1.67 |
| HotpotQA / GLM | 49.33 | 52.33 | +3.00 |
VetEx-E achieves higher mean downstream scores in eight of the nine combinations. This indicates that, under the same experience-construction pipeline and an experience-only evaluation setting, corrective experience constructed from external successful evidence provides greater downstream utility in most settings.
To further investigate whether external sources supply successful evidence that the receiver has not obtained through its own attempts, we measured each method’s coverage of the receiver’s initial gap-task set, deduplicated by task ID. The following results are also reported in Appendix C.5, Table 13:
| Benchmark / Receiver | Initial gap tasks | Donor coverage | ExpeL coverage | Donor-only coverage | ExpeL-only coverage |
|---|---|---|---|---|---|
| ALFWorld / DeepSeek-V3.2 | 41 | 29 (70.7%) | 22 (53.7%) | 9 | 2 |
| ALFWorld / Qwen | 14 | 11 (78.6%) | 9 (64.3%) | 4 | 2 |
| ALFWorld / GLM | 11 | 7 (63.6%) | 5 (45.5%) | 3 | 1 |
| WebShop / DeepSeek-V3.2 | 59 | 14 (23.7%) | 10 (16.9%) | 6 | 2 |
| WebShop / Qwen | 57 | 8 (14.0%) | 6 (10.5%) | 4 | 2 |
| WebShop / GLM | 59 | 10 (16.9%) | 10 (16.9%) | 3 | 3 |
| HotpotQA / DeepSeek-V3.2 | 49 | 17 (34.7%) | 10 (20.4%) | 9 | 2 |
| HotpotQA / Qwen | 52 | 14 (26.9%) | 12 (23.1%) | 8 | 6 |
| HotpotQA / GLM | 44 | 10 (22.7%) | 6 (13.6%) | 6 | 2 |
External sources provide additional positive evidence in all nine combinations. The donor covers more gap tasks than ExpeL in eight combinations and the same number in one. Together, these two supplementary analyses clarify the specific value of external evidence: with the subsequent experience-extraction pipeline held fixed, supplementing trajectories through an external donor yields broader successful-evidence coverage overall and greater downstream utility.
We also observe complementarity between the two approaches. This suggests a valuable direction for further improving our algorithm: combining autonomous reflection with external assistance to achieve more comprehensive experience supplementation at a larger scale. The donor-only and ExpeL-only coverage columns in Table 13 document this complementarity; combining the two acquisition routes remains a direction for future work.