- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces ProSEvo, a framework for the self-evolution of multi-agent systems within a single generative backbone lineage. The method assigns interaction experience to controller and executor roles and retains it through two mechanisms: typed procedural memory and role-specific parameter updates. A frozen same-backbone compiler annotates recorded trajectories, while deterministic validation checks their structure and source evidence. Admitted experience supports memory construction, whereas original positive role outputs from successful trajectories provide supervision for separate student adapters. Through successive rounds of experience collection, memory accumulation, and supervised fine-tuning, ProSEvo improves performance over the base system on OfficeBench, AppWorld, and τ-bench Retail.
Critical strengths
- The framework clearly distinguishes memory consumption from parameter supervision. Procedural knowledge is routed to the role that should use it, while training targets remain associated with the role that originally produced the corresponding output. Together with explicit source and execution checks, this design makes the flow of experience through the learning pipeline relatively transparent and provides a useful framework for studying cumulative agent improvement.
- The evaluation includes multiple benchmarks and informative interventions. The paper reports consistent improvements over the base system and examines memory components, parameter updates, and cumulative experience reuse. In particular, the fixed-checkpoint comparisons between compiled, raw, absent, and role-swapped memory provide useful evidence about how inference-time memory affects performance.
Critical weaknesses
- The benefit of the proposed training-data admission and supervision construction over straightforward successful-trajectory replay is insufficiently established. The paper provides useful memory interventions and carrier ablations. However, Raw-replay SFT is explicitly introduced in Appendix A.3 and Table 9 without corresponding results. This leaves an important gap in assessing the additional value of the training-side filtering and supervision construction. The raw-trajectory retrieval comparison addresses inference-time memory and does not resolve this training-side question.
- The evidence for reducing self-confirmation is indirect. The paper uses self-confirmation risk to motivate ProSEvo, but the experiments do not directly test whether the admission rules reduce incorrect interpretations of past experience. For example, a failure explanation can cite the correct event and still misidentify why the action failed. The validation statistics in Table 26 report structural and source-check failures, without measuring how often incorrect interpretations are accepted or reused in later rounds. The task results are encouraging, but I would be more cautious about attributing these gains to reduced self-confirmation.
Questions for authors
- What evidence beyond structural and provenance validation supports the claim that ProSEvo mitigates semantic self-confirmation?
- Could the authors report the Raw-replay SFT results defined in Table 9? Please specify the inference-time memory condition and which supervision-construction choices change in this comparison, so that its results can be interpreted under the stated matched experience and optimization budgets.
- What specifically differs between the final Full checkpoint evaluated without retrieval in Table 20 and the Parameter-only variant in Table 23?