- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This research studies the self-evolution of LLM agents from a population-level perspective, shifting the focus from the entire agent to the collective dynamics of plugin-version instances. Inspired by kinetic theory, the authors draw on four architectural properties of DeepSeek Harness (permutation symmetry, reversibility, acyclicity, and typed contracts) to motivate modeling plugin-version instances as identical hard spheres. Based on this analogy, they formulate a kinetic equation with four operators: collision, reaction, external field, and a validation gate that selectively accepts updates. The authors claim three theoretical results: a hitting-time certificate for performance improvement, a resolution law relating validation budgets to detectable improvements, and a separation theorem concerning the independence of the evaluator from the evolving population. Experiments on a simplified WebShop-based system examine the predicted fluctuation scaling and non-equilibrium steady-state behavior.
Critical strengths
-
This paper takes an unconventional yet interesting perspective on self-evolving LLM agents, drawing on kinetic theory to study how a population of plugin instances evolves through repeated updates and validation. I appreciate the authors’ effort to develop a theoretical account of this process, as I believe a solid theoretical foundation could help the community better understand the mechanisms underlying agent self-evolution.
-
This paper acknowledges the limitations of its physical analogy and reports experimental findings even when some of them do not support the proposed predictions. The authors also provide experimental records, document corrections to earlier experiments, and describe their efforts to formally verify parts of the theoretical analysis.
Critical weaknesses
-
This manuscript suffers from considerable writing and presentation issues. It is often difficult to follow due to awkward phrasing, abrupt transitions, and insufficiently explained connections between key arguments. The authors should carefully revise the manuscript to improve its clarity and readability.
-
The applicability of the proposed kinetic model to plugin population dynamics remains insufficiently justified. The authors do discuss the similarities between plugin properties and hard spheres in Appendix D and acknowledge the dependencies introduced by shared experience in Appendix F.4. However, these structural similarities alone do not fully explain why the proposed kinetic model would apply to the evolution of plugin populations. In particular, it remains unclear whether the assumptions behind the mean-field approximation hold when plugin instances interact through a shared experience database. I regard this as a fundamental concern, since the paper's central kinetic-theory claims depend on the validity of this modeling assumption.
-
The experiments do not sufficiently validate the interaction mechanisms proposed by the kinetic model. Although the authors acknowledge the limitations of their minimal WebShop-based system, representing plugins with only four tunable parameters leaves a considerable gap between the experimental setting and realistic self-evolving agents. More importantly, the main fluctuation-scaling and NESS experiments use only one plugin per episode, while the proposed theory defines collision through the co-activation of plugin instances. The authors include a separate fan-3 experiment, but it remains unclear whether the observed improvement comes from plugin interactions or simply from having more candidates to choose from. I would like to see stronger evidence connecting the predicted statistical patterns to the interaction mechanisms described by the kinetic model.
-
The reported statistical patterns do not provide sufficiently convincing evidence for the proposed kinetic theory. The fluctuation scaling observed under higher edit density is based on only three population sizes with two seeds each. More Importantly, the predicted N^(-1/2) scaling is also a common statistical property under suitable averaging assumptions, making it unclear what this result specifically tells us about the proposed kinetic model. Similarly, the observed performance plateau is interpreted as relaxation toward a non-equilibrium steady state, but it is confused whether this alone establishes stationarity of the plugin population. I would appreciate stronger evidence that these observations are specifically explained by the proposed kinetic theory, perhaps through comparisons with simpler statistical models.
Questions for authors
My main concerns are discussed in the Weaknesses section. I have a few additional questions below:
-
The hitting-time analysis appears to assume that improving edits remain available until the target is reached. However, an agent may reach a capability ceiling under the bounded-edit setting, where no further improving edit is available. Could the authors clarify the practical significance of this guarantee in such cases?
-
Regarding the collision experiment (Figure 8): The performance gap between fan-3 and fan-1 appears to be almost identical before and after evolution, with both settings achieving similar improvements during training. How do the authors distinguish the benefit of plugin co-activation during execution from its actual contribution to the self-evolution process?
-
Regarding the density-dependent fluctuation scaling (Section 5.2): The sparse and dense settings differ not only in edit budget, but also in training duration and the population sizes used for fitting. How can the authors determine whether the observed scaling difference is driven by edit density rather than these other factors?