- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper primarily explores and investigates the feasibility of guiding agents to reflect on and adjust their beliefs in real-time based on exploration and testing results, within the context of recursive self-optimization. I think the main contribution of this paper is MESH, a unified framework where beliefs guide candidate generation and search outcomes recursively revise beliefs. MESH is evaluated on 11 MLGym tasks and 8 MLE-bench competitions against baselines (Linear, MCTS, AIRA, MLEvolve, AB-MCTS-A). It outperforms them on most tasks, demonstrating its superiority.
Critical strengths
The proposed MESH framework unifies high-level beliefs with low-level search into a single paradigm, offering a novel optimization approach for recursive self-optimization in agents and opening a new avenue for this research direction. It moves beyond traditional static prompt engineering and isolated search methods, providing a principled and dynamic foundation for agent self-improvement.
Critical weaknesses
-
The evaluation is restricted to 19 tasks from MLGym and MLE-bench, which are all fundamentally confined to machine learning engineering, code generation, and simple game-theoretic simulations. While the paper claims to propose a general recursive self-optimization paradigm, the framework is not tested on broader agentic domains such as web navigation (e.g., WebArena), operating system interaction, complex tool orchestration, or multi-agent collaboration.
-
It remains unclear whether the belief revision mechanism can generalize to domains with sparse, subjective, or multimodal feedback (e.g., user satisfaction or physical world interactions), which are fundamentally different from the numeric metrics (accuracy, R², reward) used in these 19 tasks.
Questions for authors
- Regarding the initialization and prompt design of beliefs: Section 4.3 mentions that slots start empty and the first revision forms the initial beliefs from the outcomes of the first ν executions. Could the authors provide details on the exact prompt template used by the high-level agent U to generate these beliefs? How is the LLM guided to distinguish between mechanism (m), directive (δ), and expected outcome (e) without any prior examples?
- Regarding hyper-parameter sensitivity: The framework introduces several critical hyper-parameters: the number of belief slots K, the revision interval v, and the bounded commitment length L. The paper does not specify how these were chosen. How sensitive is MESH's performance to these hyperparameters? For instance, what happens if v is too small (frequent revisions without enough evidence) or too large (stale beliefs)?