- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes HiMeco, a self-evolving embodied agent that combines perception–exploration–planning (PEP) failure diagnosis with two forms of external memory: a strategy bank and a library of executable skills. After each interaction round, HiMeco uses execution traces, task outcomes, and diagnostic feedback to identify failure causes, consolidate reusable strategies, abstract parameterized skills, and validate them through later executions. The VLM parameters remain frozen throughout evolution. Experiments on ESI-Bench and EmbSpatial-Bench report substantial improvements over active VLM baselines.
Critical strengths
1.The paper addresses an important issue in self-evolving embodied agents: failed interaction alone does not reveal whether the underlying problem comes from perception, exploration, or planning. Explicitly separating these failure sources is a reasonable and potentially useful direction.
2.The framework is well structured. Strategy consolidation, skill abstraction, evidence contracts, and execution-based skill validation form a coherent evolution pipeline, rather than simply storing successful trajectories in memory.
3.The reported performance gains are substantial. On the selected ESI-Bench episodes, HiMeco improves GPT-5.6 from 56.89% to 69.19% and Gemini-3-Flash from 54.74% to 62.51%. The paper also provides component ablations and detailed implementation information.
Critical weaknesses
1.The main evaluation repeatedly adapts on the same ESI-Bench episodes, making it difficult to separate genuine generalization from instance-specific adaptation. The cross-episode transfer evidence is mainly qualitative.
2.The PEP diagnosis relies on privileged retrospective information, including simulator metadata and benchmark correctness. This limits the applicability of the proposed evolution mechanism in realistic settings where such supervision is unavailable.
3.The SOTA comparison is not fully controlled because different methods are evaluated on different episode subsets or sample counts. This weakens the strength of the benchmark-level claim.
4.The ablation study covers only a subset of tasks and does not fully disentangle the contributions of diagnosis, strategy memory, skill evolution, and evidence validation.
5.The “brain-inspired” framing is stronger than the technical evidence. The implemented mechanisms largely resemble structured reflection, external memory, and skill consolidation, while the biological analogy is mainly motivational.
Questions for authors
Clarification requests
-
Can the authors clarify whether the main ESI-Bench results measure generalization or repeated-instance adaptation, given that the same episodes are revisited across evolution rounds?
-
Which parts of the PEP diagnosis require privileged simulator metadata or benchmark correctness, and how much of the method would remain applicable without this information?
-
How should the SOTA comparison be interpreted when some methods are evaluated on different episode subsets or sample counts?
-
Do the component-ablation conclusions hold across all nine ESI-Bench tasks, or only the four tasks reported in Table 2?
Suggestions for future work
None. My current concerns are primarily about clarification and evaluation validity rather than missing future extensions.