- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces RoboHarn-Evo, a dual-loop intelligent agent framework that enables the improvement of a robot’s operational capabilities through physical interaction, without the need to update the underlying VLM or lower-level actuators. The hierarchical physical knowledge structure employed by this framework includes task knowledge used to guide the selection of subtasks and to evaluate their completion level, as well as action knowledge used to describe the relative geometric relationships between objects and local physical effects. The internal execution loop is responsible for retrieving and applying this knowledge, while the external evolution loop utilizes physical feedback to verify, refine, and maintain this knowledge.
On the RMBench platform, the authors tested RoboHarn-Evo using various VLM models, and they conducted analyses of the effectiveness of knowledge maintenance, experiments on continuous interaction, comparisons across different benchmarks, as well as tests in real-world scenarios. The results show that, with unchanged model parameters, the robot’s task completion rate and performance can be improved through the accumulation of interaction experience over time.
Critical strengths
-
A sound design for the maintenance of hierarchical knowledge. This paper separates the completion of sub-tasks from the actual physical actions performed, and utilizes this distinction to maintain knowledge related to tasks and actions. This design addresses a major issue in long-duration robotic operations: faults and the evidence related to them can occur at different decision levels.
-
A relatively comprehensive empirical evaluation. The authors report that this method results in significant improvements in performance across various visual language model architectures and operational tasks. They also investigated the correction of historical knowledge, the performance gains resulting from continuous interaction, the ability to transfer knowledge across different environments, and the performance in real-world applications. In particular, comparisons using data from the same source provide strong evidence for the effectiveness of the entire knowledge maintenance framework.
Critical weaknesses
This paper addresses a meaningful issue and proposes a framework with a solid theoretical foundation, while also showing improved empirical results. However, the differences between its core methodological contributions and those of existing research are not significant; furthermore, the hierarchical evidence attribution mechanism proposed lacks direct and controllable comparative analysis. As a result, the current evidence is not sufficient to fully support the innovative aspects it presents.
- The concept of hierarchical evolution of physical knowledge does not differ markedly from that of existing research.
Previous studies have explored topics such as hierarchical representation of experience, knowledge updating based on feedback, as well as the verification and reuse of physical knowledge. For example, XSkill separates skills at the task level from experience at the action level; PhysMem investigates how knowledge that has been physically verified can be accumulated; EmbodiSkill distinguishes between skill deficiencies and execution errors.
In particular, the paper does not clarify in what physical interaction scenarios existing methods may incorrectly extract, attribute, or update knowledge at different decision levels. Although Figure 1 illustrates fault conditions at various levels, these examples are not directly linked to the specific limitations of the existing methods.
Therefore, it remains unclear which specific limitations of existing knowledge evolution methods the proposed hierarchical evidence attribution mechanism addresses, and what fundamental technical contributions it offers compared to these existing approaches.
- The hierarchical evidence attribution mechanism proposed has not yet been directly tested, and comparisons with other self-evolving methods are also limited.
The three experimental scenarios listed in Table 2—“only task level,” “only action level,” and “planar reflection”—demonstrate the usefulness of different knowledge levels and their combinations; the knowledge maintenance experiments shown in Figure 4 also highlight the advantages of evidence-based verification methods. Nevertheless, these experiments do not directly prove whether the hierarchical evidence attribution and maintenance mechanism is superior to those knowledge evolution mechanisms based on uniform verification standards.
A more precise experimental design should maintain the same “task+behavior” knowledge representation, information source trajectories, retrieval mechanisms, underlying models, and executors, and then compare the proposed hierarchical verification mechanism with a unified knowledge verifier that can access complete trajectory evidence. This would allow for a more accurate assessment of the actual contributions of each verification mechanism at different levels.
Additionally, the existing external benchmark methods are mainly strategy-based approaches and Harness VLA. Comparisons with methods related to self-evolution of knowledge or skills are still insufficient. The authors should consider incorporating mechanisms such as PhysMem, EmbodiSkill, or others similar to them, or explain why these methods are difficult to apply effectively in the current evaluation environment.
There are also some issues related to cross-references and inconsistent terminology:
- When describing the retrieval and maintenance processes, Section 4.3 refers to Figure 8, whereas the relevant overview should be Figure 3; moreover, Figure 3 is not mentioned anywhere in the main text.
- Appendix E.7 references Section 3.4, which does not exist.
- Appendices E.1 and E.7 use the term “Action-Feedback Knowledge” (AFK), while the main text uses “Hierarchical Physical Knowledge” (HPK). These terms should be consistent, or it is necessary to clarify the relationship between these two concepts.
These issues relate mainly to the way things are presented and to consistency, rather than the two core technical problems mentioned earlier.
Questions for authors
- Compared to XSkill, PhysMem, and EmbodySkill, what specific unsolved problems does the proposed hierarchical physical evidence attribution mechanism address? Can the authors provide a concrete example of a failure case, illustrating how existing methods would incorrectly update knowledge, and how RoboHarn-Evo avoids such errors?
- Can the authors design a controlled experiment in which, while keeping the same task and representation of action-related knowledge, execution trajectories, retrieval mechanisms, and computational resource consumption, the hierarchical evidence verification mechanism is replaced by a unified knowledge verification mechanism? This would help quantify the independent contribution of the hierarchical evidence attribution mechanism.
- Can the authors further explain the rationale behind selecting these external benchmark methods? Additionally, it would be useful to compare them with PhysMem, EmbodySkill, or other methods capable of knowledge evolution or feedback-based skill refinement. If direct comparison is not feasible, please describe the specific differences in their implementation or experimental setup.
- In Appendix A.1, it is mentioned that Appendix D contains detailed information regarding the resources required for knowledge construction, model configurations, and repeated experiments. However, in reality, Appendix D mainly describes the definitions of metrics used for knowledge correction and transfer evaluation. Can the authors provide the relevant experimental configurations and details of the repeated experiments, or at least indicate where such information can be found?