- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper presents HumanoidHarness, an agentic framework for coordinating pretrained policies for humanoid whole-body tasks. Its main components are an editable execution-policy graph, which specifies controller stages, observation checks, and recovery transitions, and an experience-guided revision process that uses execution history and memory to update this graph while keeping the underlying controllers fixed. The framework is evaluated on HumanoidArena and a physical Unitree G1, with experiments examining task completion, execution strategies, and the effect of episode memory.
Critical strengths
Complete system and substantial engineering effort. The paper integrates policy authoring, graph validation and compilation, supervised execution, and experience memory into a working system supporting both simulation and physical deployment.
Technically reasonable approach with experimental support. The overall framework appears technically sound. The experiments across multiple simulated tasks and the hardware demonstrations provide evidence that the system can improve the execution of pretrained controllers.
Critical weaknesses
1. Insufficiently polished writing and unclear presentation
The manuscript gives me the impression of insufficiently revised AI-assisted writing. I do not object to using AI for writing assistance. However, the authors are responsible for ensuring that the paper is logically coherent, precise, and readable. The manuscript frequently introduces notation and terminology without sufficient explanation at the point of use. Examples include:
- (line 168): The notation is introduced without definition.
- Terms such as “editable object” (line 169), “compiler” (line 173), and “bounded segment” (line 174) are introduced without sufficient explanation at first use. The paper should clearly define what the agent can edit, what compilation entails, and what limits govern each execution segment.
- The fourth paragraph of the introduction: The connection between execution recovery, experience-guided policy revision, and the specific research contribution needs a clearer logical progression.
There are many other similar issues. Although subsequent sections explain some aspects of these concerns, their abrupt introduction makes the method unnecessarily difficult to follow. The paper needs substantial revision to introduce concepts in a logical order, define terminology consistently, and explain the actual procedure through concrete examples.
2. Limited methodological novelty and insufficient insight into design choices.
The contribution appears primarily to be an engineering integration of agentic components. The paper does not sufficiently establish what generalizable insight distinguishes this particular combination from existing approaches to agentic robot control. The rationale for the individual design choices is also underdeveloped. It remains unclear why the proposed graph representation, supervision mechanism, and reflection process are necessary, or under what conditions each provides a meaningful advantage over simpler alternatives.
Section 4.4 includes an episode-memory ablation, and Table 2 compares several execution strategies. However, these experiments provide limited isolation of the contributions of individual components and their interactions. More targeted ablations and controlled alternatives are needed to explain which design choices account for the improvements. As presented, the paper demonstrates a functioning implementation more clearly than it establishes a substantive research contribution appropriate for a top-tier AI conference.
Questions for authors
See weakness