- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PolicyGround addresses recovery from high-level failures in frozen hierarchical vision-language-action systems. It separates identifying the remaining task objective from constructing an instruction that the particular target policy can execute. Its central mechanism, Chain-of-Probe, alternates high-level subtask prediction and low-level action queries, using observations retrieved from the failed episode as proxy contexts for subsequent queries. A frozen multimodal supervisor evaluates these responses and revises the recovery instruction before a single recovery execution is committed.
The paper introduces RoboMME-FR, a recovery protocol covering ten history-dependent simulation tasks. Across 273 failures from 500 nominal episodes, PolicyGround increases recovery success from 7.7% to 23.4% and end-to-end success from 49.6% to 58.2% relative to direct semantic recovery. The evaluation includes feedback-channel ablations, revision-depth analysis, latency measurements, and a human-instruction reference.
Critical strengths
- A useful recovery interface with a concrete mechanism for obtaining policy-specific feedback.
The paper targets an important deployment constraint: improving recovery without retraining the target hierarchy, accessing its internal representations, or physically testing multiple candidate instructions. Reusing failed-episode contexts to continue black-box policy queries is a distinctive design within this setting. Figure 5 provides an informative example: an instruction names the correct target but produces ineffective low-level behavior, while feedback-driven insertion of a release prerequisite enables recovery. This demonstrates why inspecting the target policy can be useful beyond identifying a semantically correct goal. The authors also explicitly acknowledge that the resulting proxy response is neither a dynamics model nor a physical-feasibility guarantee.
- A meaningful empirical improvement under a reasonably controlled recovery protocol.
The principal comparison uses identical saved failure states, the same context-reset interface, and the same recovery horizon. Table 1 corresponds to 21 successful recoveries for semantic recovery and 64 for PolicyGround: an additional 43 successes, with improvements on eight tasks and ties on two. This is a substantive result. The denominator includes all 273 failures, including five episodes without an initial candidate. The human reference is constructed before execution and is appropriately described as an empirical reference rather than a theoretical upper bound. The paper also reports unfavorable findings, including the stronger recovery rate of low-level-only feedback and the small benefit of additional revision.
Critical weaknesses
- The experiments do not isolate the contribution of the central multi-step probing mechanism.
The automatic baseline directly executes the initial semantic instruction, whereas PolicyGround adds policy queries, supervisor evaluations, instruction revision, and candidate selection. Consequently, the main result establishes the effectiveness of the complete pipeline but does not determine which additions are necessary.
The feedback ablations in Tables 2 and 8 do not resolve this: they change the feedback supplied to the reviser and the selection score, rather than directly removing proxy-context chaining. The paper lacks both a budget-matched semantic self-refinement baseline without policy feedback and a first-step or fixed-context probing baseline. These are particularly consequential controls because the claimed methodological advance is obtaining useful multi-step evidence before execution.
Table 10 shows that one policy-guided revision already achieves 22.7% recovery, compared with 23.4% for full search—only two additional successful episodes. This does not establish that one-step probing is sufficient, since revision depth and probe depth are different quantities. It does, however, leave the value of the more elaborate search and chaining components unresolved. Establishing a clear advantage over these simpler controls is central to assessing the contribution.
- The reliability of the proxy evidence and the interpretation of the mechanism are insufficiently validated.
Appendix B.2 retrieves historical observations by matching the gripper’s open/closed state and finding the nearest recorded end-effector position within 50 mm. This does not check whether the robot is holding the same object, whether objects occupy the same locations, or whether the task has reached the same stage. Consequently, a retrieved observation may match the robot’s pose while depicting a different task state. This matters because subsequent policy queries depend on that observation.
When retrieval fails, the method can still query the high-level policy using the last available context, which may not reflect completion of the preceding action. The low-level evaluator also permits favorable scores for incomplete predicted motions. For example, Figure 5 shows a revised pickup whose predicted trajectory ends before the grasp, while the aggregate low-level score is 0.95. Such feedback may identify a promising action, but it does not establish that the full action can be completed. The paper should report how often retrieval yields relevant continuations, how frequently probes end prematurely, and whether the additional responses obtained through chaining help identify candidates that succeed during actual execution.
The HA results provide only limited evidence about the source of the improvement. Appendix D.4 counts a sequence as aligned if it contains a nonempty correct prefix of the required checkpoints, even when later steps are missing. It also excludes some preparatory actions. Thus, adding a necessary put-down step could improve recovery without changing HA. The nearly unchanged HA cannot identify which aspects of instruction sequencing or execution account for the gain. Similarly, the human reference’s 95.2% HA and 30.8% recovery suggest a substantial gap between checkpoint alignment and successful completion, but do not establish how much of that gap comes from low-level execution. These concerns limit the mechanistic interpretation.
- The absence of real-robot experiments leaves the framework’s practical effectiveness unverified, particularly whether recovery instructions selected through historical proxy contexts remain effective under real-world perception errors, contact uncertainty, and discrepancies between predicted and executed actions.
Questions for authors
Under the same supervisor, failed-episode evidence, interface description, initial candidate, and candidate budget, how does PolicyGround compare with semantic self-refinement without policy feedback? Please report supervisor calls or token usage so that the additional reasoning budget is visible.
How does full Chain-of-Probe compare with querying only the first high-level subtask and low-level action chunk, and with probing while keeping the failure observation fixed? For the full chain, can you report retrieval/truncation statistics and an offline comparison between proxy feedback and actual candidate execution outcomes?
Among HA-aligned but unsuccessful episodes, how many contain a complete correct high-level plan, and how many contain only a correct prefix followed by omission or termination? Does the claimed downstream-execution explanation remain supported after separating these cases?
Are there any real-world experiments that validate your method beyond simulation?
Response to Reviewer LNsN
Thank you for the detailed and constructive review, and for recognizing both the recovery interface and the controlled evaluation protocol. Your summary of the main result (21 -> 64 successful recoveries) is correct.
W1 (isolating multi-step probing). We agree. Our experiments establish the effectiveness of the full pipeline but do not isolate proxy-context chaining. As you note, revision depth and probe depth are different quantities, so Table 10 does not show that chaining is necessary. A budget-matched self-refinement baseline and first-step / fixed-context probing are the right controls, and we will add them in a future revision.
W2 (reliability of proxy evidence). We agree that pose-and-gripper retrieval can return a context depicting a different task state. Sec. 3.3 states that the proxy response is neither a dynamics estimate nor a feasibility guarantee. The low-level evaluator scores truncated chains on their observed prefix only, so that the hop budget is not penalized. We agree this can be optimistic, as in Fig. 5. On HA, we agree with your characterization: prefix-based alignment cannot attribute the gain to downstream execution. We will soften the statement that the gain "primarily reflects improved compatibility with downstream execution."
W3 (real robot). We acknowledge the absence of real-robot experiments and will state this limitation explicitly.