- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents an agentic framework for long-horizon mobile manipulation. The authors first analyze failures in task planning, navigation, and manipulation. Based on this analysis, they build a framework that combines demonstration-based planning, visual memory, base adjustment, and end-effector correction with a fixed VLA policy. The method improves task success rates from 19% to 47% on RoboCasa365 and from 14% to 37% on five BEHAVIOR-1K tasks. Real-robot experiments also show improvements.
Critical strengths
- Practical and well-designed system framework.
The paper presents a comprehensive agentic framework specifically designed for mobile manipulation. The authors carefully divide the long-horizon task into different stages and design corresponding tools to address their challenges. This requires considerable engineering effort and provides a practical solution for improving mobile manipulation reliability.
- Clear improvements in task success rates.
The proposed framework achieves substantial improvements on RoboCasa365, BEHAVIOR-1K, and real-robot tasks. These results demonstrate the practical value of combining task planning, memory, and geometric adjustment with an existing VLA policy.
Critical weaknesses
- Limited methodological novelty and simplified reachability analysis.
The proposed framework mainly integrates existing and commonly used methods. Its contribution appears to be more about system integration than new algorithmic ideas. In particular, the reachability check, which is important for the transition from navigation to manipulation, relies mainly on the distance between the robot base and the target. However, manipulation reachability also depends on target visibility, available arm workspace, and collision risks. These factors are not sufficiently considered, making the current analysis rather simplified.
- Limited connection between failure diagnosis and online intervention, with insufficient evaluation.
Although failure diagnosis is a central motivation of the paper, the collected failure trajectories are mainly used to identify problems and guide system design. During execution, the framework supports observation-based adjustments and retries, but it does not provide an explicit online failure diagnosis mechanism. This weakens the connection between the stated motivation and the proposed method.
In addition, the evaluation lacks analysis of system latency and computational cost. The experiments on BEHAVIOR-1K are also limited, and the generalization ability of the framework to unseen instructions and tasks remains unclear.
Questions for authors
1.Reachability analysis: Why does the proposed reachability check mainly rely on target distance? Could the authors clarify how factors such as visibility, available arm workspace, and collision risks are handled?
2.Failure diagnosis: Does the proposed framework explicitly diagnose failure types during online execution, or is failure analysis mainly used during system design? How does the agent determine which intervention is needed when a failure occurs?
3.System efficiency: What additional inference latency and computational cost are introduced by the agentic framework? Could the authors provide a comparison of task execution time and computational overhead against conventional VLA methods?
4.Evaluation and generalization: Could the authors provide more extensive experiments on BEHAVIOR-1K? In particular, how well does the framework generalize to unseen instructions in familiar environments or completely unseen tasks? Such results would help establish whether the proposed framework improves general mobile manipulation capabilities rather than performance on a fixed set of tasks.
3 comments
Response to Reviewer 91XX
W2-3 & Q4. BEHAVIOR-1K coverage and generalization. Can the evaluation be expanded to cover more BEHAVIOR-1K tasks? How well does the framework generalize to unseen instructions in familiar environments and to entirely unseen tasks
Thank you for suggesting a broader evaluation. We added five BEHAVIOR-1K tasks, bringing the total from five to ten. Our full system outperformed both baselines on each of the five added tasks.
| Added BEHAVIOR-1K task | End-to-end VLA (π0.5) | Harness VLA | Our full system |
|---|---|---|---|
| Putting Dishes Away After Cleaning | 10% | 20% | 40% |
| Loading the Car | 5% | 15% | 40% |
| Clean Boxing Gloves | 10% | 25% | 45% |
| Tidying Bathroom | 0% | 5% | 35% |
| Sorting Books on Shelf | 5% | 10% | 50% |
| Mean over the five added tasks | 6% | 15% | 42% |
The full system outperformed both baselines on all five additional BEHAVIOR-1K tasks and in the real-robot experiments, as reported in our response to Reviewer oetU's W2 & Q2. This provides evidence that our agentic design transfers beyond the five tasks in the original evaluation, using low-level policies trained on BEHAVIOR-1K data. Limited GPU availability constrained how many additional tasks we could evaluate during the rebuttal period. We would consider adding more tasks in the future.
We believe that our work explores a promising avenue for embodied AI and deserves an opportunity so that we can convey these messages to the community. If the responses above have addressed your concerns, we would be grateful if you could consider raising your score. Thank you for your time and constructive feedback!
I appreciate the author's responses in the rebuttal. Howerver, I still think that the work lacks sufficient novelty. The proposed approach relies on traditional or exsiting methods, with limited new insights or fundamental contributions. I do think agentic system is a certain promising field, and an efficient system with generalizations ability is the goal. So based on this consideration, I keep the score.
Response to Reviewer 91XX
W1-1. Methodological novelty. The framework mainly integrates existing, commonly used methods. Its contribution appears to be system integration rather than new algorithmic ideas.
Please see our response to Reviewer jnBh’s W1 & Q1, where we clarify how our approach and failure analysis extend prior work. More importantly, given that GPT-6-Astra already demonstrates strong capability in embodied tasks, similar agentic frameworks would be promising in the future. Our work provides empirical diagnosis results for this new paradigm which was not offered by prior works. And we hope that these results would guide future design about agentic framework for mobile manipulation.
W1-2 & Q1. Simplified reachability analysis. Why does the reachability check rely mainly on base-to-target distance, and how does it account for target visibility, arm workspace, and collision risk?
Thank you for suggesting a direct comparison with reachability-based and learned base placement. Originally, we used the 0.75/1.00 m distance thresholds as a low-cost way to test whether adjusting the robot’s stance before manipulation could help the same VLA executor. For the follow-up comparison, we evaluated both alternatives on the RoboCasa365 development set used for failure diagnosis, with the same episode seeds as in the original distance-threshold run. The simple inverse kinematics (IK) method checks whether the arm can reach the estimated interaction target from a candidate base pose. The learned method ranks candidate poses using the next subtask and target-relative RGB-D features. Across these matched episodes, five failures were attributed to navigation and base positioning with the original distance thresholds, two with simple IK, and one with learned base placement.
W2-1 & Q2. Does the framework explicitly classify failures during execution or mainly use failure analysis for system design, and how does the agent choose an intervention?
We assign the three failure categories offline by reviewing completed rollouts and identifying the first unrecovered error. This analysis guided the design of the intervention tools. During execution, the VLM planner uses current observations, tool feedback, and episode history to track which subtasks are complete and what remains to be done. When an action fails or the task state changes, the planner revises its plan online. Based on the observed outcome, it can select a recovery tool and retry the current subtask or change what it does next.
W2-2 & Q3. How do inference latency, task execution time, and computational cost compare with conventional VLA methods
On the held-out RoboCasa365 episodes, our full system with GPT-6.1 Sol high achieved 52% success with our original subtask VLA and 56% with Xiaomi Robotics 1 fine-tuned to follow subtask instructions.
We compared three Xiaomi Robotics 1 configurations on the matched episodes. Harness VLA and our full system used the same subtask-adapted checkpoint, the same GPT-6.1 Sol high planner, and a limit of 100 online VLM calls per episode. The end-to-end baseline ran the released checkpoint directly, with zero calls to a separate online VLM.
With the same planner and executor, our full system improved success by 35 percentage points over Harness VLA, reduced mean wall-clock time by 14.4%, and made 31.0% fewer online VLM calls. Compared with the released end-to-end policy, the full system achieved 11 percentage points higher success and took 3.24 times as long per episode.
These results validate that (1) our design works better than Harness VLA, (2) there is still room for optimization to achieve a better success-efficiency trade-off between end-to-end VLA and our system. We believe the latter is promissing as a new paradigm for embodied AI in the near future, in the light of efficient VLM while powerful as GPT-6 models.
We believe that our work explores a promising avenue for embodied AI and deserves an opportunity so that we can convey these messages to the community. If the responses above have addressed your concerns, we would be grateful if you could consider raising your score. Thank you for your time and constructive feedback!