- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work introduces OmniBrain-0, a framework designed to solve embodied manipulation, navigation, and combined tasks more efficiently. It incorporates a specialized training method to distill a VLM into a more deployable model. The system is evaluated on benchmarks for manipulation, navigation, and combined tasks, demonstrating its performance across all these benchmarks.
Critical strengths
- The work develops a relatively comprehensive execution system and evaluates it across a range of benchmarks.
- The experimental results demonstrate performance improvements over several end-to-end baselines on the evaluated benchmarks.
- The work designs a VLM training pipeline and conducts corresponding ablation studies to demonstrate the effectiveness of the training approach.
Critical weaknesses
- Videos of the real-world robot experiments and more specific quantitative metrics are missing.
- The performance gains over conventional methods appear to come primarily from the agentic framework, given the substantially higher performance achieved when using GPT 5.6 sol. Should the contribution of this framework to the performance gains also be analyzed?
- GPT-6-Astra has demonstrated substantially stronger overall capabilities than other models on embodied intelligence tasks. Comparisons and analyses involving GPT-6-Astra should be included to establish a more reliable performance upper bound.
- The paper’s main technical contribution appears to lie in distillation from closed-source models. Should the experiments therefore focus more on comparing different distillation approaches, including simpler and more direct methods?
- Some minor comments: All figures should use vector graphics so that their contents can be selected. Both the text and the figures should clarify which existing approaches are most relevant for comparison with the proposed method: different agentic architectures or different distillation methods. The performance gains and the effectiveness of distillation should be examined more thoroughly through these comparisons, rather than only through comparisons with existing end-to-end approaches.
Questions for authors
- Provide more detailed information and results from the real-world robot experiments.
- Conduct more fine-grained ablation studies of the agentic design to identify the specific reasons for the substantial gains from introducing GPT 5.6 sol. Further explain how distillation enables a smaller open-source model to approach the performance gains achieved with the closed-source model.
- Include corresponding experiments with GPT-6-Astra.
- Compare different distillation methods to demonstrate the effectiveness of the proposed approach, rather than only comparing against a setting without distillation.
Q1&W1. Real-World Robot Experiments.
We thank the reviewer for the suggestion and provide additional implementation and quantitative details. Our real-world system uses a Piper-X arm with ROS 2, OpenPI's π0.5 low-level VLA fine-tuned on 2,692 demonstrations spanning 113 pick-and-place tasks. π0.5 and OmniBrain-0 run as separate inference servers on NVIDIA RTX 4090 and H20 GPUs, respectively. We evaluate block stacking, apple placement, and drawer opening, with 20 independent trials per task (60 per method), with success determined by completion within the allotted execution budget.
Success rates for OmniBrain-0 are 75%/60%/85%, versus π0.5 at 50%/40%/85% and GPT-5.6-Sol at 90%/75%/95%, respectively. Mean execution time across real-world tasks is:
OmniBrain-0 improves upon π0.5 by 25 and 20 percentage points on block stacking and apple placement, respectively, while matching its success on drawer opening. Although GPT-5.6-Sol achieves higher success rates, OmniBrain-0 executes tasks approximately 4.5× faster, demonstrating a favorable performance–efficiency trade-off in real-world manipulation. We will add setup details, timings, and demonstration videos to the supplement.
Q2&W2. Agentic Framework Contributions and Knowledge Distillation.
We clarify the gains of the agentic framework from three complementary perspectives. First, comparison with end-to-end VLA baselines captures the contribution of the agentic execution paradigm: high-level reasoning coordinates low-level VLA skills via structured tool calls, supporting more flexible execution of complex embodied tasks. Second, comparisons between GPT-5.6-Sol and GLM demonstrate that stronger foundation models can further improve performance under the same agentic framework. Third, we quantify the contribution of experience augmentation through an Experience Library ablation:
Success rates (%). Access to the Experience Library raises success by 27.7, 6.8, and 26.4 percentage points, respectively. Together, these comparisons attribute gains to the agentic framework, backbone capabilities, and experience augmentation.
Regarding distillation, we do not aim to reproduce the teacher's general reasoning or broad world knowledge. Instead, we transfer task-specific decisions demonstrated in embodied interactions: task decomposition, skill selection, tool invocation, observation-based reasoning, and feedback-driven correction. This focus helps our smaller student learn embodied capabilities. Rather than training on raw teacher interactions, our pipeline uses Normalization, Quality Control, Reasoning Reconstruction, and Consistency Validation. These steps turn trajectories into consistent supervision, reducing noise and ambiguity in reasoning and tool-use patterns. Progressive Training and MOPD consolidate this knowledge across manipulation and navigation within a unified 9B decision model.
Q3&W3. Regarding GPT-6-Astra Evaluation.
To further evaluate the performance potential and generalizability of our framework, we conducted additional experiments with GPT-6-Astra across all four benchmarks. The results are summarized below.
Overall success rates (%).
Compared with GPT-5.6-Sol, GPT-6-Astra improves performance by 7.6, 1.8, 6.2, and 4.0 percentage points on LIBERO-Pro, RoboTwin 2.0, RoboCasa365, and R2R-CE, respectively. Our primary goal is to distill proprietary models' embodied capabilities into compact open-source models, narrowing their performance gap. Our framework can accommodate stronger teachers such as GPT-6-Astra, potentially further improving the capabilities of the distilled student model. We will provide corresponding distillation results in future work.
Q4&W4. Effectiveness of Progressive Training and MOPD.
We added a Joint SFT baseline that directly combines manipulation and navigation expert trajectories to train a single model, without our progressive training and MOPD consolidation:
Success rates (%); these consistent gains in both domains indicate that improvements cannot be attributed merely to using a stronger teacher. The progressive strategy first develops domain-specialized decision capabilities, after which MOPD consolidates them into a shared policy; this produces more effective cross-domain integration than straightforward joint supervised fine-tuning.