Just follow my concerns in the previous section, here are the more details:
1 very limited scientific novelty and the performance gain is not impressive
(1) My primary concern is the lack of significant scientific novelty, which I consider particularly important for a conference like ICLR.
- The proposed approach largely combines existing techniques, including the MoE architecture, flow-matching-based image generation, and hierarchical subgoal planning. The overall architecture and training recipe appear to be relatively straightforward combinations of existing techniques.
(2) Even these contribution can be considered as "novel", the results are not convicing though!
- considering the large scale of data collection, engineering, and computational resources invested, I would expect a more convincing demonstration of long-horizon manipulation capabilities.
- But the experiments primarily involve nine RMBench tasks, joint-planning trajectories of up to five (correct me if I am wrong) steps in the reported benchmark, and three real-world manipulation tasks which seems quite simple does not show "long" horizon task planning rather than simply 3~5 sub tasks.
- Therefore, these evaluations do not sufficiently demonstrate that the proposed method can address substantially more challenging long-horizon problems involving complex dependencies, dynamic environments, and unexpected execution failures.
And, the empirical results are not consistently compelling:
- Limited improvement in real-world action generation: RxBrain achieves 87% average success compared with 82% for π0.5, across only three real-world tasks. This five-percentage-point improvement is relatively modest considering the scale of the proposed model and training effort. It is also unclear whether the difference is robust across a broader range of tasks.
- On RMBench, several tasks remain challenging, including Blocks Ranking Try (27%), Battery Try (36%), and Press Button (0%). These results raise questions about the if the proposed model can work reliably for any tasks.
- Overall, these exp results, seem to me, is just saying proving joint text–image subgoals to a downstream policy can improve performance, but does not necessarily establish the pros of the proposed unified planning architecture.
(3) weak baselines comparison
Another major concern is the choice of experimental baselines.
- The paper aims to address long-horizon manipulation through subgoal planning. However, there are alternative approaches to this problem, particularly modular agentic AI systems that combine pretrained vision-language models, task decomposition, environment feedback, and closed-loop replanning.
- These systems may achieve similar long-horizon planning capabilities without requiring a dedicated foundation model trained on tens of millions of embodied planning segments.
- The authors do include Qwen-Agent and Cosmos-3-Nano agent baselines in their joint-planning benchmark, which I appreciate. They do not investigate how such agentic approaches would perform when integrated with the same downstream VLA policy.
- A more informative experiment would compare RxBrain against a modular agentic planner connected to the same VLA policy.
- Given the significant resources invested in RxBrain, I believe this comparison is important. Without it, the paper does not convincingly establish whether its proposed unified architecture is a better solution than existing modular approaches.
(4) failed to address more fundamental challenge in long-horizon robotic task planning.
This part is more of my personal thoughts, and does not affect my rating
In robotics research, regarding sub-goal planning, we know the limits of textual sub-goals and image based sub-goals, simply because the assumption that "manipulation tasks can be decomposed into textual subgoals and corresponding visual goal states" does not establish in many more general robotic tasks, for example, thoese involve contact dynamics, force control, partial observability, and continuous interaction, which may not be adequately represented by textual instructions or goal images alone.
This raises several fundamental questions: When are language–visual subgoals sufficient for manipulation? When do they become inadequate? How should the system represent subgoals involving forces, contacts, or partially observable physical states?
For any researcher in this field, should understand this limitations. But I did not find any discussion about this limitation.
I would have appreciated a deeper investigation of these limitations.
(5) it's terrible to read the related works section
I also feel the related-works section is somewhat superficial. The paper mostly summarizes what previous methods do, without sufficiently analyzing how they relate to the proposed contributions or identifying the specific scientific gaps that RxBrain addresses. For example, BagelVLA and π0.7 have already explored closely related ideas involving language-based task decomposition, visual-state prediction, and long-horizon manipulation. Although the authors cite these works, the discussion does not clearly explain what fundamental problem remains unsolved by these approaches or how RxBrain advances beyond them.
(6) lastly, it's still a good work for the research community, I want to provide some encouragements to the authors
This is a well-written paper. I could imaging huge amount of engineering work and compute invested in this project. The community will definitely learn from their exp configuraitons. I particularely appreciate the authors listed the detailed dataset consctruciton, how they mixture these datasets.
Given the high standard of ICLR, I will give more chance to other papers that truely can advance our understanding of these foundation models.