- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ARC, a reasoning-based fine-tuning recipe for pretrained robot foundation models. The key idea is to introduce action-grounded causal reasoning traces that connect the current state, intended effects, and robot actions. The authors develop an automatic annotation pipeline to generate these traces from existing DROID demonstrations and use the resulting supervision to fine-tune π0.5 and Cosmos3-Nano-Policy.
Critical strengths
ARC achieves substantial improvements on both π0.5 and Cosmos3-Nano-Policy across multiple benchmarks, particularly on reasoning-intensive tasks and underspecified instructions. The real-robot evaluation further demonstrates that these improvements are not limited to simulation. These results provide convincing evidence that reasoning-conditioned control can substantially improve existing robot policies.
The authors introduce an automatic relabeling pipeline that augments existing DROID demonstrations with action-aligned causal reasoning traces. The ability to improve pretrained robot policies using existing data and relatively lightweight fine-tuning makes the approach practical
Critical weaknesses
The idea of using reasoning to improve robotic controal has been explored in prior work like ECoT, however the paper does not compare it with ECoT task success rate. Also the counterfacutual loss for π0.5 to prevent the policy from ignoring reasoning traces is not directly ablated (with and without this objective)
Questions for authors
Could the authors report the performance of π0.5 + ARC with and without the counterfactual objective?
Could the authors report the downstream task success of the ECoT-style fine-tuned baseline already introduced in Figure 2, rather than comparing only attention statistics?
3 comments
Thank you for the detailed response and additional experiments. My concerns are mostly addressed so I raise to weak acceptance
Thank you for taking the time to consider our responses and additional experiments. We are glad that we could address most of your concerns, and we sincerely appreciate your feedback and continued support for our work.
We thank the reviewer for their thoughtful assessment and for recognizing ARC's substantial improvements across simulation and real-world benchmarks. We are encouraged by their appreciation of the action-grounded reasoning formulation and the practical benefits of improving pretrained robot policies using existing demonstrations. We appreciate the two suggestions and have addressed both through additional experiments in the updated manuscript. We summarize the results below.
Q1 and Weakness 1. Ablation of the counterfactual objective
We thank the reviewer for pointing out this missing ablation and apologize for its omission in the original submission. We have now added an explicit ablation of the counterfactual objective for π₀.₅ + ARC in Appendix B.1.1 (Page 22) and reproduce the results here for convenience.
Under the same training and evaluation settings, we obtain the following results across all three instruction settings on RoboLab-120:
As discussed in Section 4.3, the counterfactual objective in Equation (2) is designed to discourage the action expert from ignoring reasoning traces. It introduces contradictory traces during training and penalizes action predictions that remain too close to the demonstrated actions despite the conflicting reasoning. The new ablation directly measures the contribution of this objective to downstream task success and complements the existing analysis of reasoning-token attention and trace-component ablations.
Q2 and Weakness 2. Downstream task success of the ECoT-style baseline
We appreciate this suggestion and agree that reporting downstream success for the ECoT-style baseline introduced in Figure 2 would provide a useful comparison. We have now extended the evaluation to include task success for this baseline and added the results to Appendix C.4.1 (Page 35).
Given the limited rebuttal timeline, we conducted this additional evaluation on a diverse subset of 40 tasks from RoboLab-120. The tasks were selected to cover different manipulation and reasoning requirements, providing a broader comparison across task types. We have included the exact task list and evaluation details in the appendix for transparency and reproducibility.
Importantly, the ECoT-style baseline uses the same π₀.₅ backbone and demonstration dataset as ARC, as described in Section 4.1. This allows us to examine how the choice of reasoning representation influences downstream control while keeping the underlying policy architecture and training data consistent.
On the evaluated subset, we obtain the following task-success results:
These additional results complement Figure 2, which examines how the action expert attends to intermediate reasoning under different supervision formats.