- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RAFT, a post-training framework to improve the robustness of generalist VLAs when adapting to nominal tasks. RAFT is a two-stage post-training method. Specifically, in Stage 1, RAFT freezes the pretrained model and trains LoRA adapters, with the goal of mimicking reasoning annotations generated by a proprietary VLM. In Stage 2, RAFT freezes the LoRA adapters and fine-tunes the VLM backbone and action head under the SFT paradigm. Experimental results on both simulated and physical robot platforms show that RAFT can outperform existing methods.
As 'Questions For Authors' is for some Q's that answer can 'materially affect your assessment', I might just leave some of my suggestions here.
- The authors argue that "reasoning supervision has not been studied" in the context of low-data VLA post-training. However, I would like to point out that "not having been studied" is not a sufficient motivation. There could be many things in the world that have not been studied; some are valuable, while others are not. To make the paper better motivated, I would suggest that the authors focus on why reasoning supervision is particularly valuable for robust VLA adaptation, rather than simply highlighting a gap in the literature.
Meanwhile, I would like to point out that ECoT-Lite shares a very similar idea with RAFT, particularly in its reasoning pre-training strategy, which separates reasoning supervision from subsequent action training. The authors should better clarify the novelty of RAFT over this existing work, particularly the contribution of freezing reasoning adapters during action fine-tuning.
Chen, William, et al. "Training Strategies for Efficient Embodied Reasoning." Proceedings of the Conference on Robot Learning (CoRL), 2025.
Critical strengths
Good empirical performance, particularly on physical robot platforms.
Critical weaknesses
-
Distilling knowledge from a strong proprietary model and aligning the policy through supervised fine-tuning are strategies that have been widely explored over the past few years. Although RAFT introduces a two-stage training strategy with complementary parameter freezing, the paper does not sufficiently establish why this particular design leads to better robustness, beyond the empirical improvements.
-
As shown in Figure 6, RAFT achieves higher success rates under several OOD conditions than under the corresponding ID condition. Performing better on OOD than on ID is counterintuitive and needs analysis. In the menahwile, RAFT is proposed to address the low-data adaptation problem, as shown in Figure 11 (right). However, RAFT performs similarly to Plain FT when only 25% of the demonstrations are provided, with relatively modest gains at intermediate demonstration budgets.
Questions for authors
- Further analysis is required for why RAFT perform better on OOD than on ID. Is it a data issue, a setting issue, or some hidden gem to be explored in the algorithm
13 comments
Why OOD success can exceed ID success (Fig. 6)
"Further analysis is required for why RAFT perform better on OOD than on ID. Is it a data issue, a setting issue, or some hidden gem to be explored in the algorithm"
It is mainly a property of the evaluation design, and the same analysis shows where RAFT's gain comes from.
1. ID episodes probe the edge of the demonstrated distribution; OOD episodes probe interpolation under shift. ID episodes place objects at the periphery of the placement region, the hardest positions represented in the demonstrations. The OOD conditions ask a different question: when appearance, objects, clutter or pose change, can the policy still act within the motions it was trained on? They therefore use unseen configurations inside the demonstrated range. We will add the start-position distributions for both robots to the revision.
2. This test is what separates the methods. On identical episodes, the baselines fail once the scene changes: Plain FT falls from 60% ID to 28% OOD on DROID, and the baselines succeed in 13–33% of YAM OOD-pose trials, against 70% for RAFT. Their remaining successes concentrate on the red toy, one of the novel-colour objects shown in Fig. 20:
- DROID OOD-object: the fine-tuned baselines (Plain FT, RETAIN, DeLock) succeed in 50–88% of red-toy trials but only 13–25% of trials with other colours; RAFT reaches 100% and 75%.
- YAM (clutter, pose and background pooled): the baselines succeed in 41–52% of red-toy trials and 18–25% with other colours, a gap of 23–27 points; RAFT's gap is 9 points (73% vs. 64%).
- When the red toy is not the target, the baselines collapse: 23–30% on the YAM colour shift (RAFT 80%), and 17–33% on DROID OOD-distractor, where the red toy appears only as a distractor (RAFT 75%).
RAFT follows the instruction across colours and copes with unseen configurations; the baselines largely succeed only when the target is the red toy.
- The remaining ID–OOD difference is within evaluation noise. On DROID, RAFT's ID success is 19/30 (63%; 95% Wilson interval 45.5–78.1%) and its OOD-object success 20/24 (83%; 64.1–93.3%); the intervals overlap. OOD success above ID success has also been reported in prior VLA post-training work (Yadav et al., 2026). We will add this discussion and the intervals to the revision.
(Yadav et al., 2026) Robust Fine-tuning of Vision-Language-Action Robot Policies via Parameter Merging
Low-data budgets (Fig. 11)
"RAFT performs similarly to Plain FT when only 25% of the demonstrations are provided, with relatively modest gains at intermediate demonstration budgets."
With roughly 25% of the demonstrations, the two methods tie (49 of 106 ID successes each); at that budget neither policy has learned the task, and many required motions lie outside the demonstrated range. From there RAFT's lead grows with data: about 2 points at roughly 50% of the demonstrations, and 101 vs. 96 of 106 ID episodes (+4.7 points) with all demonstrations, so RAFT makes better use of additional data.
Overview
Thank you for the review and for the pointer to ECoT-Lite! We start with the question you marked as material to your assessment, why RAFT can score higher OOD than ID, and answer it with new data: object start positions, per-colour success on both robots, and confidence intervals. We then address the low-data budgets in Fig. 11, and finally the motivation, why the design improves robustness, and the relation to ECoT-Lite. Details follow below.
Please let us know if there are additional questions we could address.