- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies Learning from Demonstrations (LfD) and proposes CRAVE, a training-free offline method for recovering task progress from repeated robot demonstrations. CRAVE combines frozen DINOv3 visual features with robot-state information, applies dimensionality reduction and clustering to identify recurrent configurations across demonstrations, and performs whole-trajectory decoding to obtain a coherent progress estimate. Based on the recovered progress, the method estimates the future progress increment of each state and converts it into ordinal progress conditions (LOW/MIDDLE/HIGH), which are then used to post-train a π0.5 policy.
The key contribution is to use recurrence across repeated demonstrations as an implicit source of progress supervision, avoiding manually annotated task stages or a separately trained reward/value model. The authors validate the recovered progress representation and further evaluate its utility for downstream robot policy learning on several manipulation tasks. On garment folding, CRAVE improves the success rate over plain π0.5 SFT from 50% to 55% with 150 demonstrations and from 55% to 75% with 300 demonstrations, while both methods achieve 80% with 450 demonstrations. The paper also evaluates a low-data writing task with 55 demonstrations, where plain SFT achieves 90% success and CRAVE achieves 84.2%, as well as a nail-painting task where CRAVE provides a modest improvement in stage completion. Overall, the results suggest that CRAVE can recover meaningful task-progress signals from repeated demonstrations and can improve downstream policy performance in some settings, although the improvements over standard SFT are not consistent across all evaluated data regimes and tasks.
Critical strengths
- The paper proposes a simple and training-free offline progress estimation/relabeling method based on repeated demonstrations. The method does not require training an additional reward, value, or advantage model, making it relatively easy to integrate into existing Learning from Demonstrations pipelines.
- The idea of exploiting recurrent configurations across demonstrations to construct a shared progress coordinate is interesting. In particular, the whole-trajectory decoding results provide evidence that the recovered progress signal is more temporally coherent than frame-wise assignment.
Critical weaknesses
- The downstream benefit of CRAVE appears limited and inconsistent. While CRAVE produces a meaningful progress signal, it is unclear whether this signal translates into a practically meaningful improvement in the learned policy. For garment folding, the success rates of BC and CRAVE are 50% vs. 55%, 55% vs. 75%, and 80% vs. 80% at 150, 300, and 450 demonstrations, respectively. Moreover, the reported confidence intervals for the CRAVE-vs.-BC differences all include zero. Therefore, the current evaluation does not provide sufficient statistical evidence to distinguish a consistent CRAVE improvement from rollout-level variation.
- The experiments do not clearly establish the data regime in which CRAVE is beneficial. If the recovered progress signal provides additional useful supervision from an existing demonstration corpus, one might expect its benefit to be particularly visible in some data regimes. However, the low-data writing experiment does not show an advantage: plain π0.5 SFT achieves 18/20 success (90%), whereas Direct CRAVE achieves 16/19 (84.2%). Similarly, the advantage on garment folding disappears at 450 demonstrations. These results make it difficult to determine when the additional CRAVE conditioning is actually useful for downstream policy learning.
- The downstream evaluation is relatively limited for establishing generality. The method is motivated as a generic approach for recovering progress from repeated demonstrations, but the robot experiments cover only a small number of tasks and relatively constrained settings. The nail-painting experiment also shows only a modest improvement (35% vs. 30% mean stage completion). More diverse tasks, particularly tasks with different temporal structures, substantial state aliasing, or multiple valid solution trajectories, would be useful for understanding when the recurrence assumption underlying CRAVE holds and when it fails.
- The robot evaluation has substantial statistical limitations. The experiments use only one trained checkpoint per method and relatively few real-robot rollouts. Therefore, the reported uncertainty mainly captures rollout-level variation rather than variation across training runs. This makes it difficult to distinguish improvements caused by CRAVE from stochasticity introduced during policy training and evaluation.
Questions for authors
- What empirical evidence demonstrates that CRAVE conditioning actually improves downstream policy learning rather than merely producing a reasonable progress representation? The progress-recovery evaluation appears convincing, but the downstream policy improvements are considerably less clear.
- Under what data regime do the authors expect CRAVE to provide the largest benefit? The garment-folding improvement is largest at 300 demonstrations but disappears at 450 demonstrations, while the 55-demonstration writing experiment does not outperform plain SFT. Is there an explanation for this behavior?
- How sensitive is CRAVE to demonstrations containing multiple valid strategies or substantially different trajectories? Since the method relies on recurrent cross-episode configurations to establish a shared progress coordinate, it is unclear how the approach behaves when demonstrations do not share a consistent temporal or state-space structure.
- Could the authors provide results across multiple independently trained policy checkpoints? This would help separate the effect of CRAVE from training variance and make the downstream performance comparison substantially more convincing.