- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies whether faster demonstrations can improve robot learning and whether faster deployment necessarily leads to faster or better task completion. It trains VLA and WAM using a mixture of original speed and retimed demonstrations, and argues that the two speeds provide complementary temporal supervision. Specifically, original speed demonstrations preserve intermediate targets, while accelerated demonstrations expose the policy to longer-horizon progress within the same action window. Experiments on CALVIN, BEHAVIOR-1K, LIBERO, and two real-world insertion tasks show that mixed-speed training generally improves completion, sometimes while reducing the number of control steps or task time. However, execution-time action-chunk compression has task-dependent effects, that is, moderate compression can be beneficial, whereas aggressive compression substantially harms success.
Critical strengths
-
The paper studies a practically relevant question in robot IL. Its most useful contribution is the clear separation between training pace, behavior conditioning, and deployment pace, which are often conflated in discussions of robot speed.
-
The evaluation covers multiple model families, simulation benchmarks, and real-world manipulation tasks. Although the results are primarily empirical, the consistent improvement from mixed-speed training across several settings, together with the finding that aggressive execution compression can hurt success, provides useful evidence that training speed and deployment speed should be treated as separate design choices.
Critical weaknesses
-
The major weakness is that the paper does not cleanly establish that the gains come from mixed-speed supervision itself. The accelerated WAM data are generated through replay and filtered to keep only successful episodes, while the physical mixed-speed policies continue training from original-speed checkpoints. Thus, the improvements could be due to success filtering, broader data coverage, or additional training, rather than the proposed complementary temporal supervision.
-
The paper’s main explanation is not actually tested. The claim that original- and accelerated-speed demonstrations provide complementary multi-timescale supervision remains largely a hypothesis, since the paper does not measure gradient interactions or otherwise directly validate this proposed mechanism. Combined with the use of a single training seed, success-conditioned step statistics, and approximate real-world timing, the experiments support an interesting empirical observation but not a strong or well-validated technical contribution.
Questions for authors
-
Can the authors provide a controlled comparison that separates the effect of mixed-speed supervision from success filtering, additional data coverage, and continued training from an original-speed checkpoint?
-
Do the reported gains persist across multiple training seeds, and are the differences statistically significant given that several key comparisons rely on a single seed?
-
Is there any direct evidence that the improvements arise from complementary multi-timescale supervision, such as gradient alignment or other mechanism-level analysis, rather than from ordinary data augmentation or exposure to more successful trajectories?