- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
Summary
This paper proposes Speed on Demand, which accelerates imitation policies by compensating for frequency-dependent tracking errors. A neural dynamics model trained on play data predicts reached joint positions. The pretrained policy is fine-tuned through this frozen model to match demonstrated positions rather than commands. A speedup factor conditions the policy for execution at different frequencies. Experiments cover three manipulation tasks on two robot platforms. The method achieves 80% success at five times the demonstration frequency on CRANE-X7. Results on FR3 are mixed: mug hanging improves over direct acceleration, while high-frequency cup insertion suffers from overcompensation and reduced task success rates.
Critical strengths
Strengths
- The central idea is straightforward: use a learned dynamics model to directly fine-tune a pretrained policy to compensate for frequency-dependent tracking errors.
Critical weaknesses
Weaknesses
1. The added value and scope of the methodological contribution need to be better established.
My understanding is that the main methodological novelty lies in using a learned dynamics model to directly fine-tune the policy for different execution frequencies. Compared with SAIL's execution-side mechanisms, this provides a conceptually more straightforward approach. However, this simplification introduces a dependence on the dynamics model's accuracy, particularly for the compensating commands generated during policy fine-tuning. I am concerned that model mismatch could substantially restrict the method's applicability.
2. Important baseline comparisons are missing.
-
Methods with access to online interaction data. The proposed method collects additional robot interaction data to train its dynamics model. It should therefore also be compared with methods that leverage online interaction, rather than only direct acceleration and gain adjustment. For example, SpeedTuning uses RL to learn an execution-speed policy on top of a base manipulation policy. What advantages does the proposed approach offer over such alternatives under comparable interaction budgets, accounting for differences in supervision requirements?
-
A representative comparison with SAIL. SAIL is not simply a high-gain controller baseline. If the DiT High-Gain's base policy is only outputting the commanded pos and force the robot to stay closer to the commanded pos, the failure is obvious, which is also stated in SAIL's appendix. Comparing only against DiT High-Gain does not sufficiently establish the benefit of dynamics-model-based policy fine-tuning over SAIL, which the authors identify as the closest related method. A direct comparison is needed to clarify their respective benefits and limitations.
-
A simple baseline is missing to assess whether the forward dynamics model is necessary. The current baselines—direct acceleration and increased controller gain—do not sufficiently isolate the benefit of the proposed forward-model-based policy fine-tuning. A straightforward alternative would be a two-stage approach: first train a policy to predict desired reached positions, then freeze this policy and train a separate frequency-conditioned module to convert these targets, together with recent joint-state history, into commanded positions. This conversion module could be trained directly on the same multi-frequency interaction data.
- Although this alternative would still learn an inverse mapping, it would not require a separate forward dynamics model or backpropagation through that model to update the task policy. Comparing these approaches under the same data budget would help determine whether the proposed fine-tuning mechanism provides additional value over separating task prediction from execution compensation. Without this comparison, it remains unclear whether the reported improvements require the proposed forward-model-based approach.
Questions for authors
See weaknesses