- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SkillReasoner learns goal-conditioned contact-rich manipulation from unstructured play without task-specific demonstrations. It combines discrete varying-horizon skills spanning 1 to 20 steps with state encoding, keypoint grounding, duration prediction, skill proposals, latent dynamics, and goal-conditioned value learning. Beam search scores imagined sequences using keypoint-based goal costs, variance-based risk, and cost-to-go, then executes one skill open-loop before replanning. Three Push-T variants and four robot tasks using two hours of play demonstrate gains over shared-data baselines and test horizons, search budgets, adaptation, constraints, self-improvement, and crossing-data removal.
Critical strengths
-
Varying horizons balance coordinated motion reuse and fine adjustments. At equal search depth, uniform sampling over 1 to 20 steps outperforms fixed horizons of 1, 4, and 16 steps and longer ranges in score and execution steps.
-
Skill tokenization, duration prediction, grounding, dynamics, value, and beam search use shared play data without task labels, allowing failed or mixed-quality interactions to contribute.
-
Scores exceed shared-play and expert-demonstration baselines across six simulation settings and π0.5, DP, and ACT across four robot tasks trained on two hours of shared play. The planner recovers from perturbations, adapts to friction changes by fine-tuning only dynamics, and handles new keep-out constraints by rejecting plans.
-
Training episodes have a median of approximately 100 steps and skills span at most 20, whereas test executions require hundreds. Removing all crossing-spanning windows preserves a 0.915 score, supporting composition beyond demonstrated routes.
Critical weaknesses
-
Table 1 omits prior latent skill planners such as SkiMo and model predictive methods, despite acknowledged precedents. Fixed-horizon variants are compared only against one another on narrow-passage. Gains remain difficult to attribute specifically to varying horizons rather than keypoint costs, learned value, or search.
-
In Table 1, all play-trained baselines score below 15, which the authors attribute to short-episode hindsight relabeling rather than insufficient tuning. Hyperparameter ranges, training budgets, goal-pose conditioning for π0.5, ACT, and DP, and simulation dataset size are unspecified. Comparable keypoint supervision for baselines is unclear. Physical evaluation has only ten trials per task and no numerical table.
-
Table 1 averages two runs without intervals or standard deviations. SkillReasoner shares a frozen skill model and varies only value heads. Half the score rewards route progress, while full-task success is 53.0% for multi-room and 34.0% for winding-maze. Medium exceeds High success on narrow-passage (73.0 versus 66.5) and multi-room (63.0 versus 53.0), contradicting the claimed monotonic improvement with more compute.
-
Claimed benefits of variance prediction, random versus event-based windows, and frozen versus joint training lack supporting plots or tables. Timing disables early stopping and adds duration cost, unlike Table 1. Single-object Push-T tasks use replayed expert actions, leaving robustness to truly unstructured data untested.
Questions for authors
-
Why do scores and success diverge? On multi-room (full), High scores higher but succeeds less often and takes more steps. Does deeper search sacrifice alignment or increase 720-step timeouts? Please report main-text success, error-bar definitions, and more than two complete training seeds.
-
How are goal poses supplied to π0.5, ACT, and DP? Do they receive comparable keypoint supervision? How large is the play dataset relative to 50 expert demonstrations? Would longer hindsight horizons or trajectory stitching help? A fixed-horizon planner with identical keypoint costs and value would be the most informative comparison.
-
Does uniform sampling over 1 to 20 steps remain advantageous on multi-room and winding-maze? Please ablate variance prediction, random windows versus event boundaries, and frozen versus joint training. How is duration d modeled, and how is plan-length bias avoided across depths?
-
What is latency under the exact Table 1 settings with early stopping enabled and no duration cost? What replanning rate is used on the real robot, and how much data are needed for friction adaptation? Since the best scores require depth 4 at approximately 1 Hz, should the abstract qualify "up to 30 Hz"?