- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Hindsight Self-Distillation (HSD), a training framwork that leverages future observation hindsight from demonstrations to train a deployable, current-observation robot policy. HSD employs shared Video and Action DiT backbones with distinct query banks for a privileged teacher and a student. The teacher is trained on ground-truth actions, which distills both action-flow predictions and visual summary representations to the student. The authors also provide an interface-aware theoretical decomposition separating distillation mismatch into unavailable future evidence, representation loss, and student approximation error.
Critical strengths
- The idea of leveraging hindsight observation is simple, intuitive, and well-motivated, and the experiment also shows its effectiveness.
- The shared model parameter and summary level transfer effectively improves the alignment between teacher and student model.
- The experiments show consistent gain across both simulated and real world environments.
- HSD demonstrates comparable inference latency as Fast-WAM.
Critical weaknesses
- The theoretical analysis minimizes the KL divergence between teacher and student, but the training loss is a linear combination of action-flow and summary MSE loss, which introduces a gap between the theoretical analysis and the actual training.
- The value of observation horizon is not listed in the paper, and the similarity of teacher's and student's summary depends on this parameter. If it is much smaller than action chunk, how the teacher prediction is mixed with ground truth action and how student model is leanred to generalize to a larger action chunk?
Questions for authors
- What is the key difference between action level transfer and other IDM methods? Since the dataset already contains the ground truth action, what is the advantage of using teacher model to predict the action?
- What is the design choice of the summary loss? It is clear that the teacher's summary contains many future information depending on the observation horizon, will this affect the representation alignment? Can you compare with other alignment methods, such as an extra summary prediction head with student's summary and action as input?
- How many seeds are used for the experiments? In the ablation study, most difference comes from the long horizon task, can you provide an explanation of why the action level and summary level transfer improves the performance in long horizon task?