- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
TETHER addresses catastrophic forgetting in continual robot learning without retaining individual demonstrations. It uses compact state-cluster statistics and local state-to-visual-feature mappings to reconstruct past task conditions. A frozen teacher from the preceding learning stage guides the current policy through velocity-field matching, while Magnitude-Aware Regularization assigns greater relative weight to small teacher pose responses. Experiments on LIBERO benchmarks and four real-robot tasks demonstrate improved task retention and reduced historical-data storage.
Critical strengths
- The paper focuses on an important problem in continual robot learning: acquiring new skills while preserving previously learned behaviors with limited historical data storage.
- Reconstructing paired state and visual conditions from compact statistics provides a practical way to support teacher-guided retention within a single shared policy.
- Extensive experiments demonstrate the effectiveness of TETHER.
Critical weaknesses
- Similar proprioceptive states may correspond to different object configurations or grasp outcomes. Attempted and successful grasps may fall into the same cluster, whose deterministic state-to-feature mapping may fail to preserve these task-relevant distinctions.
- The one-step teacher prediction approximates the conditional action mean and may inadequately represent multimodal action distributions. Consequently, distillation queries constructed from this estimate may fail to sufficiently cover distinct valid behaviors.
- Although the authors acknowledge reduced new-task performance in a few settings, the trade-off between retaining old skills and learning new ones remains insufficiently analyzed. The results do not clearly establish whether reduced forgetting reflects more effective knowledge preservation or partly stems from stronger constraints on learning new tasks.
Questions for authors
See weaknesses above.