- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper introduces DexPrior for multitask dexterous manipulation.
Critical strengths
The main idea is reasonable. It is logically beneficial if the model can differentiate between different skills or modes of action for downstream action generation, especially in a multitask setting. However, it's not indeed a novel idea to do so, especially in imitation learning for robotic manipulation.
Critical weaknesses
- Real-robot experiments are not included in the evaluation, leaving the method’s effectiveness in the real world unsupported by evidence. This is a critical weakness for a paper on robotic manipulation.
- As I understand it, the latent variable z, which conditions action generation, is meant to account for different skills or action modes. However, no visualization of this is provided in the paper. Do similar skills or actions have similar latent representations?
- Following up on point 2, the latent ablation in Sec. 4.2 does not seem meaningful or reasonable to me. Since all variants use the same checkpoint, trained end-to-end with the original latent inputs, randomly shuffling these inputs is almost certain to degrade performance. However, this does not, by itself, demonstrate the effectiveness of the latent representation.
- The presentation is not very satisfactory. In particular, the analysis of the experimental results is insufficient.
Questions for authors
Is this method scalable? In the paper, 6-tasks mulitask training setting is tested. However, if we want to scale the training to hundreds of tasks in real life, would the latent still be a plus or a drawback?