- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes to learn an energy field conditioned on the object, and use optimization over the hand parameters to synthesize dexterous grasps. However, their experiments do not support their motivation for the method: 1. performance gains are marginal and inconsistent; 2. a key limitation of test-time-optimization-based method, efficiency, has not been discussed; 3. as a learning based method, there is no clear seen/unseen data split in the main paper to study generalization.
Critical strengths
Strengths
- Multiple applications are demonstrated.
Critical weaknesses
Weaknesses
- As a learning-based algorithm, generalization to the unseen has not been thoroughly validated. It is extremely important to split the object set into seen and unseen set and verify performance on the unseen split.
- Hand-object collision avoidance and hand-hand self-penetration avoidance is very crucial for dexterous grasp synthesis. But the learned energy landscape does not support penetration-avoidance on its own, and has to rely on an analytic point-cloud based penetration penalty during test time. Without this additional penalty, PenVol becomes very bad according to Table 1.
- The performance improvement demonstrated in Table 1 is not satisfying.
- As an iterative pipeline that requires test-time gradient-based optimization, efficiency is a very big concern, but it has not been explicitly reported in the main paper. How much slower is this algorithm compared to purely generative methods?
- No real-robot experiments
Questions for authors
Questions:
- How is the energy field actually learned? How is ground truth training data collected?
- Since the authors already require test-time optimization and point cloud based penetration penalty, it is reasonable to compare with completely optimization-based methods (in other words, methods that do not rely on a training set nor a learned model, but might require iterative optimization to synthesize grasps). How do their method compare with these type of methods, like DexGraspNet?