- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a new method for object-centric unsupervised skill discovery. Their main idea is to apply temporal distance-maximizing skill discovery (METRA) to each object. Specifically, they first assume that the state space consists of N factors, and apply the METRA formulation to each of the N components, weighted by a causal action influence estimate defined by . They show that the resulting method, called OCUSD, outperforms previous object-centric and general unsupervised skill discovery algorithms on Elden Kitchen, Playground, and Fetch.
Critical strengths
- The paper is clearly written and easy to understand.
- The experiments are reasonably thorough. The authors show that their proposed method outperforms previous baselines across 10 environments. The ablation studies seem reasonable too.
Critical weaknesses
- To my understanding, the main novelty of this paper is action influence weighting (because the remaining part is a rather straightforward application of METRA to individual objects). However, I found this formulation to be too heuristic and not convincing enough. For a fixed , suppose that we want to learn a skill that pushes the object to the right. Then this skill should be able to (1) approach the target object, and (2) push the object to the right. However, CAI will only upweight the second part because the mutual information is zero before the arm has contact with the object. Please correct me if I've misunderstood anything. Although it might still work well empirically despite this sort of pathology, I think the formulation is too heuristic to be widely applied to diverse scenarios.
- Moreover, even if this weighting scheme hasn't had this pathology, I would have still been concerned about the significance of the proposed method. The core methodology is identical to METRA (except for its per-object application) and the method is based on a rather strong assumption that the state space provides ground-truth object segmentations. This assumption does not seem to hold in practice in general, as we don't typically have ground-truth information about the objects in robotics.
Questions for authors
I don't have any other questions than the one asked in the weaknesses section.