- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- This paper presents a method for tackling the order of object removal in cluttered scenes, using several depth-aware models. Their approach detects objects, scene depth, and predicts a graph of object removal order.
Critical strengths
- The paper tackles a useful problem of visual manipulation reasoning. In particular, here they focus on inferring the order of removing objects from a cluttered scene.
Critical weaknesses
- The approach of chaining several depth models does not seem elegant or unified; it does not seem like it is principled for scaling to more complex scenes where objects are stacked and supported on top of each other in various ways, and the camera angle is arbitrary. In the qualitative examples they provide from the benchmarks, for many object pairs there does not seem like there even requires a particular order to remove from the scene; the objects are resting indepednently on the ground surface. A robot that reaches from the top would be able to grasp objects in many different orders. The proposed approach in this paper is in my view, a heuristic for solving the task in a manner that is not quite how modeling approaches should move going forward, nor how humans do the task. A principled alternative approach -- inspired by how humans might do it -- would likely involve some kind of world model that simulates the effects of candidate actions. For each candidate action, it would simulate the consequence, and from there infer the relationships and proposed object removal. Any such model should have the notion of gravity and support, as well as be able to simulate potential actions and predict what would happen. This is briefly discussed with some results, e.g., in the Probabilistic Structure Integration (Kotar et al., 2025) paper. Further, it would be good to explore this task in more diverse scenes, especially going beyond simulation to real-world or robotics scene, for instance. It is likely that there the constraints are quite different.
Questions for authors
None.