- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents a GRU-based policy that performs multi-step prediction for in-hand reorientation of simple cylindrical objects.
Critical strengths
I like the exploration of memory, which remains underexplored in robotic manipulation. Memory is particularly relevant for dexterous manipulation, where occlusions frequently occur during execution.
Critical weaknesses
-
The use of RGB observations somewhat weakens the claim, as RGB can already reveal substantial information about the object's state. It would be interesting to evaluate the method without RGB to isolate the benefits of memory.
-
The current memory implementation relies on an RNN, an approach that has been explored in many prior works. For example, LSTM-based policies were already used by OpenAI in 2017, and it was also the default option for manipulation in rl_games codebase around 2021–2022. It would be helpful to clarify the methodological novelty beyond the use of recurrent memory.
-
It is unclear whether future prediction helps. It is not studied in the ablation part.
-
The task is already achievable in many prior works even without proposed architecture. Also, cylinders are the simplest / most trivial objects for this kind of rotation tasks.
Questions for authors
What are the main takeaways of this paper?