- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents FINGR, a policy for real-world dexterous manipulation focused on solving a 2×2×2 Rubik’s cube with a single robotic hand. The method combines two main ideas: (1) a finger-relative geometric representation that encodes cube points relative to each fingertip, and (2) a future interaction prediction objective that supervises latent representations using multi-horizon predictions of contact-force changes, layer-turn progress, and finger joint motion. Experiments are conducted on a real robotic platform.
Critical strengths
1.The paper presents a solid real-world system with strong empirical performance. In particular, the reported 99% success rate on continuous layer turns and the successful end-to-end solving of 10 scrambled cubes suggest that the approach is robust in practice, not only in isolated demonstrations. The experimental section is also reasonably complete, with baseline comparisons and ablations on the proposed components.
- The finger-relative geometric representation is a sensible design choice for this task. Instead of relying only on global cube features, the policy explicitly models geometry relative to each fingertip, which fits the contact-rich nature of the manipulation problem. The ablation results indicate that this component provides a meaningful improvement over the base flow policy.
Critical weaknesses
-
The manipulation setting is fairly constrained, which makes the scope of the contribution narrower than the paper sometimes suggests. The system relies on a largely fixed grasp where the thumb and middle finger continuously stabilize the cube, while the remaining fingers execute predefined U/L layer turns. There is no finger gaiting or substantial in-hand reconfiguration during manipulation. As a result, the learned behavior appears closer to a specialized controller for a particular cube-turning setup than a more general dexterous in-hand manipulation policy. This limitation is important because much of the claimed significance comes from its relevance to broader dexterous manipulation.
-
The evaluation is limited to a tagged 2×2×2 cube under a carefully engineered pipeline, including marker-based reconstruction, restricted move sets, and planner-assisted table regrasps. It remains unclear whether the proposed representation and future prediction objectives would transfer to less structured settings, larger cubes, or other articulated object manipulation tasks. The paper demonstrates strong performance within its setup, but the evidence for broader applicability is limited.
Questions for authors
-
The manipulation policy is evaluated under a fixed grasp configuration with only U/L turns. How much of the reported performance depends on this constrained setup? For example, can the same policy architecture handle settings that require significant in-hand reorientation or changing support fingers during manipulation?
-
The paper motivates the method as improving dexterous in-hand manipulation more broadly, but all experiments are on a tagged 2×2×2 cube with marker-based reconstruction. Do the authors have any evidence that the proposed finger-relative representation and future-token objectives transfer beyond this specific task setting, e.g., to other articulated objects or less constrained cube manipulation setups?
-
The complete system relies on planner-assisted table regrasps when the current grasp cannot realize the remaining moves. Could the authors clarify how often the learned policy itself fails due to grasp limitations rather than execution errors? This would help separate manipulation capability from planning constraints in the reported full-system results.