- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The proposed CalibAll is a training-free pipeline for estimating camera extrinsics from existing robot manipulation datasets. It converts robot end-effector poses into standardized camera-frame tool center point (TCP) actions.
Critical strengths
The problem is important for cross-embodiment robot learning, and the approach is practical because it reduces dependence on physical robot access and robot-specific training data. The reported calibration results are strong: on DREAM, CalibAll achieves an AUC of 97.642 and an average distance error of 8 mm, outperforming the compared methods. Simulation and real-robot experiments also provide encouraging evidence of downstream utility, including a 77.5% average real-world success rate across four tasks.
Critical weaknesses
There is a gap between the paper’s broad scalability claims and its calibration-failure analysis. In the DROID evaluation, tracking fails in 5 of 20 scenes, and only 14 scenes yield successful refinement.
The dataset-construction procedure also requires manual intervention when tracking or segmentation fails, limiting the claim of fully automatic annotation.
In addition, the calibration benchmark is primarily based on DREAM; evaluation across additional platforms with independently verified ground-truth extrinsics would better substantiate robot independence.
Finally, real-world results are based on only 10 trials per task and setting. The reported differences are promising but have substantial sampling uncertainty, and the paper provides limited statistical analysis.
Last point, the single-arm/bimanual action convention—assigning arms according to their left-to-right image position—may be sensitive to camera viewpoint and could produce inconsistent action semantics across scenes.
Questions for authors
Here are some suggestions for improvements: It would be nice to report calibration success and failure rates across all evaluated datasets, robot platforms, and challenging conditions, including occlusion and clutter.
Also, it would be good to evaluate on more datasets with independent calibration ground truth and report translation/rotation errors alongside uncertainty or confidence intervals. Also provide ablations or sensitivity analyses for camera-intrinsic errors, tracking noise, segmentation quality, and manual intervention.
Finally, clarify how the arm-ordering convention behaves under changing viewpoints and test whether it preserves consistent action semantics.