- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces SurgURDF-Calib, a method for estimating a sequence-level rigid correction to an initial camera-to-robot extrinsic state. The methods works by selecting a 64-frame candidate pool and trains a cores initializer followed by learned robust LM stage. The LM stage augments the classical analytical pose update with a learned per factor reliability weighting, 6D damping vectors, where frames are chosen by a greedy D-optimal schedule. The authors also introduce SurgURDF-100k, a synthetic benchmark with URDF, joint-state and extrinsic annotations. Extensive ablations confirm the design choices and the resulting model performs well on the holdout test set.
Critical strengths
-
Geometry preserving Pipeline: The introduced pipeline combines classical LM update rules with learning based parts to initialize, weight and damp the optimization, making it accurate, robust and interpretable. The pipeline is well motivated and design choices are clearly ablated. The model shows strong performance on synthetic data and generalizes to held-out-instruments.
-
Synthetic benchmark with full calibration annotations: A surgical dataset shipping with URDF, joint states, and camera extrinsics. If this dataset gets released it would enable controlled evaluations of calibration methods and help train future models.
Critical weaknesses
-
Concerns about baseline comparisons: The proposed method takes gt instrument masks as inputs while some baseline consume RGB. It is unclear to me if or how baselines were retrained on SurgURDF-100k. If not retrained, the synthetic benchmark is in domain for the proposed method and out of domain for every baseline and the results could reflect domain gap rather than method performance.
-
Evaluation currently does not quantify robustness vs accuracy: All results are means only. In order to get a real understanding of the convergence of the method, the authors should report success rates or full error distributions.
Questions for authors
-
It is unclear to me whether the baselines are retrained on the SurgURDF-100k dataset. Could you clarify if the baselines are retrained on the dataset and if so how? If not, the synthetic benchmark measures domain gap rather than calibration quality. In that case, please add an evaluation on a public benchmark if possible for a fair comparison to the baselines.
-
In order to get a deeper understanding of robustness and accuracy, it would be helpfull to report sequence distributions: median errors, histograms and success rates at fixed thresholds (e.g. 1°/2 mm, 2°/5 mm) for Table 2 and fig 6.
-
LM100: is the network applied outside its training schedule since its trained up to 64 frames only or is the model retrained for 100 frames? Would this be a more plausible explanation for the degradation? Does classical LM also degrade from 64 to 100 frames?
5 comments
Response to Reviewer
Q3. LM-100 Evaluation and Training-Schedule Generalization
We clarify that LM-100 uses the original trained checkpoint without retraining. After the 64-frame stage, it performs one additional refinement update using all 100 frames. The shared factor encoder and masked mean pooling support variable-length observations, while the analytical normal equations remain 6×6.
However, LM-100 extends beyond the four-stage refinement schedule used during training, which may contribute to the observed degradation. We additionally evaluated classical Robust LM under the same frame expansion.
| Classical Robust LM | LM-64 | LM-100 |
|---|---|---|
| Rotation Error (°) ↓ | 7.959 | 8.179 |
| Translation Error (mm) ↓ | 17.426 | 17.539 |
Classical Robust LM also exhibits a slight performance decrease when extending from 64 to 100 frames. This suggests that additional weakly informative or occluded observations may adversely affect optimization. Nevertheless, since LM-100 changes both the observation set and update count while extending beyond the training schedule, we cannot attribute the degradation to a single factor. We will clarify this limitation in the revised discussion of Figure 5.
Gentle Reminder
Dear Reviewer ofwu,
Thank you for your time and constructive feedback on our paper. As the author–reviewer discussion period will end in about one day, we would greatly appreciate it if you could review our rebuttal and consider whether your concerns have been addressed. Thank you again for your time and consideration.
Regards from the authors.
Response to Reviewer
Response to Reviewer
We sincerely thank the reviewer for the thoughtful and constructive feedback, particularly for highlighting important concerns regarding baseline fairness and evaluation robustness. We have conducted additional experiments and expanded our statistical analyses to address these concerns. We hope our responses will clarify the evaluation protocol and strengthen your confidence in our work.
W1/Q1. Baseline Retraining and Fair Comparison
We clarify that the task-specific modules of four baselines were retrained on the SurgURDF-100K training split, rather than directly using out-of-domain pretrained models. Specifically:
All methods follow the same training/test split, initialization conditions, camera intrinsics, and evaluation metrics. We acknowledge that different methods retain their respective RGB or mask inputs, so these comparisons evaluate complete calibration systems rather than identical input modalities. The controlled mask-based comparison in our response to R1-W2/Q2 further evaluates the LM refinement stage under identical observation conditions, isolating the contribution of the learned solver.
Furthermore, Table 2 includes evaluations on three public real-world datasets (SurgSync, SutureBot, and ImitateCholec), with all learned weights kept fixed and no additional fine-tuning. We have also expanded the appendix with detailed baseline training and implementation protocols.
W2/Q2. Error Distributions and Calibration Success Rates
We conducted additional statistical analyses to quantify calibration accuracy and robustness, including mean ± standard deviation, median errors, error histograms, and success rates under fixed accuracy thresholds.
1. Error statistics and distributions.
The median errors are lower than the means, indicating that a subset of challenging cases produces relatively large errors. We have additionally included histograms of all six metrics in the appendix to illustrate their distributions.
2. Calibration success rates.
A calibration is considered successful only when both rotation and translation errors satisfy the specified thresholds.
Our method achieves the highest success rates across all three thresholds. At 3° / 10 mm, it achieves 40.97%, outperforming the strongest baseline, EasyHeC (28.75%), by 12.22 percentage points.
We have also updated Figure 6 with standard-deviation error bars across initialization perturbation levels. Together, these additions provide a more comprehensive assessment of calibration accuracy, variability, and robustness beyond average performance.