- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors argue that instrument-tissue clearance is not captured by standard geometry metrics. They proposed CARE3R, which is a VGGT-style feed-forward model that predicts metric depth, pointmaps, poses and instrument masks from endoscopic RGB. They contribute ESD-Contact, a contact-vs-hover AUC benchmark, and Contact-Aware Supervision. On four validation clips CARE3R reaches AUC 0.933 versus ≤0.806 for seven zero-shot baselines.
Critical strengths
A real, clinically motivated gap, addressed with an original data design. Using a side view to derive perpendicular clearance targets, with resistance recordings to verify labels on a subset, makes a millimetre-scale quantity learnable and measurable.
Dense FS supervision alone gives AUC 0.822, a self-referential profile hurts (0.743, the tip sinks), a stereo-referenced profile gives 0.883, and contact/hover terms add 0.050, positive on every clip.
Critical weaknesses
The headline claim rests on four validation clips that were also used to select loss settings, with a single seed and no confidence intervals. I appreciate that held-out surgical data are scarce and the authors acknowledge this, but a leave-session-out split , bootstrap CIs, and separating tuning from evaluation are feasible. CARE3R exceeding the stereo teacher (0.933 vs 0.892) suggests it may exploit visual contact cues.
Conventional metrics are measured on tissue or other datasets, and no tip-region depth error is reported.
Questions for authors
Could the authors report depth error in the tip region against FS, and the hover clearance error in mm against the side-view measurement? How does the model behave on “near” frames, which are currently excluded?
Would it be possible to evaluate with a leave-session-out split, multiple seeds, and bootstrap CIs? Arm D suggests variation of about 0.005 AUC and 1 mm, so how large is the uncertainty on the four-clip AUC?
How can the AUC (0.933) exceed the stereo teacher (0.892) that supplies the targets? Does the model rely on visual cues rather than geometry?
3 comments
The response says FS depth is “least reliable at instrument edges.” But Appendix A.2 says: “FS is reliable near the instrument but noisier on distant, weakly textured tissue.” The paper also uses the Spearman correlation between predicted and FS tip–tissue gaps as supporting evidence. So it’s hard to see why the authors won’t report tip-region error against the same reference. I also have a concern about the two-level bootstrap. The outer level has only four clips, so the interval mostly reflects variation across those four clips. It may understate the real uncertainty. More evaluation clips would make this stronger in future work. Overall, the paper tackles a clinically relevant gap with an original data design. I’m keeping my weak accept rating.
Clarification: where FS is reliable, and where it is not
We thank the reviewer for the careful re-reading and for keeping the paper under consideration. Both points are fair. Our wording in the previous response described where FS is weakest in a way that did not match Appendix A.2, and the bootstrap interval is indeed limited by having four clusters. We make the picture clearer on both below.
Clarification: where FS is reliable, and where it is not
Our earlier sentence said FS is "least reliable at instrument edges". What we meant is the small region around the instrument tip and the tissue immediately around it, not the instrument surface, which FS measures well: it is close to the camera, large in the image and strongly textured. FS is noisier on tissue, most of all on distant, weakly textured tissue. We will correct the wording.
The gap is a difference between two depth readings. One is taken on the instrument at the tip, where FS is accurate. The other is taken on the tissue just outside the instrument mask, where FS is weaker. In hover the two readings are only a few millimetres apart, while the tissue itself is tens of millimetres from the camera. A small relative error on the tissue reading is therefore a large relative error on the gap, and that is the reading that decides the score.
FS's own score on this benchmark says the same thing empirically. Run through the identical readout against the side-view labels, FS reaches an AUC of 0.892 on the stereo clips, not 1.000. If its depth resolved the gap well enough to serve as the reference for it, its own readout would be close to perfect.
This does not make FS a poor supervision signal. As dense supervision it is clearly better than nothing: it is dense, metrically scaled, and correct in ordering over most of the frame. The claim is narrower. FS is good enough to supervise against and to correlate against, and not precise enough on tissue to serve as the absolute reference for a millimetre gap.
Why is reported and a tip-region error is not
Both use FS, but they ask different things of it. Spearman asks only that the predicted and FS gaps rise and fall together across frames, and a smooth error or an offset on the tissue term does not break that ordering. An absolute error asks that FS be accurate at the very location where we have just said it is weakest. The primary metric does not depend on FS either: AUC is scored against the side-view contact labels, and the per-frame alignment to FS changes it by less than 0.002 for every method.
The bootstrap
We agree. With four clips the outer level has three degrees of freedom, so the interval is coarse and probably optimistic.
Three checks bound the claim independently of it. The statistic we rely on is the paired contrast of , which is positive on all four clips individually ( to ), so its sign does not rest on the interval. Dropping any single clip leaves a mean of to , so no one clip carries the result, and even the lowest of these is above the strongest baseline (0.806). And the two checks that do not use the four clips agree: three seeds give , and (SD ), and removing every same-session clip costs at most while every arm stays above the contact-free model.
We agree that more evaluation clips is the right fix, and we state the four-clip scope as a limitation. We will also add this clarification to the manuscript, so that the reliability of FS on the instrument and on tissue is stated once and consistently.
We thank the reviewer for the valuable comments. All three requests, namely bootstrap CIs, a session-disjoint check and seed variation, are now run, and we have revised the manuscript where appropriate. The four-clip AUC carries real uncertainty (±0.03); the paired contrast does not (+0.050, positive in every replicate); and it survives removing temporal context and same-session clips.
Re W1 / Q2 (a): how large is the uncertainty
A two-level bootstrap, resampling clips then frames, gives [0.902,0.963] around the four-clip AUC of 0.933, and [+0.030,+0.071] for the +0.050 paired contrast. Per-clip AUCs are 0.966, 0.956, 0.900 and 0.909, so the interval reflects clip-to-clip variation.
Re Q3 / W1: whether the gain comes from visual cues rather than geometry, and why we can exceed FS
In one line: we train no contact classifier, so an appearance cue could only enter the score by making the predicted depth wrong; and FS is not a ceiling on this metric, for reasons a model with temporal context can exploit. First, there is no contact output. The network predicts metric depth and point maps, camera poses and an instrument mask; contact is never a prediction target. Every method, ours and all seven baselines, is scored by the same readout on its own depth map: the median depth in a patch at the annotated tip minus that of a surrounding tissue ring. AUC ranks that scalar. Second, the supervision is that same distance, not a label. On a contact frame the loss drives the tip's signed perpendicular distance to a plane fitted to the surrounding tissue ring toward zero; on a hover frame it drives that distance toward the side-view measurement. The plane comes from a detached copy of the model's own ring, so the tip is never supervised by its own depth. Reducing it requires moving the tip to the right place in 3D. Third, the paired contrast isolates the supervision:
Re W1 / Q2 (b): same-session clips and seeds
In one line: removing every same-session clip costs no more than re-finetuning on an unrelated session, and three seeds agree to ±0.001. The experiment acts on the contact stage from the reported model and tests whether the supervision depends on same-session data; it is not a run from base, which we label. A control keeping all ten clips under the same recipe divides out that cost (−0.007, CI [−0.016,+0.001]). Values are relative to it:
Re W2 / Q1: why not report tip region error against FS, and near frames
In one line: we do not report it because its reference is FS, an estimate rather than ground truth, whereas the contact state is annotated in a second view and used as the criterion. An error at the tip would be measured against FS depth, itself a prediction and least reliable at instrument edges. Closer agreement would not show that the geometry is recovered, so methods should not be ranked by it. The contact state is what we can hold fixed: annotated in the side view, and on the three clips with a resistance channel the two agree on 99.9% of frames. Near frames are excluded because the transition is ambiguous; only 21 exist in the four clips.