- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a framework for adapting point trackers to surgical videos, combining temporal–stereo consistency-based pseudo-label filtering with endpoint-guided streaming training. The approach addresses limited trajectory annotations and long-sequence training constraints. While the application is relevant, my main concerns are the limited differentiation from existing methods and the lack of closely related adaptation baselines.
Critical strengths
-
The paper addresses a practically important problem: learning reliable surgical point tracking from limited annotations.
-
The streaming training strategy offers a potentially useful way to incorporate long-sequence supervision without modifying the inference architecture.
Critical weaknesses
- Limited methodological novelty beyond existing consistency-based adaptation strategies
My main concern is that the methodological contribution is not sufficiently distinguished from closely related work. Several central components closely resemble existing approaches. SurgTracker [1] already uses a frozen teacher, forward–backward consistency filtering, and student fine-tuning. Endo-TTAP [2] employs staged adaptation with pseudo-labels and final-frame supervision, while MFTIQProb [3] uses stereo consistency to assess tracking reliability, albeit during inference. While none of these works uses exactly the same pipeline, the paper does not make clear what is methodologically new about putting these components together. The main novelty seems to lie in endpoint-guided streaming training, but the paper does not clearly explain how this differs from standard endpoint-supervised fine-tuning. Without a clearer distinction, I am not convinced that the contribution is strong enough for ICLR.
- Insufficient comparison with relevant adaptation methods.
The comparison between training with manual trajectories and the proposed approach is useful for studying supervision choices, but it does not establish superiority over existing surgical-domain adaptation methods. SurgTracker [1] is a particularly important missing baseline because it also fine-tunes a pretrained tracker without adding architectural parameters. Endo-TTAP [2] is another relevant surgical tracking baseline, with architectural differences appropriately acknowledged. Without comparisons under matched data and supervision budgets, it is difficult to determine whether the improvements result from the proposed training design, additional supervision, or domain adaptation more generally.
Questions for authors
-
What is the essential methodological difference between endpoint-guided streaming training and conventional endpoint-supervised fine-tuning, and what evidence demonstrates the benefit of that difference?
-
How does the method compare with SurgTracker-style adaptation using the same backbone, training data, and supervision budget? Can the authors also provide a comparison with Endo-TTAP?
-
Why do you reset point memory and query descriptors at each gradient-window boundary instead of carrying over the full state with gradients detached? Does this reset reflect what happens during continuous streaming inference, and is there evidence to support that? Have the authors separately compared initializing from predicted positions with initializing from accurate boundary positions?