- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper presents SurgFM-Control, a controlled evaluation framework for studying the transferability of frozen visual representations in surgical workflow recognition. The framework aligns encoder features to a common temporal grid and evaluates them using a shared temporal learner across surgical procedures. The study investigates representation performance under multiple conditions, including in-domain recognition, limited annotation budgets, cross-procedure initialization, temporal subsampling, and visual/sequence corruptions.
Critical strengths
This paper provides a commendable alternative perspective for evaluating foundation model representations. It attempts to isolate representation quality through a controlled downstream protocol. Evaluating frozen representations under a shared temporal learner across procedure type, annotation budget, temporal density, and corruption provides a complementary perspective to conventional leaderboard-style comparisons.
Critical weaknesses
1. The sparse expert router is presented as a main contribution, but it is barely discussed in the main paper and does not perform well. “Sparse Expert Routing” appears in the title, but the router is only briefly described in the appendix and is not part of the main paper discussion. More importantly, it does not clearly outperform simple baselines: the uniform ensemble performs best on Cholec80. This makes it unclear why routing is emphasized in the title.
2. The benchmark does not include enough recent surgical foundation models. Most evaluated models are general-purpose or relatively established encoders, such as DINOv2, MAE, VideoMAE, TimeSformer, and VideoMamba. For a paper focused on evaluating surgical foundation representations, more recent surgical-specific models should be included. For example, LemonFM[1] and SurgeNetXL[2] are directly relevant and has already been evaluated on datasets such as Cholec80 and AutoLaparo.
[1] LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settings. CVPR 2026
[2] Scaling up self-supervised learning for improved surgical foundation models. MedIA 2026
Questions for authors
Could the authors clarify the cross-procedure parameter transfer protocol?
The paper says that all parameters with matching names and shapes are copied from the source model. However, because distinct surgical procedures typically have disjoint label spaces, this strategy risks copying class-specific prediction weights across semantically unrelated targets. To isolate whether performance gains stem from generalizable temporal dynamics rather than arbitrary head initialization, could the authors report an encoder-only transfer baseline (i.e., transferring representations while randomly reinitializing the task-specific classification head)?
2 comments
Thank you for the clarifications and additional experiments. I appreciate the improvements made in the revision.
However, I would still like to see direct comparisons with SurgeNetXL and LemonFM under the same evaluation protocol.
We thank the reviewer for the feedback. The revision clarifies the contribution, improves the presentation, and makes the transfer protocol explicit.
Routing and presentation. We removed routing from the title and explicitly labeled Appendix D an auxiliary negative result (line 689). The revised discussion acknowledges that the tested router does not outperform the strongest static control (lines 728–733): averaging leads on Cholec80, while routing ties the best expert on microanastomosis. All experts are evaluated, so top-2 weighting provides no encoder or tower computation saving (lines 699–701). We also added Figure 2 to summarize recognition, transfer, and temporal-thinning results (lines 336–339).
Recent surgical foundation models. LemonFM and SurgeNetXL are included. The revised related work now discusses both models and clarifies the scope of the evaluated checkpoint set (lines 130–137). Our framework provides a common protocol for comparing frozen representations, while the reported findings concern the model actually evaluated. LemonFM and SurgeNetXL are not included in the reported experiments as they are new and we do not need to run new experiments at this phase. Their published results cannot be inserted as matched comparisons because downstream heads, dataset splits, and supervision may differ; these distinctions are now explicit in lines 133–137.
Cross-procedure parameter transfer. The experiment measures whether source initialization improves subsequent target learning under the same frozen features and labeled target videos as the target-only control. Compatible temporal-head parameters, including class-dependent layers, are transferred and then adapted to native target labels. No semantic correspondence between procedures’ classes is assumed. This protocol is explicit in lines 253–267.
If “encoder-only transfer” means retaining the frozen pretrained encoder while randomly initializing the entire temporal head, that is the existing target-only baseline (lines 255–257). To address the reviewer’s concern, we now provide the additional control that transfers compatible class-independent parameters while resetting every stage classifier and class-indexed refinement input projection.
At k=1, resetting class-dependent layers retains macro-F1 gains of 4.7 and 7.1 macro-F1 points over target-only training. The low-label benefit therefore persists without copying class-specific prediction weights, supporting the usefulness of transferred class-independent head parameters.
At k=8, both initialization strategies remain below target-only training. Resetting class-dependent layers does not eliminate negative transfer, reinforcing the budget-dependent operating regime identified in the original analysis (lines 422–426). The original results characterize complete source initialization; this additional ablation separates that finding from the contribution of copied class-dependent layers.