- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper investigates federated surgical video understanding when clients perform different prediction tasks. The authors propose TriEKB-Surg, which combines prompt-based client compatibility, reliability- and update-agreement-based aggregation, and local cross-task alignment. They evaluate the approach on three segmentation datasets and two depth-estimation datasets, reporting an aggregate relative improvement of 15.76% over FedAvg. The study contributes a framework for personalized knowledge transfer across heterogeneous surgical tasks.
Critical strengths
- The paper addresses differences in institutional annotation types, extending the problem formulation beyond federated learning with a shared prediction task.
- The framework combines semantic compatibility, source reliability, and cross-task alignment, addressing both source selection and local knowledge absorption within one federated procedure.
- Comparisons with federated baselines and component ablations across five datasets provide empirical support for the combined framework on segmentation and depth estimation.
Critical weaknesses
- The ablation study does not isolate the contribution of the curriculum schedule within the knowledge bridge, leaving its specific benefit to the reported gains unresolved.
- The cross-task alignment module is described only at a high level, and the generation of pseudo-labels is unclear, so more implementation details is good for reproducibility.
Questions for authors
see weaknesses.
3 comments
Dear Reviewer tMvh,
Thank you again for your thoughtful and constructive review.
We have posted a point-by-point response addressing concerns raised in your review. As the discussion period approaches its conclusion, we would greatly appreciate knowing whether these additional results and clarifications have addressed your concerns, or whether any questions remain. We would be happy to provide further clarification.
Thank you again for your time and consideration.
Best regards,
The Authors
Thank you for the detailed response, which clarifies my questions. So, I will maintain my positive rating.
Response to Reviewer tMvh
We sincerely appreciate the reviewer’s careful and constructive comments. Below, we provide detailed responses to each concern.
Response Thank you for this suggestion. To examine the contribution of the curriculum mechanism within the knowledge bridge, we compare the full method with Without Curriculum, which removes curriculum gating while retaining the remaining components. As shown in Table 1, the full method performs better on four of the five datasets, supporting the contribution of curriculum gating beyond the other components of the knowledge bridge. We additionally evaluate Absolute Curriculum, which retains the gates but removes the subsequent renormalization.
It can be noticed that the variant provides only modest gains over Without Curriculum. A possible explanation is that unnormalized gating reduces both the influence of less reliable sources and the overall transfer strength, potentially weakening useful contributions when gate values are small. Renormalization preserves relative source selection without this additional attenuation. These results support the value of the curriculum mechanism within the knowledge bridge and suggest that selectively weighting sources while preserving transfer strength contributes to its effectiveness.
Table 1 Ablation Study About Curriculum Gate Design
Response Thank you for the suggestion. We have added implementation details for the cross-task alignment and pseudo-label generation. At round t, each client uses its frozen personalized model from round t−1 as the teacher. This teacher has already received cross-task information through the previous bridge aggregation. Given the current client’s local images and prompts, the teacher generates soft predictions for the unlabeled auxiliary task. Specifically, a segmentation client uses the teacher’s depth prediction as a soft depth pseudo-label, while a depth client uses the teacher’s mask probability as a soft segmentation pseudo-label.
For cross-task feature alignment, the student’s primary-task prediction and the teacher’s auxiliary-task prediction are spatially aligned and mapped into a shared embedding space through two-layer projection heads. We then apply an MSE loss between the projected representations. Additional training details are provided in our responses to Reviewer RcUC’s Q2 and W2. We will release our code after the review process to facilitate reproducibility.