- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
PPFuse proposes a closed-form feature fusion method for combining frozen pathology foundation model representations at the tile level. The method aligns an auxiliary representation to an anchor space using a semi-orthogonal Procrustes mapping, decomposes the anchor representation into an auxiliary-reachable component and an orthogonal complement, fuses only the reachable coordinates after scale matching, and preserves the orthogonal complement based on a minimum-change reconstruction principle.
Critical strengths
The method has a clear geometric rationale: it fuses aligned features while preserving the anchor information outside the aligned subspace. Its closed-form, label-free construction also makes it easy to use with existing MIL models.
Critical weaknesses
- The evaluation does not clearly isolate the value of the fused tile features. Pathology results depend on retrained MIL aggregators, the full-data and few-shot tasks differ, and CONCH v1.5 is evaluated using 256×256 crops rather than its recommended 512×512 setting. Tile-level tests and a native-crop control are needed to attribute the gains to the fusion method.
- The practical benefit of a second tile encoder is not established. The gains are modest, and all nine multiclass comparisons against UNI2-h have paired 95% confidence intervals that include zero. Without an end-to-end cost comparison or clearer positioning against existing multi-encoder methods such as ELF, the added extraction cost is difficult to justify.
Questions for authors
- Could the authors clarify why some tasks are evaluated only in the few-shot setting, while others use the full training set? Would the conclusions remain consistent if both settings were reported across all tasks?
- Could the authors clarify the patch size used for CONCH v1.5 and UNI2? If both use 256×256 crops, how do the authors account for the difference from the standard input setting of CONCH v1.5?
- Given that tile-level feature extraction is typically much more computationally expensive than slide-level aggregation, could the authors justify the practical benefit of fusing features from two tile encoders? The reported gains appear relatively modest compared with the additional cost of extracting both CONCH v1.5 and UNI2 features. In contrast, several WSI-level foundation models, such as TITAN, FEATHER, and CARE, are built on CONCH v1.5 features, making fusion at the WSI-representation level potentially much cheaper.
- Similar to Question 3, the authors use MIL to evaluate the effectiveness of tile-level feature fusion. I think this is only partially convincing, because the MIL aggregator is trained for each downstream task, meaning that the final performance is influenced not only by the fusion strategy but also by the aggregator itself. Moreover, different baselines may require different MIL hyperparameter settings for optimal performance. Therefore, evaluating the proposed fusion strategy on tile-level downstream tasks may provide a more direct and fair assessment of the quality of the fused tile representations.
- The paper does not compare against a closely related ensemble-based pathology foundation model approach, e.g., Xiyue Wang et al., “Ensemble Learning of Pathology Foundation Models for Precision Oncology”, which appears to be an important baseline for evaluating whether the proposed fusion strategy provides benefits beyond existing model-ensemble methods.
Overall, I am particularly interested in the authors’ responses to Questions 3 and 4, as they will substantially affect my final rating. I hope the authors can provide additional experiments to address these concerns. In particular, tile-level downstream tasks could be used to directly validate the effectiveness of tile-level feature fusion. It would also be valuable to explore fusion at the slide-representation level using WSI foundation models such as TITAN and CARE, to demonstrate whether the proposed fusion strategy remains effective across different representation levels rather than only under MIL-based pipelines. Finally, reporting the computational cost and runtime for the different fusion settings would help clarify the practical trade-offs. I believe these additional experiments would substantially strengthen the paper.
The authors have still not addressed my primary concern. PPFuse essentially fuses representations from two tile-level pathology foundation models. Therefore, evaluation on a tile-level pathology benchmark (SICAPv2) would provide the most direct evidence of the effectiveness of the proposed method. However, the observed improvements on this benchmark are not particularly significant.
On the other hand, the slide-level feature fusion (TITAN + FEATHER) appears to result in a performance degradation. It remains unclear whether this is because the original FEATHER representations negatively affect the fused representations or due to other factors. The authors could consider evaluating the TITAN + CARE combination to further demonstrate the effectiveness of PPFuse.
Furthermore, ICLR allows authors to update their manuscripts during the rebuttal period. I believe the authors should incorporate the tile-level PPFuse results on SICAPv2 and the slide-level PPFuse results using TITAN + CARE into the main manuscript. Evaluating tile-level fusion on tile-level tasks and slide-level fusion on slide-level tasks provides the most direct evidence of the advantages of the proposed fusion strategy. In contrast, evaluating tile-level fusion combined with MIL on slide-level tasks serves only as supplementary evidence of the effectiveness of the fusion strategy. Including these results would help improve the paper's Informativeness and Soundness.