- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper looks at the instability of whole-slide image (WSI) representations in continual learning. Even when patch features are frozen, updates to the attention-based aggregation module can still change slide-level representations. The proposed PACE framework fixes both the projection and attention aggregation modules to maintain a stable slide-level feature space. It then stores a small set of clustering-based prototypes for each class and trains the classifier through prototype replay. The experiments evaluate classification across multiple datasets, task partitions, and arrival orders, and also include an extension to survival prediction.
Critical strengths
The experimental evaluation is extensive, covering multiple classification datasets, different task partitions and arrival orders, and a broad range of baselines. The paper also systematically examines freezing strategies, prototype counts, and replay weights. The problem is practically relevant, and the connection between the identified source of representation instability and the proposed design is clearly articulated.
Critical weaknesses
There is not much methodological novelty. The core ideas maintaining a stable representation space, preserving past knowledge through prototypes, and using multiple prototypes to capture intra-class variation have clear precedents in prior work. The methodological contribution therefore lies primarily in integrating these ideas into a continual learning framework for WSIs and validating their effectiveness through extensive experiments. This integration has practical value, but the specific methodological advances beyond existing work remain insufficiently clear.
Questions for authors
- The results across task-granularity settings in Table 5 use different class weights. AACC averages class recalls within each task and then weights tasks equally, so moving from six tasks to three increases UBC-OCEAN’s total weight from 1/6 to 1/3. The reported one-percentage-point variation therefore reflects both changes in model predictions and changes in evaluation weights, and does not by itself establish robustness to task granularity. I suggest using the final predictions on the existing shared test splits to additionally report global macro recall with equal weights across all 16 classes. This would provide a consistent basis for comparison and better substantiate the robustness claim.
- Several standard deviations are inconsistent between Table 1 and the detailed results in Tables 10 and 12. For CF, Fine-tuning is reported as 0.167 ± 0.036 in Table 1 but 0.167 ± 0.009 in Table 10. For RF, MICIL and LoRA are both reported as 0.077 ± 0.000 in Table 1, whereas Table 12 reports 0.077 ± 0.009 and 0.077 ± 0.005, respectively. All three tables specify means and standard deviations over five runs, but these discrepancies are unexplained. Please verify the statistics against the corresponding per-run records and ensure consistency between the main text and the appendix. If different run sets or statistical procedures were used, please state this explicitly. I would consider raising my score if the authors provide clear explanations and targeted supporting evidence during the rebuttal.
4 comments
The authors have made the necessary changes.
We sincerely thank the reviewer for the follow-up and constructive feedback. The comments have helped us to further strengthen the evaluation, improve the consistency of the reported results, and clarify the scope of our contribution. We appreciate the reviewer’s time and careful consideration of the revisions.
A Gentle Request for Score Reconsideration
As the discussion period comes to a close, we thank you for reviewing our revisions and acknowledging the changes. We summarize the main updates below:
- Task granularity (Q1). Table 7 adds global macro recall with equal weights over the 16 classes, as suggested, and the conclusion on task granularity is refined accordingly.
- Standard deviations (Q2). Table 1 now agrees with the detailed tables (Tables 17 and 19), and our response explains the source of the earlier difference.
- Scope of contribution (W1). The manuscript clarifies that PACE builds on established components and what is specific to it (Secs. 1 and 2, Table 5).
If these revisions address your main concerns, we would appreciate you reconsidering your overall assessment and score. Please let us know if any concerns remain.
We sincerely thank the reviewer for the detailed and constructive feedback. All table, figure, and section numbers refer to the revised manuscript, in which changes are highlighted in green for ease of review.
We sincerely appreciate your thoughtful review and the care you have taken to examine the standard deviations reported in the tables. We provide our responses to each of your questions below.
Q1: Table 5 uses different class weights across task granularities; please report global macro recall with equal weights over the 16 classes on the existing test splits.
We report global macro recall in Table 7, for the same runs as the task-granularity table (Table 5 is now Table 6), and it changes the conclusion as you anticipated:
Cross-cohort benchmark: means over five seeds, with the best baseline of each column in parentheses.
You are right that the one-point AACC variation mixes model behavior with evaluation weights (UBC-OCEAN's weight rises from 1/6 to 1/3). Under equal class weights, PACE keeps the highest mean at all three groupings, by 1.7–1.9 points, within the runner-up's sd (0.047, 0.039, and 0.018), which we read as parity. Its spread widens from 1.0 to 2.7 points and the trend reverses: macro recall rises as tasks are merged, whereas AACC falls. The result therefore does not establish robustness to task granularity, and we no longer claim it: we state only that PACE has the highest or tied-highest mean at all three granularities under both weightings (Secs. 6.1 and C).
Q2: Several standard deviations differ between Table 1 and the detailed tables (fine-tuning on CF; MICIL and LoRA on RF). Please verify against the per-run records and state whether different run sets or procedures were used.
You are right: the entries should not have differed, and they now agree. Both tables report the same statistic, the mean ± sd over five seeds of each method's validation-selected configuration (Secs. 5 and E). Fine-tuning on Cancer family now reads 0.167±0.009 in both (Tables 1 and 17 in the revised manuscript; originally Tables 1 and 10), and MICIL and LoRA on Rare-first read 0.077±0.009 and 0.077±0.005 (Tables 1 and 19 in the revised manuscript; originally Table 12).
Cause. Different run sets, not different statistical procedures. The sds that disagreed came from separate executions of the same configurations, and executions can differ through seed-to-seed variation (including weight initialization) and library nondeterminism. The means agreed at the reported precision in the three entries you list because these baselines collapse to approximately 1/T (0.167 for six tasks, 0.077 for thirteen).
W1: Limited methodological novelty: stable representations, prototype memory, and multiple prototypes have precedents.
We agree that the core ideas have precedents (the revised manuscript now says that the components are established; Sec. 2 and Table. 5) and that the contribution is their integration for WSIs and its empirical validation. Relative to the compared frozen-representation methods, what is specific to PACE is the combination of a complete bag-to-slide map fixed before the first task, a capped multi-centroid memory, and rehearsal through the expanding head only (Table 5 of the revised manuscript). The evidence that fixing the map matters is the matched single-run ablation: trained throughout, the same map is 14.1–28.3 points lower in every matched pair on three curricula (λproto=10; Tables 12–14). Controls also show that the fixed map need not be the pretrained attention map (Table 10), so what we claim is an empirical finding about where to fix the representation, not a new aggregator.