- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents SMART, which considers unsupervised domain adaptation for whole slide image classification through frozen pathology features and a trainable multiple instance learning pipeline. This consists of a residual variational information bottleneck that is aware of the convergence process, source-memory based retrieval of pseudo-labels, and reweighting of the target samples guided by entropy and latent mix-up. The EMA teacher provides representations and pseudo-labels.
Critical strengths
-
Good amount of evaluation along with well-defined unsupervised procedure. There are multiple clinical tasks as well as cohort pairs in the paper, and a lot of information is included in the appendix that addresses the issues in evaluation. Improvements made have been quite significant.
-
The appendix is not limited to removal of just one component. Table 10 presents static VIB vs. converging aware version comparison. Tables 11 and 12 evaluate retrieval relevance and pseudo label quality. Tables 13 and 15 differentiate between re-weighting, mixup, and difficulty aware pairing.
Critical weaknesses
-
It is hard to disentangle the improvement from baseline stabilization. Appendix A.2 reveals that many baselines predict every target slide as LUSC in the leading transfer direction. The explanation and common initialization are useful additions, but they do not show competitiveness once we stabilize and tune the baseline without labels.
-
The extra benefit of convergence awareness has not been fully disentangled. In Table 10, the static VIB in the remaining SMART framework achieves a relatively high AUC already, compared to an even higher AUC in CR-VIB. This is a good comparison, but it doesn't differentiate between loss-aware gating and scheduling regularization.
-
The semantic-purification interpretation is not among the diagnostic measures. Retrieval purity, class separation, and AUC have good properties, but fail to single out domain confounder elimination. Residual pathway may retain the original confounded representation, while compression is not selective in removing the domain data. A class-conditional domain probing test or a similar controlled analysis will be required to differentiate between the new mechanism and standard regularization.
-
The convergence gate and stochastic evaluation require a detailed description. Section 3.3 explains the transformation from EMA source loss to the convergence gate in qualitative terms, but fails to provide the full function, normalization, and update constants. The evaluation rule for the stochastic bottleneck also requires further elaboration.
Questions for authors
See weaknesses.
5 comments
Response to Reviewer vi97 (Part 2/3)
W2: Separating Loss-Aware Feedback and Joint Gating from Conventional Scheduling
To disentangle convergence awareness from conventional scheduling, we conducted a controlled two-factor ablation varying (i) the control signal (predefined linear/cosine schedules vs. source-loss-aware feedback) and (ii) the control scope (KL-only vs. joint regulation of residual preservation, Gaussian perturbation, and KL compression), while keeping all other SMART components and training settings unchanged.
| Method | CPTAC→TCGA | TCGA→CPTAC | TCGA→IPD | IPD→TCGA | Mean AUC |
|---|---|---|---|---|---|
| Linear KL-only | 93.57±2.71 | 99.48±0.50 | 83.93±3.54 | 82.86±0.81 | 89.96 |
| Cosine KL-only | 94.78±1.72 | 99.01±0.73 | 82.36±3.93 | 82.70±0.94 | 89.71 |
| Loss-aware KL-only | 92.91±1.01 | 99.17±0.36 | 84.10±1.76 | 83.35±0.69 | 89.88 |
| Linear Joint Gating | 87.68±11.91 | 98.41±1.44 | 84.99±2.79 | 82.26±1.11 | 88.34 |
| Cosine Joint Gating | 83.89±18.96 | 98.40±1.16 | 84.47±0.87 | 82.79±0.82 | 87.39 |
| Loss-aware Joint Gating (SMART) | 95.58±0.73 | 98.20±0.77 | 86.10±1.95 | 85.08±1.03 | 91.24 |
AUC (%). Mean AUC is the average across four adaptation directions.
These results demonstrate the complementary benefits of loss-aware feedback and coordinated feature compression. Applying loss awareness to KL regularization alone does not reproduce the full model's performance, while replacing loss-aware feedback with fixed linear or cosine schedules for joint gating leads to lower performance, particularly under severe domain shifts. In contrast, SMART achieves the highest AUC in three of the four adaptation directions, including both brain tumor transfers.
More importantly, SMART achieves the highest four-direction mean AUC of 91.24%, outperforming all five alternatives by 1.28–3.85 percentage points. Specifically, it improves average AUC by 2.91 and 3.85 points over linear and cosine joint gating, respectively, and by 1.36 points over loss-aware KL-only regularization. Even compared with the strongest alternative, Linear KL-only (89.96%), SMART retains a 1.28-point average advantage.
These findings suggest that CR-VIB's effectiveness arises from coupling convergence-dependent feedback with coordinated regulation of residual feature preservation, stochastic perturbation, and KL compression, rather than merely scheduling the KL coefficient or applying either mechanism independently.
Response to Reviewer vi97 (Part 3/3)
W3: Testing Semantic Purification After Residual Fusion with Alignment and Probes
To directly examine the semantic-purification mechanism, we conducted additional class-conditional domain alignment and diagnostic-information probing analyses. We compare CR-VIB against Static VIB and Static VIB + Linear KL Warm-up to distinguish convergence-aware compression from conventional regularization, while keeping all other SMART components and training settings unchanged.
All analyses use the actual residual-fused slide-level representations, directly assessing domain alignment and diagnostic discrimination after residual fusion. Target labels are used exclusively for post-hoc evaluation, while diagnostic probes are trained using source labels only.
| Transfer | Method | Conditional MMD² ↓ | Diagnostic Probe AUC (%) ↑ |
|---|---|---|---|
| CPTAC→TCGA | Static VIB | 0.4714 | 88.67 |
| Static VIB + KL Warm-up | 0.4371 | 93.25 | |
| CR-VIB (Ours) | 0.2851 | 94.88 | |
| TCGA→IPD | Static VIB | 0.0787 | 79.55 |
| Static VIB + KL Warm-up | 0.0962 | 80.70 | |
| CR-VIB (Ours) | 0.0428 | 82.44 |
Results are averaged over five splits. Conditional MMD² measures source–target distribution discrepancy within diagnostic classes; diagnostic probes are independently trained on source WSIs and evaluated on held-out target WSIs.
These results demonstrate two complementary effects. First, CR-VIB achieves substantially lower class-conditional domain discrepancy than Static VIB, with relative MMD² reductions of 39.52% and 45.62%, respectively. Second, it simultaneously improves diagnostic-probe AUC by 6.21 and 2.89 percentage points, respectively. CR-VIB also outperforms conventional KL warm-up on both measures, demonstrating a more favorable balance between cross-domain alignment and diagnostic discrimination.
Importantly, these improvements are observed in the final residual-fused representations, rather than only in the isolated bottleneck branch, indicating that the benefits of CR-VIB persist after residual fusion. Together, these findings provide complementary representation-level evidence that CR-VIB enhances class-conditional alignment while preserving transferable diagnostic semantics, supporting the semantic-purification mechanism proposed in Section 3.3 of the original submission.
W4: CR-VIB Gate Formulation, EMA Updates, and Deterministic Inference
We provide the explicit convergence-aware gating function and clarify the inference procedure.
Convergence-aware gate. As described in Section 3.3 of the original submission, denotes the EMA of the source-domain classification loss at the end of the preceding epoch. The EMA is updated at each training iteration with a momentum coefficient of 0.99 and initialized with the first observed value. The gate for epoch is then computed as
\max\left\lbrace \epsilon, \left[ \min\left( \frac{\kappa}{\mathcal L_{\mathrm{EMA}}^{(t-1)}},1 \right) \right]^{\gamma_g} \right\rbrace.$$ Here, $\kappa=5\times10^{-3}$ is the fixed scaling factor, $\epsilon=0.01$ is the lower bound, and $\gamma_g=3$ controls the transition sharpness. The same values were used across all tasks and splits. **Stochastic training and deterministic inference.** During training, CR-VIB follows Eq. (1) of the original submission: $$z_{\mathrm{vib},k}^d = \mu_k^d+g^{(t)}\sigma_k^d\odot\xi, \qquad \xi\sim\mathcal N(0,I),$$ $$z_k^d = (1-g^{(t)})v_k^d + g^{(t)}z_{\mathrm{vib},k}^d.$$ During evaluation, Gaussian sampling is disabled, and the corresponding mean representation is used: $$z_k^d = (1-g^{(t)})v_k^d + g^{(t)}\mu_k^d,$$ where $g^{(t)}$ is the gate associated with the evaluated checkpoint. No Monte Carlo sampling or averaging is performed.
Response to Reviewer vi97 (Part 1/3)
We thank the reviewer for the insightful comments and valuable suggestions on clarifying the proposed mechanisms. To disentangle performance gains from baseline stabilization, we conducted additional experiments incorporating Static VIB, EMA teacher consistency, KL warm-up, and confidence-based pseudo-label supervision into DANN under the same unsupervised adaptation protocol and evaluation splits.
Specifically, EMA teacher consistency applies soft KL supervision to all unlabeled target samples. Linear KL warm-up additionally schedules the VIB regularization coefficient, while confidence-based self-training introduces hard pseudo-label CE for target samples with teacher confidence ≥0.70.
AUC (%). Each conventional variant builds upon the preceding configuration.
These results highlight two important findings. First, the severe single-class collapse observed in pathology UDA motivates our adoption of VIB-based regularization, which effectively mitigates such negative transfer. However, preventing collapse is only one aspect of robust cross-domain adaptation. Beyond feature stabilization, SMART further addresses pseudo-label confirmation bias and difficult target samples through SARA and REALM. Consequently, SMART consistently outperforms the strongest conventional baseline by 3.50, 2.21, 2.36, and 2.59 AUC points across the four directions.
Importantly, SMART's advantages extend beyond baseline stabilization and are not confined to the extreme-collapse setting. Our comprehensive evaluation spans nine adaptation directions across seven WSI cohort. SMART improves target-domain AUC over the corresponding source-only models in all nine directions and achieves the highest AUC among evaluated UDA baselines across all five original transfers. Furthermore, extensive experiments demonstrate its compatibility with four MIL backbones (DTFD-MIL, CLAM, TransMIL, and WiKG) and two pathology foundation models (CONCH and UNI2), with broad performance improvements across diverse architectures and feature representations (Appendices A.5 and A.9 of the original submission). Together with the consistently superior performance over strengthened DANN variants, these findings demonstrate that SMART's effectiveness cannot be explained solely by baseline stabilization, but reflects broadly transferable benefits from coordinated feature-, label-, and distribution-level adaptation.