- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper addresses weakly-paired H&E→IHC virtual staining, where adjacent-section references suffer from deformation, tissue loss, and expression heterogeneity. The key idea is to use continuous (focal) optical density (OD) not only as an intensity target but as a signal for (i) calibrating local contrastive supervision (PECC: dual feature/OD-calibrated graph context encoding, OD-weighted candidate pairs, and permutation-invariant OD-graph summary alignment) and (ii) constraining regional expression composition and intra-image expression-state relations without cross-section node assignments (MRSA: quantile-based marginal alignment of block-mean FOD + entropic unbalanced Gromov–Wasserstein relational matching with a detached coupling). All auxiliary objectives are training-only. Experiments on MIST (ER/PR/HER2/Ki67) and ACROBAT-ER use 8 metrics plus a Fiji-based case-level quantification (H-score, positive nuclei/area ratios with ICC(A,1)); ablations cover the four objectives, graph topology vs. candidate weighting, alternatives to the relational term (Direct UOT / MMD / BGW), and sensitivity to ρ, ε, and loss weights.
Critical strengths
- The two challenges (ambiguous local correspondence; regional heterogeneity under imperfect correspondence) are stated precisely and map cleanly onto PECC and MRSA. The explicit stance that OD agreement is not correspondence ground truth is intellectually honest and correctly framed throughout.
- Using one OD kernel for graph calibration and cross-image candidate weighting, plus quantile-marginal and UGW-relational alignment built from the same FOD statistics, gives the method a unified design rather than a bag of losses. The UGW formulation with prescribed tissue-coverage masses, squared-mass-normalized detached relational loss, and gradient flow restricted to the virtual-side relation matrix is carefully worked out.
- The eight-metric suite is unusually complete for this task: paired perceptual fidelity (PHV Avg, DISTS), feature-distribution similarity in both generic and stain-specialized foundation-model spaces (FID, PathFID–StainNet), and three complementary staining-agreement measures (HistCorr, DAB–KL, per-image mIoD PearsonR plus dataset-level bias). This is complemented by the Fiji-based case-level quantification (H-score, positive nuclei/area ratios, ICC(A,1) over 55 pooled case groups), which is the evaluation closest to actual pathology practice and is rarely reported in this literature. Together these cover pixel-, distribution-, stain-, and case-level evidence.
Critical weaknesses
- PGLStain does not lead on 6 of 8 metrics on ACROBAT-ER: HistCorr 0.6222 vs SIMGAN 0.6466; FID 8.03 vs PSPStain 7.65; and most strikingly |Bias mIoD| 6.326 vs USIGAN 0.344 (~18× worse) and vs SIMGAN 2.301. The main text devotes two sentences to this ("competitive performance with dataset- and metric-dependent advantages") while the abstract claims "competitive ... quantitative staining agreement" broadly. The paper should (a) diagnose why — e.g., ACROBAT's larger WSI-level heterogeneity, the 1024→512 resize altering FOD statistics, or the fixed ρ=2/σ_OD=0.1 being mis-tuned for this distribution — and (b) temper the abstract. As written, a reader of the abstract and Table 1 (top half) would get a misleading impression.
- Key hyperparameters of the OD kernel lack sensitivity analysis: σ_OD=0.1 appears in the graph calibration (Eq. 1), candidate weighting (Eq. 14), and relation matrices (Eq. 6), yet only ρ, ε, and the λ's are swept. Given that σ_OD controls what "compatible staining" means relative to the empirical FOD range, a sweep of σ_OD and of the feature threshold τ=0.6 seems at least as important as the ε sweep. Relatedly, the hard-gating threshold δ_hard=0.12024 was calibrated on 128 validation pairs (A.1.5) — a mild form of validation-set leakage into a reported ablation; training data should be used instead.
- The Fiji-based evaluation is the most clinically meaningful evidence in the paper, but it is only reported on MIST-ER. Extending it to at least one additional stain would strengthen the central claim — HER2 is the most decision-relevant (semi-quantitative 0/1+/2+/3+ scoring), and Ki67 has low positive fractions where marginal alignment may behave differently. This is a suggestion for strengthening rather than a flaw in what is reported.
- On re-reading, the genuinely new elements are (a) continuous OD compatibility as a shared calibration signal across graph edge gating, context encoding, and cross-image candidate weighting — ASP-style adaptive weighting uses feature similarity only — and (b) GW-relational matching of expression-state descriptors with relaxed marginals, which is distinct from USIGAN's unbalanced feature-plan transport and from PSPStain's image-level FOD supervision. However, the paper does not articulate this boundary explicitly: the related-work section lists the predecessors but never states what exactly PECC/MRSA add beyond "graph context + OD" or "unbalanced transport." A short paragraph making the above distinctions precise would preempt the "incremental combination" reading.
Questions for authors
- Why is |Bias mIoD| on ACROBAT-ER ~18× worse than USIGAN (6.326 vs 0.344) while PearsonR is the best? Is this a systematic global intensity offset in the generated images, and if so, why don't the marginal/FOD objectives correct it?
- Please report sensitivity to σ_OD and τ. How were σ_OD=0.1, τ=0.6, σ_p+=0.25 chosen — on training or validation data?
- For the Fiji evaluation: the StarDist "Versatile (H&E nuclei)" model is applied to IHC and virtual-IHC images. How sensitive are the case-level ICCs to the detector? Does a detector mismatch penalty affect all methods symmetrically?
- The fixed UGW budget (6 linearizations × 30 Sinkhorn iterations) yields an approximate coupling. How large is the approximation error relative to a converged solution, and does a larger budget change rankings?
- ρ=2 is used for ACROBAT and all MIST stains. Was it selected on MIST-ER only? Table 8's non-monotonicity suggests per-dataset tuning risk.
Detail Respond to Weakness (1): Updated evaluation on limited performance on ACROBAT and Data Quality
On the curated ACROBAT-lite ER evaluation, PGLStain (ρ=1) achieves the best values on six of eight metrics and the second-best PathFID. Below, we explain the data-quality findings, report the updated comparison, and show both tested marginal penalties.
1. What did the data audit reveal?
We identified black registration boundaries and white or near-white, tissue-deficient patches in the original WSI-derived data. Near-zero intensities produce large values under the logarithmic OD transform, potentially introducing non-tissue signals into DAB-derived supervision; tissue-deficient regions also provide limited expression information.
This sensitivity is visible in a fixed-prediction development-set check: excluding 22 reference images with more than 1% pure-black pixels changed PearsonR from 0.0823 to 0.7589 for ρ=2 (1,169 to 1,147 pairs). The predictions were unchanged; this check shows how strongly these references can affect the reported metric. Details are in Table 4 of our response to FWA3, “Detail Respond to Q4 and Q5.”
2. Updated comparison on curated ACROBAT-lite ER
The curated dataset contains 4,422 training and 1,000 held-out pairs from 24 and 6 disjoint case-ID groups, respectively. PGLStain uses ρ=1, ε=0.05, and a fixed epoch-100 checkpoint evaluated at 512×512.
Table 1. Updated ACROBAT-lite ER results. Best and second-best values are bold and underlined. PHV denotes PHV-Avg; abs. bias is absolute mIoD bias. PathFID uses StainNet features.
PGLStain leads HistCorr, PHV, DISTS, FID, PearsonR and DAB–KL. MDCL retains the lowest PathFID, and PSPStain the lowest absolute bias.
3. Does the MIST–ER default transfer unchanged?
The default ρ=2 was selected through the MIST–ER validation sweep. We report both completed ACROBAT-lite configurations on the same 1,000 held-out pairs, with ε=0.05, epoch-100 checkpoints, and identical evaluation preprocessing.
Table 2. Marginal-penalty comparison. Better values are in bold.
Here, ρ=1 performs better on seven metrics, while ρ=2 gives lower PHV. Thus, the six-metric lead in Table 1 applies specifically to ρ=1, not automatically to the transferred default.
In summary, the updated ACROBAT-lite results support PGLStain's applicability beyond MIST, with advantages spanning perceptual and staining-agreement metrics. The data audit identifies a concrete sensitivity of OD-based evaluation, while the two-configuration comparison shows that the preferred marginal penalty need not transfer unchanged across datasets.