- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
This paper identifies the sharp performance degradation of deep learning models in detecting chromosomal structural abnormalities under environmental shifts and unseen rearrangement configurations. To address this challenge, the authors introduce a two-stage framework based on homologous pair comparison and group-wise normal-statistics calibration, recasting abnormality detection as distinguishing abnormal structural variation from normal baseline variation. Evaluated on their introduced dataset ChromoShift, the method achieves 90.83% AUROC on unseen configurations, outperforming existing baselines.
Critical strengths
1.This paper introduces the ChromoShift dataset and provides comprehensive ablation studies covering backbones, pair formulations, training dynamics, and generator types.
- The visibility-based sample filtering, real–artificial alignment and sham controls help prevent shortcut learning caused by synthetic artifacts.
Critical weaknesses
-
The framework includes an upstream ResUNet, counterfactual generation, two distinct training stages, and numerous regularization hyperparameters (), making implementation and hyperparameter tuning complex.
-
Lack of formal causal theoretical grounding: Although the authors show a causal diagram with a domain indicator E (in Figure 2), the framework lacks comprehensive formal causal proofs. There are no proofs or analyses regarding causal effect identifiability or do-calculus operations. In practice, the method relies on standard consistency regularization and stratified feature standardization. Labeling this framework as "Causally Guided" may be superficial conceptual inflation. From the overview of the proposed framework, I cannot find how the causal modeling works. The author should explain it.
-
Limited Robustness Analysis: The paper lacks a systematic analysis of robustness to individual factors in isolation.
minors:
Using the possessive suffix 's after a parenthetical year is non-standard in academic writing (Lines 114, 116, 118, 140), Examples include "Li et al. (2024)'s HomNet" (Line 114), "Chen et al. (2024)'s BR-ChromNet" (Line 116). Suggested Revision like: "HomNet (Li et al., 2024)", "BR-ChromNet (Chen et al., 2024)".
Questions for authors
-
The method uses the absolute difference to represent feature differences between the target and reference chromosomes, then concatenates it with the target features to form and resolve the symmetry ambiguity. Why not use the signed difference directly to avoid this ambiguity? The paper also evaluates alternatives such as direct concatenation , but the performance gains are limited. Could the authors provide a theoretical explanation for these findings?
-
Are all training samples used in Stage 2 artificially perturbed versions of real samples? Does the test set include any real samples with perturbations?
-
Table 2 shows substantial performance variability across folds. What accounts for this variability? Also, the sensitivity and specificity results in Table 2 do not differ significantly from those of the second-best method. Could the authors explain this observation?
-
Why are the loss terms optimized in two stages rather than combined into a single objective for joint training?
5 comments
Rebuttal for Questions (2/2)
Thank you for your questions.
Q1: Homologous Pair Representation
A: 1. Retaining q. q addresses absolute-difference symmetry and preserves the assessed member's state. Signed differences distinguish input order but lose shared features. For a feature component a added to both,
(q + a) − (r + a) = q − r.
Different pairs can yield identical differences: q − r and |q − r| alone cannot preserve the full target state, nor can swapping inputs restore it. Bidirectional [q, |q − r|] and [r, |q − r|] let us assess each member using its own features and homologous differences.
2. Absolute differences and NSC. With q retained, we choose absolute differences to work with NSC. For N equally weighted normal homologous pairs in one group, dᵢ is pair i's feature difference. Counting both directions equally gives
μ_signed = Σᵢ[dᵢ + (−dᵢ)]/(2N) = 0; μ_abs = Σᵢ|dᵢ|/N.
Signed means cancel; μ_abs captures typical normal difference magnitudes. NSC calibrates dimensionwise: z = (|q − r| − μ_abs)/σ_abs, with σ_abs the normal scale in Eq. (5). Signed differences allow scale calibration, but mean centering cannot provide the same magnitude baseline.
[q, q − r] and [q, r] are linearly interconvertible, hence our original omission of the former. Before calibration:
- [q, r]: η = uᵀq + vᵀr + b.
- [q, q − r]: η = uᵀq + vᵀ(q − r) + b = (u + v)ᵀq − vᵀr + b.
- [q, |q − r|]: η = uᵀq + Σⱼvⱼ|qⱼ − rⱼ| + b.
The first two have equal linear expressivity. Absolute differences add piecewise-linear magnitude features per dimension. With NSC, the head directly uses departures from normal differences, easing this comparison with limited abnormal samples.
3. Ablations (Table E.3). Adding q to q − r improves all four metrics. Versus [q, q − r], our representation improves cross-environment/unseen-configuration AUPRC by 13.42/0.89 pp. Versus [q, r], unseen-configuration AUROC is similar (90.83% vs 90.94%); cross-environment AUPRC differs most (56.10% vs 39.24%).
Q2: Stage II Samples and Testing
A: Stage II classification uses original real training samples. Q compares predictions before/after quality perturbations; P compares predictions before/after reference replacement. It uses real samples and derived pairs, without artificial inversions.
Main tests use uniformly preprocessed real clinical images, retaining natural patient/preparation/imaging differences without added perturbations. Appendix E.7 separately reports controlled test-image perturbations to isolate imaging effects.
Q3: Fold Variation, Sensitivity and Specificity
A: 1. Fold variation. Pericentric inversions may change relative centromere position and arm ratios; paracentric inversions mainly change local band order. Short intervals or similar bands offer fewer recognition cues. Tables B.2–B.3 list 2–3 patients per cross-environment fold and 3–4 per unseen-configuration fold. Each fold has 2.17% positive images, but patient/configuration composition differs, so a few difficult cases can affect fold metrics. Figure 5 reports between-method differences and paired patient-cluster bootstrap 95% CIs using pooled five-fold OOF predictions.
2. Sensitivity and specificity. With low positive prevalence, interpret both fixed-threshold metrics together. In Table 2's unseen-configuration results, our sensitivity is similar to DCF's (45.44% vs 45.08%), with higher specificity (98.77% vs 55.44%). Versus CHROMA, specificity is slightly lower (98.77% vs 99.58%) and sensitivity higher (45.44% vs 21.77%). Means/SDs alone cannot establish paired significance. Figure 5 compares Sens@95%Spec under the same false-positive constraint, reporting paired differences and patient-cluster 95% CIs. Ours achieves 63.22% versus CHROMA's 31.80%: +31.42 pp [19.43, 43.75].
Q4: Why Two-stage Optimization?
A: In §4.5, configuration learning must preserve subtle abnormal structures, while P/Q seeks to reduce sensitivity to patient/imaging variation. These goals may interfere in joint encoder updates. Stage I learns structural representations and updates normal statistics; Stage II freezes the encoder, statistics and head bias, adjusting only classification weights so environmental constraints act on how learned structural evidence is used.
Table E.4 reports five-fold mean ± sample SD (%); CE/UC denote cross-environment/unseen-configuration.
| Strategy | CE AUROC | CE AUPRC | UC AUROC | UC AUPRC |
|---|---|---|---|---|
| Single-stage | 89.65±3.83 | 37.24±16.72 | 88.65±5.27 | 36.72±16.84 |
| Two-stage | 93.41±5.36 | 56.10±21.33 | 90.83±5.74 | 46.77±25.32 |
Higher means for all four metrics support structure learning before environmental adjustment. Table E.6 shows that adding P/Q improves cross-environment AUROC/AUPRC by 3.36/2.46 pp over classification-only Stage II, beyond additional classification training.
Minor Comments
A: We corrected the citation formats and checked similar usage throughout.
Thank you again for your constructive feedback.
Sincere Thanks and a Brief Follow-up on Our Response
Dear Reviewer fUQ1,
We hope your research is going well. Thank you for the careful thought you gave to the reasoning behind our method. Your questions about how causal analysis guides our design choices and why we train in two stages helped us explain more clearly how the theory informs those choices and how the experiments test them.
As the discussion draws to a close, we wanted to follow up on our earlier response. If you have a moment, we would welcome your thoughts on whether the explanations and experiments clarify the reasoning behind these choices.
Thank you again for your careful review and constructive suggestions.
With best wishes,
The Authors
Rebuttal for Weaknesses (1/2)
Thank you for your constructive feedback. The revised PDF is uploaded, with additions and revisions marked in blue.
W1: Implementation Complexity and Hyperparameter Sensitivity
A: Our pipeline covers skeleton extraction, inversion generation, and abnormality detection; the first two are independently reusable or replaceable. The skeleton model is frozen downstream and can be replaced by conventional methods. Default geometric inversions are generated offline without training another generator; the appendix compares GAN and flow-matching alternatives. Stage I learns inversion structure; Stage II adjusts only classification-head weights for environmental robustness. These roles make the workflow clear.
To assess tuning sensitivity, we vary one loss weight at a time over 0.25–4 times its reference value, keeping other settings unchanged. Stage I examines B, RA, and S: across both test domains, the maximum absolute AUROC/AUPRC changes from the reference setting are 0.42/1.38 percentage points (pp). Stage II examines P1, P2, and Q; the corresponding changes are 0.18/0.35 pp. Performance is insensitive to fine weight adjustment within the tested ranges.
W2: How Causal Modeling Guides Method Design
A: “Causally Guided” means using causal analysis to understand how inversion configuration B, patient background P, and preparation/imaging conditions Q affect observations and predictions, thereby guiding sample construction and constraints: what to change, preserve, and constrain. Section 4.1 and Figure 2 model structure formation as M = f_M(A,B,P,U_M) and image acquisition as X = f_X(M,Q,U_X), where A denotes inversion status. This follows medical-imaging analyses of distribution shifts through the data-generating process [1].
Artificial inversions change local band order to supervise structural recognition. Sham controls preserve band order while introducing artifacts from the same processing pipeline, discouraging artifact dependence. For label-preserving comparisons, we perturb quality or replace the reference while fixing the target, constraining prediction variation. This parallels using semantic-preserving counterfactual image pairs for imaging robustness [2]. NSC uses normal homologous differences as a baseline for assessing departures from normal variation.
Regarding the identifiability and do-calculus issues you raised, our theoretical objective is prediction stability under these controlled comparisons. Appendix A.2.1 defines ideal structural interventions and relates target risk to synthetic-sample risk, configuration coverage error, and generation error. Equations (8)–(9) and Appendix A.2.2 show that, for label-preserving comparisons with mean squared logit change J, mean absolute probability change and the change in mean cross-entropy risk are bounded by √J/4 and √J, respectively. The appendix gives coverage conditions for unseen changes; A.3 analyzes NSC under location–scale assumptions. These analyses provide the rationale and conditions under which the designs apply; the main-text ablations demonstrate their detection gains.
[1] Castro, D. C., Walker, I., and Glocker, B. Causality matters in medical imaging. Nature Communications, 11:3673, 2020.
[2] Roschewitz, M., et al. Robust image representations with counterfactual contrastive learning. Medical Image Analysis, 105:103668, 2025.
W3: Single-Factor Robustness Analysis
A: Cross-environment testing evaluates new patients with seen configurations and natural acquisition differences: preparation and G-banding changes can affect band appearance even within one center [3]. Unseen-configuration testing additionally excludes test configurations from that fold's real training and validation data. Appendix E.7 adds controlled perturbations to isolate imaging factors.
We fix patients, configurations, and sample composition, separately applying brightness changes, contrast changes, blur, and Gaussian noise. Absolute AUROC/AUPRC changes from original images are averaged within each perturbation type, then equally across the four types. The table reports deep learning baselines, Stage I-only VA6, and Full. Values are estimates [patient-cluster 95% CI], in pp. Table E.11 gives all results.
Full reduces mean absolute AUROC/AUPRC changes by 0.788/0.285 pp relative to VA6, supporting Stage II's role in reducing imaging sensitivity with patients and configurations fixed.
[3] Henegariu, O., et al. Improvements in cytogenetic slide preparation: Controlled chromosome spreading, chemical aging and gradual denaturing. Cytometry, 43(2):101–109, 2001.