- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Gene2Brain-AE, a two-stage self-supervised framework for imaging genetics. A frozen genetic VAE embeds SNPs. An imaging autoencoder with an NMF-style non-negative decoder splits the latent space into a genetically guided block and a residual block. A predictor and a bidirectional InfoNCE loss link the two blocks, and a cross-covariance penalty separates them. Inference uses imaging only. The authors evaluate on three semi-synthetic UK Biobank scenarios, ADNI with 1,045 genotyped MCI/AD subjects, and eight imaging-only external cohorts. On ADNI the model yields four genetic axes and one residual axis. They report SNP associations, clinical and biomarker correlations, and external replication of clinical and neuropathological signatures, and they extend the model to clinical risk factors. The stated contributions are an interpretable genetics-guided decomposition, directional partial coupling, and empirical validation.
Critical strengths
The strongest reason for giving this rating is the external validation: eight independent cohorts, including autopsy data, with the imaging encoder applied without genotypes. That is more out-of-distribution testing than is usual in this area. I also think the design is right: an NMF-style non-negative decomposition with a predictor that maps genetics into only part of the latent space. It keeps the components interpretable and makes the genetic guidance partial rather than symmetric, which is a sensible structure for this problem.
Critical weaknesses
(1) The evidence for distinct genetic mechanisms is insufficient. Three of the four genetically guided components (L0, L2, and L3) are associated with the APOE region, yet the paper does not report APOE-conditional, LD-clumped, chr19-excluded, or APOE-e4-stratified analyses that directly assess whether these components capture distinct genetic effects beyond shared APOE-related signals. The genome-wide analysis uses the same subjects and is exploratory, and the external SNP validation in NACC and WRAP is limited to the APOE region. These results do not rule out that the four axes reflect different aspects of a shared APOE-related signal associated with disease severity. Interpreting them as distinct biological mechanisms therefore seems premature, especially since this is the paper's central biological claim. (2) The reconstruction objective appears inconsistent with the imaging preprocessing. Appendix A.6.2 states that imaging maps are z-scored against the CN reference, with the sign inverted, so the resulting inputs can contain negative values. However, the bias-free decoder uses nonnegative weights and sigmoid-bounded latent representations, so the reconstruction is nonnegative, while the loss is defined as MSE on the input maps. The paper does not explain how negative input values are handled. If they are passed to the model unchanged, the decoder cannot reproduce them, potentially affecting reconstruction fidelity and the interpretation of the learned components as NMF-style factors. The authors should clarify the exact preprocessing and decoder implementation, including whether any shift, clipping, or signed reconstruction is used, and report the fraction of negative input values.
Questions for authors
- What preprocessing is applied to the voxel-wise z-scored maps before they enter the imaging autoencoder? Please report the range of values and the proportion of negative entries. If negative values are retained, how does the nonnegative, bias-free decoder reconstruct them, and would that change the interpretation of the learned components as NMF-style spatial bases?
- What evidence establishes that L0-L3 capture distinct genetic effects rather than different aspects of a shared APOE-related signal? APOE-conditioned association tests, chromosome 19 exclusion, or APOE e4 stratification would help clarify this. How should the near-zero correlation between L3 and e4 count be reconciled with the 118 significant SNP associations reported for this axis?
- What subject-level split was used to calculate the held-out SNP-panel R2? Were the encoder and predictor trained without the held-out subjects, and which SNP-latent associations and GWAS results are based on held-out data? Since Appendix A.8 uses the training or selection subjects, would it be more accurate to restrict "generalizable biology" to the external validation of the imaging components?
- The Contr K=2 and K=3 baselines differ from the proposed model in several respects, including the predictor, latent dimensionality, loss direction, and encoder training. How much of the observed difference can be attributed specifically to directional coupling? A projection-matched symmetric baseline would help isolate this effect. What motivated the choice of the lambda_link search range, which ends at 0.3?
- Could the authors clarify the configuration used for Fig. 4 and Tables 8-9 by reporting K, Kg, Kr, and C? Section 5.2.1 describes four genetic axes and one residual component (C = 5), whereas Appendix A.7 reports a selected configuration of (K, C) = (8, 4) and near-zero variance beyond C = 4. Which configuration produced the reported results?
- The ADNI training cohort includes only MCI and AD cases. Could the authors explain this selection and discuss whether conditioning on diagnosis may induce or distort genotype-imaging associations? If suitable cognitively normal participants with genotype data are available, would including them or running a sensitivity analysis change the conclusions?
5 comments
Response to Reviewer cYd3 (2/4): out-of-sample evidence and preprocessing
2. Out-of-sample and non-genetic evidence
We agree that the genome-wide analysis is exploratory and that external SNP validation is limited to APOE, and now present the non-APOE loci as hypothesis-generating in the main text. The distinctness of the axes does not rest on them alone:
- Different APOE relationships out-of-sample. In NACC (never used for training, 4,467 participants), ε4 count is associated strongly with L0 (0.21 SD/allele, ), weakly with L1 and L2 (0.09, 0.08 SD), not with L3 (), and negatively with the residual.
- Different pathology. In NACC autopsy data, L0 and L2 replicate amyloid/tau neuropathology, whereas L3 shows a TDP-43 signature.
- Individual, stable profiles. In NACC (891 with repeat MRI, median 2.5 years): ICC 0.73–0.91, and profile similarity 0.77 within vs 0.24 between same-diagnosis participants (permutation ). ADNI follow-up scans not used for training agree (ICC 0.66–0.82, profile similarity 0.68 vs 0.10).
- Differences at comparable severity. Severity (diagnosis, MMSE, CDR-SB) explains 14–20% of L0–L2 and 2% of L3. Adjusting for it leaves the non-APOE associations intact. Biomarker profiles differ formally (Steiger, 27/42 comparisons at FDR < 0.05, e.g. CSF Aβ ρ = −0.45 for L0 vs +0.04 for L3).
- No staging between axes. Cross-lagged mixed models in NACC test whether one axis is a later stage of another: if it were, a high baseline value on the first axis would predict faster later growth of the second. In 854 participants with repeat MRI, we modelled each axis's annual rate of change with a linear mixed model, with all four baseline axes as predictors and baseline diagnosis, age and sex as covariates. Across all 12 directed pairs (FDR-corrected), no baseline axis significantly predicted change in another. For L0↔L2, the least separable pair, 0.006 SD/year per SD each way (95% CI −0.018 to 0.030 and −0.033 to 0.045). Only L1→L3 was nominal (0.034, , ).
We treat points 3 and 5 as supporting rather than decisive: stability does not exclude a shared factor with stable individual offsets, and in this mostly cognitively normal cohort small staging effects cannot be excluded. The APOE-related axes change fastest, so profiles shift towards them over time while remaining individually distinguishable.
3. Interpretation. These results support L0–L3 as distinct disease axes with different relationships to APOE, pathology and clinical course: different combinations of APOE-related and non-APOE risk may shape different atrophy patterns, consistent with known locus biology (MS4A and microglial/TREM2 biology, Deming et al., Sci. Transl. Med. 2019; CLU and amyloid-β clearance, Nelson et al., PNAS 2017). We present this as a hypothesis. Testing it requires external genotyped replication, Mendelian randomization and colocalization, now listed as future work.
W2 / Q1: Negative inputs and the nonnegative decoder
The input is nonnegative by construction. After voxel-wise z-scoring against the CN reference and sign inversion (positive = atrophy), negative values are set to zero before the autoencoder. We apologise for omitting this step and have added it to Section 3.2 and Appendix A.6.2.
- No shift, rescaling or signed reconstruction. Input = z-scores truncated at zero, range [0, 6.78].
- The objective is consistent. Input, decoder (, bias-free) and latents (sigmoid, [0, 1]) are all nonnegative, so lies in the input's domain and the MSE is well-posed. This is the standard NMF setting. Components keep their interpretation as additive, parts-based atrophy patterns with nonnegative loadings.
- Why atrophy only. The study targets tissue loss. Values above the CN reference mostly reflect anatomical variability and registration noise. Nonnegativity is what makes NMF components interpretable as regional patterns (Sotiras et al., 2015).
- Same pipeline everywhere: semi-synthetic data and all eight external cohorts, so training and inference inputs share one scale, and baselines see the same representation. Extensions to CSF maps (where disease appears as an increase) or a mixed-sign semi-NMF decoder are natural future work.
Response to Reviewer cYd3 (3/4): held-out R², directional coupling and λ_link
Q4: Directional coupling and the λ_link range
In the original baselines, the genetic VAE was also pretrained and frozen (Appendix A.4.2). Contr used the same VAE as our model (), and Contr a VAE retrained at to match . The remaining differences were the predictor, the loss direction and the imaging-side dimensionality. The new requested comparison removes these. All variants share the frozen genetic VAE, imaging autoencoder, loss terms, temperature, coupling weight and optimizer, and differ only in the coupling: two-tower MLP or linear (CLIP) projection heads with symmetric Bi-InfoNCE, one-way InfoNCE (gen→img or img→gen), and a reversed predictor (, aligned with the frozen genetic embedding).
Basic scenario (full table in Appendix A.14). The two-tower MLP reproduces Contr's profile: genetic/environmental similarity 0.934/0.535 vs Contr 0.939/0.540 and ours 0.905/0.738. Both two-tower variants carry genetic signal in the residual (0.4/2 vs 0 for ours) and lose causal-SNP association (1.6/2 MLP, 1.2/2 linear, vs 2/2). In 4/5 seeds, a genetic component best matches the environmental pattern. One-way variants match ours. The reversed predictor matches or exceeds ours on cosine metrics (0.912/0.756), but its residual spans nearly the whole brain (A.14, Fig. 16c), so its higher environmental cosine reflects a diffuse map rather than recovery of .
Weak-effect scenario (5 seeds; large-overlap results, per-seed results and SDs in Appendix A.14):
| Model | Gen. spatial | Env. spatial | Latent–sev. | Gen. assoc. /2 |
|---|---|---|---|---|
| Ours | 0.649 | 0.625 | 0.273 | 1.8 |
| One-way (img→gen) | 0.646 | 0.560 | 0.289 | 1.4 |
| One-way (gen→img) | 0.652 | 0.634 | 0.241 | 1.0 |
| Reversed predictor | 0.557 | 0.529 | 0.104 | 0.2 |
| Two-tower MLP | 0.643 | 0.488 | 0.145 | 1.0 |
| Two-tower linear | 0.611 | 0.467 | 0.205 | 0.8 |
- Capacity does not explain the benefit. The two-tower MLP (more capacity) leaks into the residual, loses the environmental pattern and carries fewer causal SNPs. The linear two-tower (less capacity) fails the same way.
- Anchoring directly is what matters. The matched-capacity reversed predictor is competitive under strong effects but collapses under weak ones (no meaningful coupling in 4/5 seeds): an imaging-side head can fit weak genetic variation from noise, and weak polygenic effects are the realistic regime.
- Both InfoNCE terms contribute under weak effects, based on the one-way ablations' genetic associations.
λ_link range. A coarse range-finding step with λ_link ∈ {0.1, 0.5, 1.0} preceded the systematic search: 0.1 gave too weak coupling and 1.0 let the link loss dominate reconstruction. 0.5 was better than both, so the stability-based grid {0.3, 0.5, 0.8} was centred on it.
Q3: Held-out and "generalizable biology"
The was computed with 5-fold cross-validation over subjects for the ridge regression only. The genetic VAE, encoder and predictor were trained on all ADNI training subjects. These are therefore cross-validated in-sample estimates and all SNP-level analyses, including Appendix A.8, are in-sample. With ~1,000 genotyped ADNI participants, a held-out set large enough for SNP-level replication would leave both training and testing underpowered, and no external cohort offered genotypes beyond APOE. Out-of-sample genetic evidence is therefore limited to ε4 on the APOE axis in NACC and WRAP.
We agree with the suggested scope. "Generalizable" will refers only to the imaging axes and their external validation (biomarkers, pathology, longitudinal stability, ε4 on the APOE axis). External genotyped replication and biological causal analyses will be listed as future work.
Response to Reviewer cYd3 (1/4): distinct genetic effects vs a shared APOE signal
We thank the reviewer for a thorough review. We performed all requested analyses: APOE-conditional, chr19-excluded, ε4-stratified and LD-clumped tests, severity controls, longitudinal NACC analyses, retraining with CN participants and a controlled coupling comparison. We also correct the preprocessing description and the A.7 error. Details follow point by point (summary in the general comment).
W1/Q2: Distinct genetic effects vs a shared APOE signal
We performed all four requested analyses. They show that L0, L2 and L3 do not share one APOE signal, and that every axis retains distinct loci outside the APOE region. All SNP-level results are in ADNI (in-sample). Out-of-sample evidence follows in point 2 (next comment).
1. APOE controls (ADNI)
Independent signals: LD-clumped at r2>0.1 within 1 Mb. "Strict" = APOE region excluded and ε4/ε2 conditioned. Strata: N = 481 non-carriers, 564 carriers.
L3 vs ε4 count (Q2). The near-zero correlation and the 118 SNPs are consistent:
Note on ancestry PCs: we updated the main results to adjust for 20 ancestry PCs (previously 5). Panel counts become 139/19/74/122 (was 140/17/79/118) for L0–L3, conclusions are unchanged, and Section 5.2.1 and Fig. 5b will be updated. The L3 breakdown above refers to the 118 SNPs in the submitted version.