- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents CryoNet.Density, a resolution-conditioned 3D Brownian Bridge Diffusion Model that generates realistic, experiment-like cryo-EM density maps from atomic structures. A differentiable Gaussian renderer first produces a physically simulated map from the atomic model, and the diffusion model then learns a structured correction that maps it toward the corresponding experimental map. Target resolution is controlled continuously through FiLM conditioning on Fourier features. Sampling uses a single stochastic transition that needs only two denoiser evaluations.
The authors build a benchmark of paired atomic models and experimental maps, with 1,923 held-out test cases. They compare CryoNet.Density with analytical rendering methods and Struc2mapGAN on seven metrics covering the spatial and Fourier domains, and report large gains in map fidelity. Further experiments test resolution control and downstream usefulness, the latter by running frozen Emap2sec+ and ModelAngelo models on the generated maps. The paper also releases the CryoNet.Density Database, about 3.64 million generated maps at controlled resolutions.
Critical strengths
- A well-motivated formulation with thorough evaluation.
The paper frames density generation as translating a physically rendered map into an experimental one. Analytical rendering preserves the structural content, and the model learns only the remaining correction. This is a sensible way to combine explicit physics with the flexibility of a generative model.
The evaluation is fairly thorough, covering 1,923 held-out cases and seven spatial- and Fourier-domain metrics. CryoNet.Density outperforms all reported baselines, with the largest gains in Fourier-domain agreement. The ablations, including comparisons with direct regression and alternative sampling trajectories, support the main design choices. Taken together, the empirical case is convincing.
- Downstream utility and a potentially valuable large-scale dataset.
The authors go beyond map similarity and test whether the generated maps preserve features needed for structural interpretation. With frozen Emap2sec+ and ModelAngelo models, CryoNet.Density maps support downstream analysis better than the other synthetic maps, which is good evidence of practical value.
The accompanying database of about 3.64 million resolution-controlled maps could also be a useful resource for training and benchmarking data-driven cryo-EM methods. This extends the potential impact of the work beyond map generation itself.
Critical weaknesses
- Limited validation of experimental variability, and an unclear physical meaning for resolution control.
CryoNet.Density agrees well with the paired experimental maps, but the evaluation does not show whether its outputs reproduce the variability of real experimental reconstructions.
Real cryo-EM maps vary with acquisition conditions, particle count, reconstruction pipeline, local resolution, and structural heterogeneity. The model, by contrast, is conditioned only on the atomic structure and a nominal target resolution. It is therefore unclear whether the stochastic variation in its samples reflects realistic experimental variability or is simply an artifact of the learned sampling process.
The supplementary analysis of conditional diversity and residual structure is a useful first step. A more direct test would compare generated samples against multiple independent experimental reconstructions of the same structure, which exist for many entries in EMDB.
Resolution control raises a similar concern. It is evaluated mainly through spectral bandwidth and how well bandwidth tracks the requested resolution. This shows that the conditioning works, but bandwidth is not the same as experimentally measured resolution, and it says nothing about spatially varying local resolution. Validating local structural fidelity and other resolution-dependent properties would clarify what the resolution control actually achieves.
- Gaps in the downstream evaluation, and no direct evidence that the database is useful.
The downstream experiments suggest that the generated maps retain structural information, but some choices in the protocol limit how far the conclusions extend.
The ModelAngelo results are reported on 711 of 1,524 eligible protein test cases, keeping only cases where all four inputs yield nonzero sequence matches. This ensures that every method is evaluated on the same cases, but it hides how often each method fails. It may also bias the comparison: requiring success on every input, including the weakest baseline, tends to keep the easier cases. Reporting per-method success rates and aggregate results over all 1,524 cases would give a fuller picture.
The value of the CryoNet.Density Database is asserted but not demonstrated. No experiment trains or augments a downstream model with the generated maps. Showing improved performance on held-out experimental data after such training would be much stronger evidence of the resource’s impact.
These issues do not undermine the reported improvements, but they leave the broader practical benefit of the generated maps less certain.
Questions for authors
Q1. Does CryoNet.Density capture the variability of real reconstructions, beyond matching a single paired map? For structures with several independent experimental reconstructions, how does the spread of generated samples compare with the spread across those reconstructions?
Q2. Does resolution conditioning reproduce the properties of real maps at a given resolution? Beyond radial spectral bandwidth, how do local resolution and structural fidelity change with the target resolution? Does this behavior hold at intermediate resolutions not seen during training?
Q3. What are the ModelAngelo results over all 1,524 eligible cases? The reported results cover only the 711 cases where every input yields a nonzero sequence match. Could the authors report each method’s success rate, and aggregate performance over the full set with failures included?
Q4. How much of the gain comes specifically from the Brownian bridge formulation? The same-backbone comparison with direct regression is useful. How does CryoNet.Density compare with a standard conditional diffusion model, or another bridge formulation, at matched compute? This would separate the benefit of the bridge from that of conditional generative modeling in general.
6 comments
Resolution control and local structural fidelity
Comment 2 : Beyond radial spectral bandwidth, how do local resolution and structural fidelity change with the target resolution? Does this behavior hold at intermediate resolutions not seen during training?
Response: We added local comparisons with experimental maps and evaluations at resolution values absent from training. Section 4.3 now introduces these analyses (lines 380–383).
Local experimental-map agreement. Using fixed PDB-7kod coordinates, we compare generated maps and physical renders against six experimental references spanning 1.655–10.18 Å. EMD-22972 is the map deposited with PDB-7kod; the other five are Glacios reconstructions from the ice-thickness series in EMPIAR-11397. Before inspecting predictions, we select 24 Cα-centered spheres of 32 Å diameter. Correlations are averaged across three seeds per sphere, then summarized by the median and IQR across spheres.
| Experimental reference | Nominal resolution (Å) | Physical-render PCC, median [IQR] | CryoNet.Density PCC, median [IQR] | Median paired Δ |
|---|---|---|---|---|
| EMD-22972 | 1.655 | 0.636 [0.634, 0.638] | 0.844 [0.840, 0.846] | +0.208 |
| EMD-29566 | 3.40 | 0.755 [0.748, 0.762] | 0.884 [0.881, 0.889] | +0.130 |
| EMD-29567 | 4.64 | 0.759 [0.746, 0.767] | 0.844 [0.823, 0.853] | +0.088 |
| EMD-29569 | 9.63 | 0.716 [0.691, 0.723] | 0.712 [0.682, 0.723] | −0.006 |
| EMD-29570 | 9.84 | 0.576 [0.552, 0.588] | 0.584 [0.559, 0.596] | +0.009 |
| EMD-29568 | 10.18 | 0.860 [0.853, 0.876] | 0.887 [0.866, 0.896] | +0.019 |
Generated maps have higher local PCC at five of six reference resolutions, with the largest improvements at 1.655–4.64 Å. The value at 9.63 Å is slightly lower. Δ is the median of paired regional differences, not the difference between the column medians. This measures local map–map correlation at each reported global resolution (Appendix I.3.1, Table 16, lines 1784–1816).
Intermediate resolutions. We generated maps at 20 resolutions from 1.655 to 10.18 Å, keeping coordinates, grid, regions, and random draws fixed. Local PCC between adjacent outputs ranges from 0.931 to 0.997; the four 0.25 Å steps from 5.5 to 6.5 Å give 0.997, 0.991, 0.977, and 0.96. Five targets—1.655, 6.25, 9.63, 9.84, and 10.18 Å—are absent from both training and validation. Local density remains correlated between adjacent target resolutions (lines 1836–1849; Figures 16–17).
Experimental maps at resolution values absent from training. We checked all 13,659 training pairs and 1,923 test cases and identified 17 qualifying test cases. Their resolutions are within the 1.52–15.0 Å training range and 0.004–0.100 Å from the nearest training value. All methods use the same 17 cases and the predictions from Table 1; results are averaged across cases.
| Method | n | Map–map CC ↑ | Masked FSC AUC ↑ | FSC@target ↑ | SSIM ↑ | Correlation ↑ | log-RAPS MAE ↓ | PCC ↑ |
|---|---|---|---|---|---|---|---|---|
| ChimeraX molmap | 17 | 0.759 | 0.204 | 0.262 | 0.880 | 0.769 | 1.346 | 0.564 |
| phenix.model_map | 17 | 0.771 | 0.228 | 0.292 | 0.663 | 0.608 | 1.949 | 0.629 |
| EMAN2 | 17 | 0.738 | 0.209 | 0.261 | 0.878 | 0.747 | 1.822 | 0.532 |
| TEMPy | 17 | 0.771 | 0.213 | 0.248 | 0.871 | 0.785 | 3.689 | 0.672 |
| CryoNet molmap | 17 | 0.738 | 0.206 | 0.261 | 0.878 | 0.748 | 1.570 | 0.545 |
| CryoNet.Density | 17 | 0.786 | 0.244 | 0.305 | 0.873 | 0.803 | 0.924 | 0.690 |
CryoNet.Density leads in six of seven metrics; ChimeraX molmap has the highest SSIM. Relative to CryoNet molmap, FSC AUC increases 0.206 → 0.244, PCC 0.545 → 0.690, and log-RAPS MAE decreases 1.570 → 0.924. Excluding the two labels also present in validation (4.57 and 7.82 Å) leaves 15 cases. The same six-metric lead remains: FSC AUC is 0.223 and PCC 0.704, compared with 0.186 and 0.546 for CryoNet molmap. Added to Appendix I.3.2, Table 18 (lines 1946–1978).
ModelAngelo evaluation and downstream training
Comment 3: What are the ModelAngelo results over all 1,524 eligible cases? The reported results cover only the 711 cases where every input yields a nonzero sequence match. Could the authors report each method’s success rate, and aggregate performance over the full set with failures included?
Response: We re-evaluated all 1,524 eligible cases after correcting an evaluation error. Unavailable Phenix scores had been recorded as zero, so the previous analysis retained only 711 cases. The other 813 cases had at least one failed Phenix evaluation. We corrected missing-score handling and structure-file formatting/chain identifiers, then repeated the comparison with the same 3 Å matching radius. Model weights, predictions, and coordinates were unchanged.
All 1,524 cases now have valid evaluations for each input. Success is defined as a nonempty prediction with positive Phenix sequence match: all four inputs yield a nonempty prediction with a positive sequence match for every case; this does not establish complete or accurate structure recovery. The case-equal means are:
| Input map | Residue accuracy ↑ | Sequence match (%) ↑ | Sequence score ↑ |
|---|---|---|---|
| Experimental | 0.588 | 85.1 | 0.786 |
| ChimeraX molmap | 0.478 | 83.0 | 0.824 |
| CryoNet molmap | 0.496 | 84.1 | 0.835 |
| CryoNet.Density | 0.629 | 92.8 | 0.912 |
CryoNet.Density remains highest in all three metrics. Scores are accepted only after successful Phenix execution and parsing; unresolved evaluations remain missing and block aggregation. Eight previously successful control comparisons retained identical sequence match and sequence score.
Resived in the manuscript: Section 4.4, Table 3 (lines 415–427), and the corrected protocol in Appendix I.4 (lines 2015–2027).
Comment 4: The value of the CryoNet.Density Database is asserted but not demonstrated. No experiment trains or augments a downstream model with the generated maps. Showing improved performance on held-out experimental data after such training would be much stronger evidence of the resource’s impact.
We fine-tuned ModelAngelo using CryoNet.Density maps and compared it with fine-tuning on physically rendered maps. Both models were evaluated on the same 60 held-out experimental maps at 3–6 Å.
Both training sets contain 863 structures at seven resolutions (3–6 Å in 0.5 Å intervals), giving 6,041 maps per set. They use identical atomic coordinates and grids. We initialized both models from the official ModelAngelo checkpoint and fine-tuned the full GNN for 10,000 AdamW steps at a learning rate of 10⁻⁶, using the same loss and number of training graph crops. CNN and ESM-1b parameters remained fixed. Evaluation used the same CNN candidate points, ESM features, three GNN iterations, sequence assignment, and pruning.
The official model is the common baseline (O). Values are percentages; Δ denotes percentage-point changes calculated before rounding. The first four metrics are averaged across cases; the remaining metrics combine residue counts across cases.
| Metric ↑ | Official (O) | Generated (G) | ΔG−O | Physical (P) | ΔP−O |
|---|---|---|---|---|---|
| Cα precision | 88.45 | 93.51 | +5.07 | 87.84 | -0.61 |
| Cα recall | 42.31 | 45.97 | +3.67 | 33.23 | -9.08 |
| Cα F1 | 50.10 | 53.71 | +3.60 | 40.23 | -9.87 |
| Sequence recovery | 40.32 | 43.83 | +3.51 | 31.22 | -9.10 |
| Pre-pruning residue accuracy | 53.07 | 56.60 | +3.53 | 43.40 | -9.67 |
| Final end-to-end macro-F1 | 50.56 | 53.69 | +3.13 | 39.18 | -11.38 |
Training on CryoNet.Density maps increased Cα F1 from 50.10% to 53.71%, sequence recovery from 40.32% to 43.83%, and end-to-end macro-F1 from 50.56% to 53.69%. Training on physically rendered maps gave lower scores. These results show that the generated maps improve ModelAngelo's performance on experimental data. Residue accuracy measures amino-acid classification among matched residues; end-to-end macro-F1 also accounts for missing and incorrectly predicted residues.
The test set contains 60 cases: 39 at 3–<4 Å, 18 at 4–<5 Å, and three at 5–6 Å. We required CC_mask ≥ 0.5, Cα coverage ≥ 0.95, and compatible map sampling, and excluded sequence overlap with the fine-tuning data. The 60 PDB entries also have no ID overlap with ModelAngelo training set. Predicted and reference Cα atoms were matched one-to-one within 3 Å without rigid-body fitting; valid empty predictions received zero recovery.
Revised in the manuscript: Section 4.4, Table 4 (lines 447–462); training and evaluation details in Appendix I.4.1, Tables 19–20 (lines 2029–2115). The improvement is also stated in the Abstract (lines 27–28) and Conclusion (lines 534–535).
Overview and experimental variability
OVERALL RESPONSE:
Your suggestions led us to compare repeated reconstructions, evaluate local map agreement, and add a conditional-diffusion baseline. The revised manuscript includes four main results:
1. Improved downstream performance with stronger evaluation. On 60 real maps, generated-map fine-tuning improves ModelAngelo Cα F1 from 50.10% to 53.71% and sequence recovery from 40.32% to 43.83%. The corrected frozen-model comparison now includes all 1,524 cases, preserving the leading ranking (Weakness 2 , Question 3; Tables 3–4, lines 415–427 and 447–462).
2. CryoNet.Density generated maps agree better with local experimental density. We compared generated and physically rendered maps with six experimental references and tested resolution values absent from training. CryoNet.Density achieved higher local PCC at five of six reference points*and the best performance in six of seven metrics on the 17-case unseen-resolution test set (Question 2; Tables 16–17, lines 1806–1816 and 1958–1978).
3. CryoNet.Density outperforms standard conditional diffusion. We trained a conditional DDPM with the same network architecture and compared several sampling step counts. CryoNet.Density achieved Map CC 0.774 versus 0.642 for the best DDPM setting, using two rather than ten network evaluations (Question 4; Table 32, lines 2896–2912).
4. Repeated reconstructions quantify the variation in generated maps. We compared five experimental reconstructions with 20 generated samples at fixed structure and resolution. The mean maps had PCC 0.801, while the generated samples showed less variation than the experimental reconstructions (Question 1; Table 29, lines 2594–2623).
We first compare generated samples with repeated experimental reconstructions, then discuss resolution control, downstream performance, and the conditional DDPM baseline.
Comment 1: For structures with several independent experimental reconstructions, how does the spread of generated samples compare with the spread across those reconstructions?
Response: We compared all five PDB-6knf/EMD-0730 particle-subsampled reconstructions at 4.57 Å with 20 generated samples. Coordinates, resolution, physical input map, grid, and molecular mask were fixed. All PDB-6knf entries belong to validation. Voxel variance uses the n−1 denominator; map pairs that share a reconstruction are not independent.
CryoNet.Density generated maps have 3.85% of the experimental voxel variance, and the two variance maps have PCC 0.090. Standardizing each map separately gives a variance ratio of 7.92% and variance-map PCC 0.091. The mean maps have PCC 0.801. Thus, generated maps agree with the average experimental density but vary less than the repeated reconstructions. These are reconstructions from one parent dataset, and particle-subset overlap is unrecorded.
The other sampling analyses address where these differences occur. Across 1,923 cases, the experimental-minus-rendered residual has median neighboring-voxel correlation 0.635 and fraction of residual squared density inside the molecular mask 0.845. On 96 structures, phase randomization preserves the power spectrum but reduces gradient alignment 0.4611 → −0.0002 and curvature alignment 0.5512 → −0.0001 (Tables 30–31, lines 2722–2759; Figure 23).
For five samples of each of three structures, molecular-region PCCs are 0.9939–0.9947. The region contains 78.9%–92.5% of sample variation, with variance 26.3–42.8 times the background variance. Full-volume PCCs to each structure's experimental reference are 0.828191 ± 0.000170, 0.828770 ± 0.000263, and 0.793743 ± 0.000156 (mean ± standard deviation across seeds). These results show consistent experimental-map agreement across samples, with local density variation (Table 28, lines 2533–2544; Figure 21).
CryoNet.Density generated maps also retain recognizable structural features: frozen ModelAngelo residue accuracy improves 0.496 → 0.629 and sequence match 84.1% → 92.8% over 1,524 cases; Emap2sec+ helix F1 improves 0.595 → 0.733 over 136 cases (Tables 2–3, lines 408–427).
Revised in the manuscript: the direct reconstruction comparison is in Appendix J.4.1, Table 29 and Figure 22 (lines 2594–2623); complementary analyses are cited above.