- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes HeteroGauss, a heterogeneous cryo-EM reconstruction method built on a shared set of anisotropic Gaussians conditioned on particle state. Each particle is assigned an inferred latent state, and the position, scale, orientation, and amplitude of every Gaussian depend on that state. This allows a single representation to capture both conformational and compositional heterogeneity. Learnable spatial anchors coordinate local deformations. An adaptive topology mechanism clones, splits, and prunes Gaussians according to reconstruction gradients and state-dependent motion. The authors also implement a batched differentiable CUDA renderer for efficiency.
Experiments cover three CryoBench datasets (IgG-1D, IgG-RL, and Ribosembly) and one experimental dataset (EMPIAR-10180). HeteroGauss reports the highest mean AU-FSC across the three synthetic benchmarks, and the authors show sharper high-frequency detail on the experimental data. Ablations examine anchor-based deformation, adaptive topology, amplitude modulation, and frequency-weighted reconstruction.
Critical strengths
- A flexible Gaussian representation that handles both kinds of heterogeneity.
HeteroGauss keeps a shared set of Gaussians with fixed correspondence across states, while letting their geometry and amplitude change with the latent state. This lets one representation cover both conformational and compositional heterogeneity. Learnable anchors allow local deformations, and adaptive topology adds capacity to regions that are hard to model. Overall, this is a sensible direction for heterogeneous cryo-EM reconstruction.
- Strong benchmark results, supported by ablations.
HeteroGauss obtains the highest mean AU-FSC on all three CryoBench datasets, with clear margins on IgG-1D and IgG-RL. On EMPIAR-10180, it shows better high-frequency agreement than RECOVAR. The ablations indicate that several components improve reconstruction quality, and adaptive topology gives the most consistent gains.
Critical weaknesses
- No comparison with the closest Gaussian-based heterogeneous reconstruction methods.
The core of HeteroGauss is a shared Gaussian representation whose geometry and amplitude depend on the latent state. Yet the main quantitative comparisons leave out the most closely related methods, notably CryoSPIRE and e2gmm, both of which use Gaussian representations for heterogeneous reconstruction.
CryoSPIRE is the most important omission. It also uses state-dependent Gaussians coordinated by anchors. The authors distinguish HeteroGauss from it by pointing to anisotropic covariances and adaptive spatial capacity, but provide no experiment showing that these differences actually lead to better results.
The comparisons with CryoDRGN, RECOVAR, 3DFlex, and other established methods are useful, but they do not show what HeteroGauss adds over its nearest neighbors. Because several components build on existing Gaussian representation and deformation techniques, a direct comparison is needed to judge both the novelty and the size of the empirical gain.
- Limited evidence that the learned heterogeneity is correctly attributed, and limited experimental validation.
The paper claims that one Gaussian framework can represent both conformational and compositional heterogeneity. The reconstruction results are strong, but the experiments do not test whether the learned geometry and amplitude changes correspond to the true structural changes.
Geometry and amplitude are optimized jointly through the reconstruction loss, and nothing in the model explicitly separates them. Amplitude changes could therefore compensate for errors in deformation, and deformation could in turn absorb variation that is actually compositional.
The supplementary Ribosembly analysis shows that amplitude changes are spatially correlated with compositional differences. A spatial correlation, however, does not measure attribution accuracy, nor does it reveal how much the two mechanisms interfere with each other. Synthetic experiments with known motions and known density changes would answer this directly.
On the experimental side, quantitative results cover three synthetic CryoBench datasets, and real-data validation is limited to EMPIAR-10180. The high-frequency improvements there are encouraging, but more experimental datasets are needed to show robustness across molecular systems, heterogeneous states, and imaging conditions.
In short, the paper shows strong reconstruction performance, but offers less support for its broader claims that the representation is physically meaningful and generalizes well.
Questions for authors
Q1. How does HeteroGauss compare with CryoSPIRE and e2gmm?
Could the authors compare against both under the same fixed-pose protocol? CryoSPIRE in particular also uses state-dependent Gaussians coordinated by anchors, so this comparison is the clearest way to show what anisotropic primitives and adaptive topology actually add.
Q2. Can the authors directly test whether geometry and amplitude capture the intended mechanisms?
The Ribosembly analysis shows that amplitude changes align spatially with compositional differences, but it does not show that each mechanism captures only what it is meant to. Using synthetic data with known motions and known density changes, how accurately are each recovered, and how much does one leak into the other?
Q3. Do the gains from adaptive topology come from better allocation or simply from more Gaussians?
Adaptive topology gives large improvements in the ablations, but it likely also changes the final number of Gaussians. How does it compare with a fixed-topology model that has the same final count? This would separate the effect of state-aware allocation from that of added capacity.
Q4. What is the end-to-end benefit of the batched CUDA renderer?
The supplementary material reports higher rendering throughput than per-particle processing, but faster rendering does not necessarily mean proportionally faster training. Could the authors report total training time and peak GPU memory, alongside representative baselines?
Q5. How reliable are the improvements on experimental data?
On EMPIAR-10180, were masking, half-map reconstruction, and post-processing identical for all methods? Do the high-frequency gains over RECOVAR hold across random seeds, and on other experimental datasets?
4 comments
Response to reviewer qLTi (Part 2/2)
Q3
We already considered the impact of the number of Gaussians when designing our ablation study. The none-topology model uses the same number of Gaussians as the adaptive model has after topology adaptation. The counts are 12,803 for IgG-1D, 12,034 for IgG-RL, and 32,293 for Ribosembly. With the counts matched, the improvement comes from topology adaptation.
Q4
Table 4 in Appendix B.2 of the original submission shows that, in the At a fixed batch size, reducing rendering time per batch increases the number of particles processed per second by the same factor. The speedup calculated from rendering time therefore equals the speedup calculated from throughput. Revised Table 5 reports both measures.
Furthermore, to further address your concern, we have added a comparison with cryoDRGN, one of the most widely recognized baselines, in Table 6 of the revised appendix, reporting time per epoch and peak GPU memory. Specifically, HeteroGauss trains faster per epoch on both IgG datasets with similar GPU memory use. Moreover, the difference is even larger on EMPIAR-10180. In particular, at a batch size of 128, HeteroGauss trains successfully while cryoDRGN runs out of memory. Even so, HeteroGauss still takes less time per epoch and uses less GPU memory than cryoDRGN at its reduced batch size of 64. The details can be found in Appendix B.3.
Training efficiency (revised Table 6).
| Dataset | Method | Batch size | Mean time (min/epoch) | Peak GPU memory (GiB) |
|---|---|---|---|---|
| IgG-1D | HeteroGauss | 128 | 4.46 | 15.73 |
| IgG-1D | cryoDRGN | 128 | 5.08 | 14.59 |
| IgG-RL | HeteroGauss | 128 | 4.30 | 14.83 |
| IgG-RL | cryoDRGN | 128 | 5.09 | 14.59 |
| Ribosembly | HeteroGauss | 128 | 36.98 | 38.75 |
| Ribosembly | cryoDRGN | 128 | 16.99 | 14.62 |
| EMPIAR-10180 | HeteroGauss | 128 | 13.82 | 27.50 |
| EMPIAR-10180 | cryoDRGN | 64 | 54.37 | 34.67 |
Q5
On EMPIAR-10180, HeteroGauss and RECOVAR in Fig. 4D use the same particle partition, soft mask, and frequency grid, while independently reconstructing the half-maps with their respective methods. Similarly, the visualizations in Fig. 4A adopt the same filtering and density display threshold, with the detailed procedure provided in Appendix B.1 of the revision. Furthermore, the two half-map models were trained with different random seeds, so the experimental setup itself already avoids perturbations caused by random seeds. In addition, because preprocessing experimental data, training the half-map models, and evaluating the results are extremely time-consuming, we could not complete further validation during the rebuttal period, but we will supplement results on additional experimental datasets in future work.
Once again, we appreciate the time and effort you spent helping us refine this work, hope our responses have addressed the points you raised, and look forward to your response.
Thank you to the authors for the experimental results and the response; they have addressed my concerns, and I will adjust my score accordingly.
Thank you for your recognition of our work and for raising your score. We are grateful for your thoughtful suggestions, which helped shape the additional experiments and strengthen the paper.
Response to reviewer qLTi (Part 1/2)
Thank you for your thoughtful review and for asking how the learned Gaussian changes relate to the underlying heterogeneity and how the gains were validated on experimental data. We respond to the concerns you raised in the following sections.
W1 and Q1
CryoSPIRE. CryoSPIRE is a strong contribution to the field. Unfortunately, its code remains unavailable, and we did not receive a response to our email requesting it, so we left it out of our original experiments. The hardware configurations also differ, which prevents a direct comparison with the results in their paper. To address this question, we reimplemented CryoSPIRE from the paper and ran it on CryoBench. Because the exact experimental settings were unavailable, the numbers reflect our reimplementation under the settings we used. We report them in Appendix B.5 to address your question. The reimplementation scored below both HeteroGauss and the results reported in the CryoSPIRE paper. We attribute the gap to CryoSPIRE's sensitivity to the initial Gaussian parameters. The detailed initialization settings were unavailable. This comparison highlights the advantage of starting from randomly initialized Gaussian parameters in HeteroGauss. The details and visual results can be found in Appendix B.5, or just click here.
CryoBench AU-FSC for the CryoSPIRE reimplementation (revised Table 8).
e2gmm. e2gmm uses reconstruction gradients from the consensus stage as input to its encoder. This makes learning unstable when heterogeneity involves large motions and limits its sensitivity to complex motions. For this reason, we did not use it as a baseline in our main CryoBench experiments. To test this behavior, we also ran e2gmm on IgG-1D and report the results in Appendix B.5. Even with a carefully prepared initialization model, e2gmm did not recover plausible structures across the large rotation in IgG-1D. The details and visual results can be found in Appendix B.5, or just click here.
e2gmm comparison on IgG-1D (revised Table 7).
W2 and Q2
Figure 6 in Appendix B.4 of the original submission shows that, with Gaussian centers fixed, amplitude changes alone recover the main regions of ground-truth density change in Ribosembly.
To address your doubts, we added a quantitative analysis of Gaussian motion on IgG-1D. Figure 9 in Appendix B.6 of the revision directly compares the motion of the Gaussian centers with the known Fab rotation in IgG-1D. The mean absolute angular error is 9.92°, in line with the expected motion. You can also click here to view the visual results.These results support the use of amplitude changes to recover compositional differences and of geometric changes to recover domain motion, respectively.