- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CryoHyper is a method for recovering continuous conformational heterogeneity from cryo-EM and cryo-ET datasets. It decomposes the deformation of a reference atomic structure into global and local components, predicted from learned hyperbolic and euclidean latent spaces. The method is validated on a synthetic and two real datasets, demonstrating good conformation space organization and volume reconstruction.
Critical strengths
The recovered latent spaces have a nice continuous structure (e.g. Figure 2b) compared to the baselines, which could be helpful for interpretation in biological workflows. This is supported by improved information imbalance and neighborhood similarity metrics. Additionally, the method is demonstrated to recover heterogeneity from two real datasets (Figures 4 and 5), showing its applicability to experimental settings.
Critical weaknesses
The single-particle benchmark could be better designed. In particular, AD-FSC, BP-FSC, Map-CC, and SSIM all compare method-derived outputs to each other (e.g. structure vs map for AD-FSC), and are thus measures of self-consistency rather than correctness. These numbers cannot really be compared against the baselines. A compelling evaluation would include a standard synthetic data benchmark such as CryoBench, which is partially tested in the supplement. Reconstructed maps should be compared to GT maps in addition to latent space metrics. IgG-1D/IgG-RL could be useful to demonstrate on manifolds which do not expect to show U-shaped manifolds as in the 3 main datasets.
The motivation in the intro (e.g. "continuous paths should follow ordered structural changes") feels too strong. In particular, the demonstrated PC1 trajectories only capture directions of variation, not biophysically meaningful paths (which might be inferred by tracing low energy pathways through an estimated free energy landscape). And latent distances may be more correct in a ranking sense but the nonlinear encoding process can still distort distances if I understand the method correctly. Accordingly, the main contribution here is that a hyperbolically structured latent space can improve latent inference.
Questions for authors
- Can you clarify the claim of "making latent distances more faithful to structural relationships between conformations"?
- In Figure 3A, it appears that CryoHyper performs poorly relative to the baselines in a very local neighborhood (<5%) despite its stronger performance for large radii. Can you explain this?
- The UMAPs in Figures 2,4, and 5 all have the same general shape. Is this a coincidental property of the data, or a bias of CryoHyper? Should we expect the method to work for more complex continuous manifolds?