- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes CryoFATHOM, a generative approach that reconstructs a 3D density map from sparse, posed multi-view cryo-EM particle images using a conditional flow-matching model. Conditioned on patch-wise features of the projection images and their orientations, the model estimates the velocity field that transports Gaussian noise toward the target density volume. The model is trained on a synthetic dataset of 850 molecules collected from the PDB after sequence-based deduplication, and is evaluated on 75 held-out molecules. Experiments show that CryoFATHOM achieves the best performance with few input images (k = 4–64), whereas the baselines outperform it as the number of images increases (k ≥ 128). Ablation studies confirm the need for orientation information and show the impact of the patch size.
Critical strengths
- This paper tackles a challenging task in cryo-EM, and the approach is technically sound. In particular, it proposes a novel way to combine image features and orientation features as conditions that guide the generation of the final estimated volume. On the synthetic dataset, the results are compelling when only a few input views are available.
- The evaluation protocol on the synthetic dataset is reasonable, with multiple training seeds and reported variance.
- After a careful reading, I find the pipeline reproducible.
Critical weaknesses
-
Ideal settings may lead to no real-world applications. Though the table 1 has shown the strength to learn a geometry prior of the density map when the input view is sparse on the held-out synthetic data, there is no evidence the same pipeline can generalize to the real-world dataset. For example, the image poses of the cryo-EM is very hard to obtain given sparse inputs, the refinement of poses are essentially equivalent to the refinement of density volume, it is nearly impossible to get the perfect poses without a high-quality reconstruction. This main concern leads me to has a low expectation that this approach can make real impact at the current form. I would like to suggest the author discuss how can we further remove the need for precise poses such as making a pure ab-initio pipeline like cryoDRGN-AI or CryoFastAR, it may make a lot of sense to me. Nevertheless, the resolution of density volume achieved currently is still quite low even for ab-initio reconstruction.
-
Hallucination is not analyzed. Structural biology depends on recovering reliable, reproducible structures from raw data, so a generative prior should be used conservatively, with theoretical and experimental analysis of whether it hallucinates and how to detect or avoid it. The paper only measures the sharpness–fidelity trade-off in aggregate (Table 8) and never discusses hallucination, uncertainty or failure detection. Figure 11 shows the risk: at the classical methods fail visibly, whereas CryoFATHOM returns clean, apparently high-resolution maps that can be wrong. For 6LHT, all samplers produce a compact body with a single apex instead of the true core with peripheral protrusions, yet App. J states that the model “usually” matches the ground truth and never analyzes the exceptions. Whatever the causes (e.g., dataset or training limitations), such confident failures are hard to detect without ground truth.
Minor points:
-
Figure 2 shows patchification before CNN feature extraction, whereas the method section (Sec. 4.2) and Table 5 describe the opposite order. Please clarify which order is used.
-
The Introduction devotes considerable space to potential future applications, none of which are supported by experiments on real data. I suggest substantially shortening this discussion, or moving it to a brief outlook in the Conclusion, so the paper stays focused on what it actually demonstrates.
-
The word “tomography” in the title may mislead readers. The task addressed here is single-particle analysis (SPA), or cryo-EM reconstruction more broadly, whereas “tomography” usually implies cryo-electron tomography (cryo-ET). I recommend revising the title to describe the setting accurately.
Questions for authors
Please see the weakness section, how can CryoFATHOM expand to the real-world applications with a more thorough hallucination analysis?
2 comments
I thank authors' feedback. But I have to decide to keep my score as the quality of this paper, in my perspective, is below the bar of a solid machine learning application paper in the cryo-EM field. The main reason leading to this is the lack of the real-world impact and the poor paper writing logistics. I encourage the authors explore more meaningful applications including sparse view SPA ab-initio reconstruction and cryo-ET sub-tomo averaging in the generative and feed-forward way. For the technical paper writing, please consider focusing on your precise contribution of your work instead of talking potential applications without direct experiments.
We thank the reviewer for their time and careful reading.
We first frame our view of this work. To the best of our knowledge, this is the first work that learns a prior over 3D densities across many molecules and that can reconstruct molecules it has never seen without any inference-time optimization. If the reviewer agrees, we kindly ask to treat this paper as a proof of concept with significant conceptual & technical novelty (see the table at page 3) and not as a finished product, as such it certainly has limitations as the reviewer pointed out. Nevertheless, we believe this kind of work is of interest to the ICLR audience.
W1 - “Ideal settings may lead to no real-world applications. [...]”
We agree that assuming good pose estimates for sparse inputs is unrealistic in some settings, yet we would like to motivate potential applications with the following examples: (i) In continuous heterogeneity analysis the poses are often estimated from the whole dataset, which allows good estimates up to the errors caused by conformational changes, but each conformation is then reconstructed from far fewer images. (ii) Cryo-ET, where the tilt angles of each series are recorded, is another potential application. We agree that the paper should describe the potential applications better. We revised the introduction accordingly (lines 87-99). We also agree with the reviewer's suggestion that ab-initio reconstruction is an excellent direction for future work. Our method is currently positioned downstream of pose estimation. We added this direction to the future work section (lines 512-514).
We also added an analysis of robustness to pose estimation errors (Section 6.2, lines 450-457 and Figure 4; details in Appendix H). Every method (CryoFATHOM, CG and RELION) receives the same poses, perturbed by realistic errors based on reported pose accuracies, or by a pessimistic setting twice as large. All methods degrade, yet we were happy to see that CryoFATHOM is the most robust and thank the reviewer for motivating such an experiment which strengthens the paper. For example, at k = 16 realistic errors cost CryoFATHOM 0.9% of its FSC resolution, against 2.9% for CG and 3.4% for RELION.
W2 - “Hallucination is not analyzed. [...]”
Regarding hallucination analysis, we hope the following relieves your concern. While our framework relates to generative models, it is not generative in the literal sense. Like any reconstruction method in an ill-posed regime, some details must be "invented", and this is determined by the prior. Whether our learned prior is riskier than the priors other methods rely on should be evaluated with quantitative metrics, as we do using the Fourier Shell Correlation. We do not claim that our low-k reconstructions can be trusted at every frequency, and the FSC does not support that. We do claim that we capture the low frequencies of the 3D volume, which correspond to the coarse shape, much better than the classical baselines. Our method is no different from any other reconstruction method in this sense: our "hallucinations" come from the training-set distribution, while those of other methods come from their analytical priors. All the methods fail at reconstructing 6LHT at k=8 projection images. We now state in Appendix J (lines 1612-1614) that some reconstructions still miss parts of the shape, naming 6LHT.
M1 - “Figure 2 shows patchification before CNN feature extraction [...]”
Thank you for catching this. This was an error in the figure that we corrected. In the revision (Figure 2, page 5), the CNN is applied now to the whole projection image before the patchification, matching Section 4.2 and Table 5.
M2 - “The Introduction devotes [...]”
We revised the text regarding potential applications (lines 87-99). We devote a single paragraph to these future applications. By placing it in the introduction we are able to motivate the unusual sparse regime with known poses that is the focus of our paper.
M3 - “The word tomography in the title [...]”
Although our method in this paper focuses on single-particle cryo-EM the framework can be used to train models for any tomographic reconstruction task with known poses, including cryo-ET and medical imaging. Hence we believe the title presents the method accordingly.
Q1 - “how can CryoFATHOM expand to the real-world applications [...]”
Regarding expanding to real-world applications, our plan for upcoming work is to analyze real data, for example by pre-training on synthetic data followed by fine-tuning on real EMPIAR data. As for hallucination, we hope our explanation for W2 is satisfactory. For real world reconstructions where ground truth is not available the standard approach in single particle cryo-EM is to use half-map reconstructions and compute the gold standard FSC with the 0.143 threshold.