- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper proposes a novel cryo-EM reconstruction method leveraging AlphaFold's hidden-state to provide informative protein-structure priors during reconstruction, rather than relying on volumetric priors. A key novel component of the proposed method is using this prior not only for the final density reconstruction, but as a prior during the EM-like iterations which alternate the nuisance variable estimation (poses and class assignments) with the density reconstruction.
Critical strengths
The paper tackles an important problem with well motivated and quite ideas. The proposed method is thoroughly evaluated over synthetic and real data, with and without available poses (ab-initio) and in both homogeneous and heterogeneous settings. The experimental section shows promising results, in particular the high data-efficiency with respect to previous classical and deep learning methods.
Critical weaknesses
Unfortunately, I found different parts of the manuscript difficult to parse. While the manuscript is fairly well written, some parts of the presentations could be significantly improved.
First, the authors often introduce variables and equations in the prose without previously defining all terms. While their meaning is often possible to infer with more context, after reading the rest of the section, this makes the manuscript much harder to parse. I think this offers an opportunity to significantly improve the presentation and the accessibility of the paper.
On a similar note, I struggled to get the full picture of the proposed method until the end of the manuscript, as the main idea is spread through multiple pages. Algorithm 1 summarizes the method but is pushed at the end of the appendix, could be moved to the main paper? Also Fig. 1 is supposed to give a schematic overview of the method at the beginning, but I didn't find it very useful. For example, I struggled to connect it with the (already unclear) equations in the text. Defining clearly each variable at the beginning and placing them in the figure to clarify each component's input/output would help clarifying the whole picture. Where do step 1 and step 2 from Sec. 3 fit exactly in this diagram? How are the subfigures (A) and (B) connected? Also, subfigures (C) and (D) currently look like the outputs of (A) and (B), which is confusing: maybe this figure could be split in two separate ones?
Questions for authors
Sec 2: what is ? what is ? and ? these variables are used without being previously defined. I see some get defined only in Sec 3.1.
What is the "experimental data term" in Eq. 2? the variable doesn't appear in Eq. 2. Did you mean instead of maybe? it seems you often make use of some overloaded notation with no explanation.
End of page 5: what is exactly? this variable was never defined before. Is it the ground truth density for a single class? what is ? is it the same as just in the previous text? Also, maybe the unnumbered equation at the bottom is obvious, but a short derivation (in the appendix) would make the manuscript much easier to understand.
I am not sure I fully get the point of the conclusion of Sec 2: is this argument suggesting tracking also the covariance (rather than just a single consensus map) of the reconstructed density? In the conclusions, it is state that "under pose or class uncertainty, a consensus density need not be a sufficient statistic"; maybe this could be framed as a stand-alone theorem with a rigorous proof referenced in the main manuscript? I wonder if presenting this argument as part of the prose, as currently done, is the clearest choice. Also, I might be missing a step: why is this necessary an argument in favor of particle-domain inference rather than density maps (plus the missing sufficient statistics)?
Sec 3.1: why not using methods like RELION for ab-initio pose estimation?
Can you number of equations? even if not referenced directly int he paper, it makes it easier to refer to them when discussing the paper.
4 comments
Particle-domain fitting
This comment addresses the reviewer's remaining question: whether the argument at the end of Sec. 2 calls for tracking a covariance, whether it can be stated as a theorem, and why it favours particle-domain inference over a density augmented with the missing statistics.
When the classes are known, as in the scalar example of Sec. 2, a mean and a second moment are indeed sufficient. Below, we give a proposition and proof sketch showing that this no longer holds in the more general case of joint pose and class uncertainty.
Model
Consider two equally populated states,
where is the consensus (what a homogeneous reconstruction estimates) and is the class deviation.
The scalar analogue of the imaging model is
where
- is the unobserved class, uniformly distributed;
- is the unobserved pose;
- is the observation noise.
We define as the residual against the consensus, as in B-RECOVAR.
Proposition
For any and , the following statements hold.
(i) The consensus carries no information about the class deviation.
\qquad\text{for every }\delta,$$ and $$\frac1K\sum_{k=1}^K r_k\longrightarrow0 \quad\text{almost surely}.$$ Thus, the consensus cannot recover $\delta$, however many particles are averaged. **(ii) The second moment identifies the magnitude of the deviation.** $$\mathbb E[r_k^2]= \sigma^2+\tau^2 \bar\rho^2+(1+\tau^2)\delta^2.$$ Consequently, a single second moment identifies $|\delta|$. **(iii) No continuous statistic with fewer than $K$ components is sufficient for $\delta$.** In particular, neither a mean together with a covariance nor any fixed number of moments is sufficient when both the class and pose are unobserved. **(iv) With known classes, a fixed-size sufficient statistic exists.** For $\tau=0$, the statistic is $$\sum_k c_k r_k.$$ For $\tau>0$, the four per-class sums of $r_k$ and $r_k^2$ are sufficient. ### Proof sketch **Parts (i) and (ii).** Both follow from direct moment computation, using $$\mathbb E[c_k]=0,\qquad \mathbb E[\phi_k]=1,\qquad \mathbb E[\phi_k^2]=1+\tau^2.$$ **Part (iii).** Marginalizing over the unobserved class gives $$\log p(r\mid\delta)=E(r,\delta)+\log\cosh O(r,\delta),$$ where $E$ and $O$ are the even and odd parts in $\delta$ of the class-conditional Gaussian log-density, each quadratic in $r$. Since every nonconstant even Taylor coefficient of $\log\cosh$ is nonzero (as follows from its Bernoulli-number expansion), we obtain $$\log p(r\mid\delta)=\ell(r;\bar\rho)+\sum_{n\geq1}q_n(r)\delta^{2n},$$ where $q_n$ is a polynomial of exact degree $4n$ when $\tau\bar\rho\neq0$, and $2n$ when $\tau\bar\rho=0$. If two samples $\mathbf r$ and $\mathbf s$ have a likelihood ratio that is constant in $\delta$, then $$\sum_k q_n(r_k)=\sum_k q_n(s_k) \qquad\text{for all }n.$$ Now consider the map $$\Psi(\mathbf r)=\left(\sum_k q_1(r_k),\ldots,\sum_k q_K(r_k)\right).$$ Its Jacobian is $$D\Psi(\mathbf r)=\left[q_n'(r_k)\right]_{n,k=1}^K.$$ Because the polynomials $q_n'$ have distinct degrees, this Jacobian is nonsingular at some point. Hence $\Psi$ is locally injective on an open set. Any continuous sufficient statistic $S:\mathbb R^K\to\mathbb R^M$ must therefore also be injective on that set. For $M<K$, this contradicts invariance of domain. **Part (iv).** With known classes, the likelihood belongs to a per-class Gaussian exponential family, admitting the stated fixed-size sufficient statistics.We address the reviewer's three questions using the proposition above. Recall that denotes the consensus of the two states , where is their deviation from the consensus. We write for the residual of particle , and for the variance of the unobserved pose factor. References to (i)–(iv) below are to the corresponding parts of the proposition.
1. Covariance
We agree that tracking a covariance can recover information lost by averaging. In the two-state setting, Proposition (ii) shows that the second moment identifies , provided the noise and pose variances are known. This is the principle underlying RECOVAR and B-RECOVAR, which we use for initialization. However, identifying the magnitude of the deviation is not equivalent to retaining all the information in the particle likelihood. Proposition (iii) shows that, when class assignments are unknown, no continuous statistic of fixed dimension is sufficient as the number of particles grows. Notice that this difficulty is not simply due to pose uncertainty: Proposition (iv) shows that fixed-size sufficient statistics exist when the classes are known, even with pose noise. Hence, it is the uncertainty in class assignments that prevents such a finite-dimensional summary in this model.
More specifically, consider the expansion of the marginal log-likelihood around . We denote by the coefficient of in the contribution from particle . When , this coefficient is a quartic polynomial in . Thus, the leading nonconstant term of the full likelihood, , already depends on statistics beyond the mean and covariance. For three or more states, the limitation is more apparent, since the first two moments generally do not determine the individual states.
2. Proposition
We agree with the reviewer that the argument at the end of Sec. 2 would benefit from a formal statement. We have therefore formulated the proposition above, which distinguishes three questions: what information is retained by the consensus (i), what can be recovered from the second moment (ii), and whether these summaries are sufficient for inference when the latent variables are unknown (iii–iv). We will replace the corresponding discussion in Sec. 2 with this proposition and provide the full proof in a new appendix of the camera-ready version.
We have also revised the conclusion to reflect this distinction more precisely: "when poses or classes must be inferred, averaging the particles into a consensus density can discard the information needed to infer them together with the structure."
3. Why particles
Our motivation for working directly with particles is both theoretical and practical. First, Proposition (i) shows that the consensus is independent of the class deviation in the two-state model. In particular, the mean residual converges to zero regardless of . Notice that collecting more particles does not resolve this limitation: the consensus becomes more accurately estimated, but the deviations of the two states continue to cancel. We observe a corresponding limitation experimentally in Fig. A2. For 8U4E with 500 particles, consensus-map guidance reaches 17.95 Å Cα RMSD, compared with 6.88 Å for Fold'EM.
Second, although additional statistics such as a covariance can preserve information about heterogeneity, they must be estimated using the current pose and class assignments. This creates a difficulty for joint inference: as the atomic structure improves, these assignments may change, and a summary computed using earlier estimates may no longer be appropriate. In Fold'EM, we instead return to the individual particle images and refine the poses and classes against the current atomic model at each iteration (Step 2 of Sec. 3.2). Hence, improvements in the structure can inform the nuisance-variable estimates, which in turn provide better information for the next structure update. This is particularly relevant when few particles are available, since estimating a reliable voxel-wise covariance is itself challenging.
We do not claim that density-based inference is inherently inadequate, or that a density supplemented with sufficiently rich statistics could not support joint inference. Rather, our argument is that a single consensus density is insufficient, while retaining the particles allows the structure and latent variables to be refined together without committing to a fixed summary computed from earlier estimates.
I thank the authors for the detailed answers.
Regarding the last answer, I understand the point now thanks. I wonder now to what extent this is a novel results and what was already understood. The fact consensus alone is not a sufficient statistic seems now almost obvious to me.
I will maintain my positive recommendation as I find the idea interesting and I see value in the proposed approach; still, I strongly suggest the authors to rework the presentation in the manuscript to make it more accessible.
We thank the reviewer for the careful reading. The points below are addressed in the revised manuscript, with all changes highlighted in red. The question on the conclusion of Sec. 2 needs a longer answer, which we give in a separate comment.
1. Overview of the method, Algorithm 1 and Fig. 1. We have added a compact summary of the procedure to Sec. 3.2 (Algorithm 1), showing the initialization, the alternation between structure inference (Step 1) and nuisance refinement (Step 2), and the final decoding, with references to the corresponding equations. The full pseudocode, including the guided reverse-diffusion loop, remains in Appendix D (Algorithm 2). Regarding Fig. 1: panel (A) shows the whole of Algorithm 1, namely the initialization of poses and classes followed by the alternation of Step 1 and Step 2; panel (B) zooms into Step 1, showing how the particle likelihood is back-propagated into the intermediate Pairformer state H; panels ( C ) and (D) are an example result (PDB 9B9J). We have revised the caption to state this explicitly and to explain the labels used in the figure and updated panel (B) to include the notation
2. Undefined symbols in Sec. 2 (a, ∣a∣, s, z). We have revised the Notation paragraph of Sec. 2 so that every symbol is defined at its first use. a is the AlphaFold3 input specification (polymer sequences and any ligands), and ∣a∣ is its number of tokens: one per standard residue or nucleotide, and one per atom for ligands and modified residues. s∈R∣a∣×cs and z∈R∣a∣×∣a∣×cz are the single (per-token) and pair (per-token-pair) representations produced by the Pairformer trunk.
3. The data term L(Z) and overloaded notation. We apologize for the ambiguity. Calligraphic symbols denote ensembles and bold symbols their members: X={Xj}j=1n, H={Hj}j=1n, and Z=g(H)={g(Hj)}j=1n, with g applied member-wise. The learned-geometry analysis concerns a single ensemble member j, with Z=g(H) (superscript j dropped). L(Z) is that member's contribution to the experimental data term of Eq. 2 (Eq. 3 in the revised manuscript), i.e. the expected log-likelihood of the particles assigned to it: L(Z)=∑k: ck=jEX∼p(X∣Z)logp(yk∣X,ϕk)
Particles assigned to other members do not depend on Z, so L differs from the full data term only by a constant, and the two have the same gradients. The text now gives this definition explicitly.
4. Definition of ρ and derivation of the particle/density identity. ρ denotes the (voxelized) Coulomb potential, or density, of a single conformation, i.e. the object imaged in the particles of one class. For an atomic model X, its density is ρX, defined in Appendix E.3. The previous notation ρ(H) was shorthand for ρX with X∼p(X∣g(H)); because the decoder is stochastic, we now write ρX explicitly. The identity holds for every density ρ, hence for every sample X, and therefore also in expectation over X. We have clarified both points in Sec. 2 and added a complete derivation in a new Appendix E.4. It expands both quadratics and shows that Qρ~=q also when Q is singular, e.g. because of CTF zeros or missing views, so the two sides differ by a constant independent of ρ. The derivation also gives this constant explicitly: it is the particle misfit of the reconstruction ρ~, 21∑k∥yk−Akρ~∥Σk−12, which depends only on the data.
5. RELION for ab initio pose estimation (Sec. 3.1). We do use RELION: VDAM, the initialization step in Sec. 3.1, is the ab initio algorithm of RELION-4.0 [Kimanius et al. 2021], run as
relion_refine --grad --denovo_3dref(Appendix E.2). We have revised Sec. 3.1 to state this explicitly. The resulting poses are then refined jointly with the structure (Step 2 of Sec. 3.2).6. Equation numbers. All display equations in the main text and appendix are now numbered.