- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes a method for identifying and localizing proteins to cryo-EM density maps without the need of atomic model. The approach is inspired by CLIP and uses two frozen models: a cryo-EM map encoder and protein language model to create a shared representation. The main contributions are distilled map encoder; soft-target, background-aware, cross-chain contrastive objective with independently controlled negatives; VoxMix, distance-based spatial attention module. The shared representation is used for voxel classification and sequence retrieval. Evaluation on 225 test maps show 65% assignment accuracy and retrieval of at least one correct sequence among the top 20 for 84% of maps. Validation includes feature extractor representation probing and spatial-mixing ablations but lacks direct comparisons with established protein identification and structure building methods. All original maps have resolution between 1.5-3.9A, with lower resolutions simulated by filtering. Furthermore, reference atomic models determine input voxels and assignment metrics score only foreground voxels. The experiments do not establish performance in the intended atomic model free, low resolution application.
Critical strengths
none
Critical weaknesses
- The intended low resolution application is not validated on real low resolution data. The main argumentation for this paper is that the standard approach for identifying and localizing proteins in maps requires building atomic models, which, according to authors, becomes unreliable at resolutions worse than 5A. That said, all tested maps are 1.5-3.9A, with lower resolutions only simulated by filtering the high resolution maps, which does not reproduce the noise and processing characteristics of real data.
- The claim of atomic model free inference is not demonstrated end-to-end. Although the network does not explicitly build an atomic model, the evaluation pipeline uses the reference atomic structure to select its input voxels. The reported metrics additionally score only selected foreground voxels, leaving false protein assignments outside that foreground unmeasured.
Questions for authors
- Could you evaluate the method on real low resolution experiment maps, without using reference atomic models for voxel selection or inference, only for ground truth labels?
2 comments
Thank you for the detailed rebuttal and additional experiments.
The new foreground segmentation experiment substantially addresses my concern regarding atomic-model-free inference. The evaluation on genuine low-resolution maps and comparison with ModelAngelo are also valuable additions.
My main remaining concern is the limited scope of the low-resolution validation. All nine experimental maps are ribosome-related, and only three have resolutions worse than 5 Å. Existing benchmarks such as Emap2sec and Emap2sec+ contain experimental maps spanning 5–10 Å with associated atomic structures.
Regarding novelty, I recognize the value of direct density-to-sequence alignment and the improvements introduced by VoxMix, even if the individual components are largely based on established techniques. My original concerns were primarily about experimental validation rather than methodological novelty.
Overall, the additional experiments substantially address one of my main concerns and provide encouraging evidence for the proposed approach. While the low-resolution validation remains limited, I acknowledge the novelty of the task and the difficulty of evaluating it against existing methods. I will therefore increase my rating from 1 to 2.
We thank the reviewer for their feedback. We have addressed both experimental-validation concerns through new experiments detailed in General Response:
Regarding critical strengths and novelty, we believe the assessment does not fully recognize the following conceptual and methodological contributions:
We do not claim that two-tower learning, attention, or distillation are individually new. Rather, our contribution lies in their formulation for spatially resolved density-to-sequence correspondence, supported by controlled ablations and now by experimental low-resolution validation.
In light of these contributions and the new evidence addressing both stated concerns, we respectfully ask the reviewer to reconsider their assessment and raise their score accordingly.