- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
ProtGround learns to associate functional phrases with local protein structures. The authors construct region–phrase pairs from curated residue annotations and semantic matching, then combine contrastive learning, residue–token optimal transport, and masked modeling. They evaluate protein retrieval, candidate and blind localization, and downstream protein prediction.
Critical strengths
The local supervision is the part I find most valuable. Most pairs come directly from curated residue annotations, giving the dataset a firmer basis than associations generated from protein descriptions alone. The resource could be useful beyond this particular architecture. The reported localization gains are also substantial: U30-hard Core mAP increases from 0.2670 for ProTrek to 0.5129. These results make the approach worth investigating.
Critical weaknesses
I found the related work too thin to judge the novelty properly. Section 5 offers only a brief contrast with whole-protein modeling. DeepFRI is cited as a benchmark, but its residue-level localization is not discussed; COLLAPSE’s local structure–function representations are also relevant. Neither solves exactly the same phrase-grounding task, but both matter for establishing what language conditioning adds beyond existing functional-site learning. That distinction is currently missing.
I also could not reconstruct the blind-grounding procedure. Section 3 starts from a specified local region, whereas Level 3 requires searching the complete protein. How are whole-protein residue scores obtained, converted into five predicted sites, and matched to the annotations? The appendix does not supply this missing inference procedure. Since blind grounding is a central result, these details are necessary to assess Table 2. The adaptation of the grounding baselines also needs to be specified.
Questions for authors
- Please give the complete Level 3 inference procedure and the exact SiteRecall@5 matching rule.
- Were the grounding baselines adapted using ProtGround-Align? What local supervision and prediction procedure did each receive?
- It is better to provide an anonymized codebase for review rather than deferring the release until after acceptance.
5 comments
Response to Reviewer Comments
For W2 and Q1-Q2. Blind Grounding Implementation and Baseline Adaptation. We thank the reviewer for raising these questions. We have clarified the complete Level 3 inference procedure, evaluation metrics, and baseline adaptation protocols in the revised manuscript.
1. Level 3 Blind Grounding Procedure. Unlike Level 2, which ranks predefined candidate regions, Level 3 performs localization across the entire protein without requiring known functional sites or predefined candidate regions. Given a complete protein sequence, its 3D structure, and a functional phrase query, we construct a 10 Å spatial neighborhood around every canonical residue, using minimum interatomic distances. Each neighborhood includes its center residue and surrounding spatial neighbors, including residues that may be distant in sequence.
ProtGround-Hier encodes each local neighborhood using its sequence and 3D geometric information. For each functional phrase, we compute cosine similarity between the phrase embedding and every local region embedding. The resulting similarity score is assigned to the corresponding center residue, producing a query-dependent score for every residue across the protein. We rank all residue centers by these scores and select the five highest-scoring centers. Their corresponding 10 Å neighborhoods constitute the top-5 predicted functional regions. No ground-truth functional sites or annotated core residues are required during inference.
2. Core mAP and SiteRecall@5. Core mAP evaluates how highly the annotated functional core residues are ranked among all residue centers. For each functional phrase query q, Average precision (AP) averages precision values at the ranks of all annotated core residues, where precision at each rank is the fraction of true core residues among the residues ranked up to that position, average precision is computed as:
Here, is the set of annotated core residues, is the number of canonical residues, is the residue at rank k, and I[·] is the indicator function. Core mAP is the mean AP across all functional phrase queries.
SiteRecall@5 evaluates whether the top five predicted neighborhoods recover the annotated functional sites. For SiteRecall@5, we select the five highest-scoring local regions per query and consider a ground-truth functional site recovered if their union covers any of its annotated core residues., Let denote the union of the five highest-scoring predicted regions:
SiteRecall@5 is calculated as:
Here, N is the number of functional phrase queries, is the set of ground-truth functional sites for query q, and is the annotated core-residue set of site s.
A ground-truth site is considered recovered if at least one of its annotated core residues is covered by the union of the top five predicted regions. We calculate the fraction of recovered sites for each query and average it across queries. Thus, Core mAP measures residue-center ranking quality, while SiteRecall@5 measures functional-site recovery by the highest-scoring local 3D regions.
3. Baseline Adaptation for Local Grounding. We evaluate ProteinCLAP, ProtCLIP, Prot2Text-V2, and ProTrek using a shared candidate-generation and evaluation protocol. For ProteinCLAP, ProtCLIP, and Prot2Text-V2, we first encode the complete protein sequence to obtain contextualized residue representations. For each candidate 3D region, we identify its constituent residues and pool their corresponding full-sequence embeddings to construct a region-level representation. We then compute cosine similarity between this representation and the functional phrase embedding to rank the regions. For ProTrek, we additionally incorporate its structural embedding into the region representation. In contrast, ProtGround-Hier directly encodes each local 3D region using its sequence and geometric information.
At Level 2, all methods evaluate the same predefined candidate regions. At Level 3, all methods use the same 10 Å neighborhoods centered at every canonical residue. The resulting region scores are assigned to their center residues, and the same top-5 selection and site-matching rules are applied to all methods.
Therefore, all methods share the same candidate regions, functional queries, and evaluation metrics. Their differences lie in how local regions are represented and aligned with functional phrases.
Response to Reviewer Comments
4. Training Supervision. The baselines are evaluated using their original pretrained representations. To further investigate the contribution of our model architecture, we conducted an additional structural encoder ablation by replacing our geometry-aware region encoder with ProTrek's structure encoder, while keeping the training data, objectives, and remaining model components unchanged. As shown in the table below, this replacement consistently reduces performance across all grounding and downstream metrics. In particular, Level-3 Core mAP decreases from 0.537 to 0.450, and SiteRecall@5 decreases from 0.865 to 0.786. These results demonstrate that our task-specific local 3D structural encoder contributes to the performance improvements beyond the fine-grained training data itself.
Ablation study of pre-training objectives and structural encoding in ProtGround-Hier.
| Config. | Grounding Level1 mAP | Grounding Level2 mAP | Grounding Level3 Core mAP | Grounding SiteRecall@5 | Loc. Fixed (Acc.%) | Loc. Full (Acc.%) | Fit. Fixed (ρ) | Fit. Full (ρ) | Func. Fixed (Fmax) | Func. Full (Fmax) |
|---|---|---|---|---|---|---|---|---|---|---|
| Full objective | 0.722 | 0.914 | 0.537 | 0.865 | 89.90 | 89.75 | 0.673 | 0.813 | 0.633 | 0.696 |
| w/o | 0.694 | 0.868 | 0.487 | 0.819 | 87.44 | 88.01 | 0.647 | 0.790 | 0.592 | 0.658 |
| w/o | 0.682 | 0.841 | 0.462 | 0.797 | 87.86 | 88.36 | 0.646 | 0.787 | 0.589 | 0.654 |
| w/o | 0.710 | 0.894 | 0.516 | 0.849 | 88.87 | 88.92 | 0.659 | 0.791 | 0.610 | 0.666 |
| w/o | 0.703 | 0.885 | 0.508 | 0.840 | 88.72 | 88.74 | 0.662 | 0.793 | 0.607 | 0.664 |
| w/ Alt. 3D Encoder | 0.677 | 0.835 | 0.450 | 0.786 | 87.93 | 88.45 | 0.653 | 0.795 | 0.598 | 0.657 |
We have incorporated this additional structural encoder ablation into Table 4 of the revised manuscript.
Manuscript Revision. We have explicitly clarified the Level 3 inference procedure, residue-level scoring, top-5 region selection, and exact definitions of Core mAP and SiteRecall@5 in Lines 359-425 of the revised manuscript. We have also expanded the baseline descriptions in Lines 418-425, specifying the region-level representations, shared candidate-generation procedure, and similarity-based ranking used for local grounding.
We hope our detailed responses and manuscript revisions have addressed your questions and concerns about novelty. If so, we would sincerely appreciate your consideration of a higher rating. Thank you very much for your valuable feedback.
Response to Reviewer Comments
For W1. Distinction from Prior Local Function Modeling Methods. We thank the reviewer for highlighting DeepFRI and COLLAPSE. Due to space limitations, our original Related Work section provided only a brief discussion of existing local function modeling methods. We have expanded this discussion in the revised manuscript.
DeepFRI predicts protein functions labels using sequence and applies Grad-CAM to generate residue-level importance maps for GO and EC function labels. Although it can identify relevant residues, its localization is derived from post-hoc interpretation of predefined function-label predictions, rather than explicit supervision of functional phrase–region correspondences. Therefore, DeepFRI focuses on identifying individual functionally important residues rather than directly grounding free-form functional descriptions in local 3D structural regions, where protein function depends on both the residues and their surrounding structural microenvironments.
COLLAPSE learns representations of local sites through evolutionary self-supervision. It provides function representations of protein sites but does not incorporate natural-language descriptions or explicitly align functional phrases with local structural regions. Consequently, its learned site embeddings are not directly conditioned on functional phrase queries.
In contrast, ProtGround explicitly connects natural-language functional phrases with local 3D structural regions. Rather than focusing solely on individual functional residues, we consider both these residues and their surrounding 3D microenvironments, where spatially close but sequence-discontinuous residues can jointly contribute to protein function. We construct large-scale, explicitly annotated region–phrase pairs that capture many-to-many functional relationships. ProtGround-Hier further learns these correspondences through geometry-aware region encoding, multi-positive alignment, and residue–token optimal transport. Given a functional phrase, the model can directly localize its corresponding 3D functional regions and identify their core residues, rather than relying on post-hoc residue importance maps or text-independent structural site embeddings.
Thus, our main contribution is not simply residue-level localization or local structural representation learning, but language-conditioned grounding of distinct functional descriptions in their corresponding local 3D microenvironments.
We have now substantially expanded Section 5 (Related Work) of the revised manuscript, systematically reviewing the development of protein representation learning from whole-protein modeling to fine-grained local function modeling. We discuss representative methods, including ProtST, ProtCLIP, DeepFRI, COLLAPSE, MMSite, and the recent ProLoc, highlighting their methodological contributions and limitations. This expanded discussion clarifies the distinctions between existing approaches and ProtGround, particularly our explicit alignment of functional phrases with local 3D structural microenvironments, and better establishes the novelty and advantages of our work.