- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces SLCState, a manually curated benchmark for ligand-conditioned conformational-state ranking in solute carrier (SLC) transporters, and SLCHier, a hierarchy-aware hyperbolic representation learning model. SLCState contains 762 pocket–ligand records from 622 PDB entries, covering 109 transporters, 14 structural folds, and five canonical conformational states. Seven evaluation splits target held-out proteins, held-out ligand–transporter associations, and different conformational-state configurations. SLCHier combines state-level pocket–ligand similarity with transporter-level structural hierarchy supervision through Lorentz-space representations and a two-scale architecture. It achieves the highest top-1 accuracy among the reported methods in all seven settings.
Critical strengths
-
The paper addresses a practically relevant and underexplored problem in transporter drug discovery: ligand-conditioned conformational-state ranking within the same protein. The manually curated SLCState benchmark, covering 109 transporters and five conformational states, provides a useful resource for studying this problem.
-
The proposed SLCHier framework incorporates transporter structural relationships while preserving state-specific pocket representations. The ablation studies provide evidence that structural hierarchy supervision and hyperbolic representations contribute to performance, particularly under limited same-fold training support.
Critical weaknesses
-
The experimental comparison is not entirely fair. SLCHier is trained specifically on SLCState, whereas all competing methods are evaluated zero-shot. Therefore, the reported improvements may partly reflect task-specific supervision rather than the superiority of the proposed architecture.
-
The definition of ligand-preferred conformations is not sufficiently justified. Observing a ligand bound to a particular conformation does not necessarily establish its preference over other conformations. Treating unobserved states as competing negatives may introduce misleading supervision and weaken the biological interpretation of the results.
-
The dataset is relatively small and imbalanced across conformational states, raising concerns about the robustness and generalizability of the approach.
-
The methodological novelty is somewhat limited. Hyperbolic representation learning, hierarchical structural supervision, and contrastive learning have been extensively explored. The proposed framework mainly combines these established techniques, and its broader methodological contribution beyond transporter-specific applications remains unclear.
Questions for authors
- For each of the seven splits, how many unique held-out proteins, ligand–transporter pairs, and test records are evaluated? How many of these queries have exactly one candidate state?
- How often is the same ligand experimentally associated with more than one canonical state of the same transporter? Are those associations treated as mutually exclusive during state-ranking training?
- What is the distribution of the number of pocket representatives per state, and how sensitive are results to fixing this count?
- Why are all six external methods evaluated exclusively zero-shot, despite the availability of training data and the use of task-specific supervision for SLCHier?
6 comments
Response to Reviewer EsWk(2/3)
W2. Definition of Ligand–Conformation Associations and Negative Supervision
Regarding the definition of ligand-preferred conformations, we agree that an experimentally observed ligand-bound conformation does not necessarily establish thermodynamic preference or exclude binding to other states. The supervision target of SLCState is an experimentally supported ligand–conformation association, verified through original publications, structural inspection, and chain-level annotations. The evaluation measures whether models rank the experimentally observed state highly among candidate conformations. Thermodynamic preferences, equilibrium state occupancies, and functional selectivity require corresponding experimental evidence, and unobserved states should not be interpreted as experimentally verified nonbinding states.
Given that the same substrate may remain bound during multiple stages of the transport cycle, our supplementary computational candidate poses also help explore ligand–conformation combinations not yet captured experimentally, partially addressing gaps in experimental sampling without treating these candidates as experimental evidence. Furthermore, as described in Appendix C, we construct presumed background negatives by first excluding all known positive ligands in the current training partition from the FDA-approved drug library, including those with and without resolved bound conformations, and then sampling from the remaining compounds. This ensures that these known binders are not included in the background drug-negative pool merely because they lack conformation-resolved experimental structures.
Q2. Multistate Ligand Associations and Their Treatment in Training
We analyzed the 762 experimental pocket–ligand records in SLCState. After grouping records by transporter and standardized ligand structure and merging repeated observations within the same canonical state, we identified 412 distinct transporter–ligand pairs. Of these, 59 pairs (14.3%) were experimentally observed in at least two canonical states, involving 29 transporters. A substrate can remain bound as its transporter progresses through multiple substrate-bound conformations, while available experimental structures may capture only a subset of these states.
After adding the 2,043 computational records described above, the expanded database contains 434 transporter–ligand pairs, of which 90 pairs (20.7%) cover at least two canonical states, involving 41 transporters. Specifically, the computational expansion provides candidate binding poses in additional conformations for 31 pairs previously represented by only one experimentally observed binding state. Using the original 412 pairs as a fixed denominator, multistate coverage increases from 14.3% to 21.8% (90/412).
Regarding mutual exclusivity during training, multi-positive pocket–ligand alignment retains all known positive pockets for each ligand. When a ligand has experimental binding records in both inward-facing and outward-facing states, both states are treated as positives in the alignment objective. State ranking encourages the experimentally observed state in each record to receive a higher score, so both known binding states receive positive supervision while also competing with each other. Together, these supervision signals allow the same ligand to receive high compatibility scores with multiple states. If two experimentally supported states both receive high and similar scores, this indicates strong model support for compatibility with both binding states, consistent with a substrate remaining bound across multiple transporter conformations.
Response to Reviewer EsWk(3/3)
W3/Q3. Dataset Coverage and Pocket Representation
We thank the reviewer for raising concerns about dataset coverage, conformational-state imbalance, and variation in the number of pocket representatives. Ligand-conditioned conformational recognition requires experimentally supported associations among ligands, specific protein chains, binding pockets, and conformational states. Through systematic structural retrieval and literature-guided curation, SLCState-Exp provides 762 experimental pocket–ligand records spanning 109 transporters and 14 structural folds, including 47 proteins with at least two experimentally resolved states and 22 with at least three. Among the public resources we examined, SLCState-Exp provides the largest collection of experimental records and the broadest fold coverage for this specific ranking task.
We nevertheless acknowledge that the experimental collection provides limited coverage across transporters and conformational states. In response to the reviewer’s suggestion, we introduce SLCState-Aug, which supplements the experimental collection with computational candidates generated using Glide docking and BioEmu2, providing additional binding configurations for 55 of the original 109 proteins.
Regarding conformational-state imbalance, the expansion adds 55 inward-occluded candidates to the original 23 experimental records. This state remains underrepresented, partly reflecting differences in how readily transporter states can be captured experimentally. Despite this imbalance, SLCHier outperforms all zero-shot baselines in mean accuracy and MRR on the two-state ranking task (2S; Table 2).
Table X. Distribution of conformational states in SLCState-Exp and SLCState-Aug.
| Conformational state | SLCState-Exp, n (%) | SLCState-Aug, n (%) |
|---|---|---|
| Inward-facing | 297 (39.0%) | 1,288 (46.5%) |
| Inward-occluded | 23 (3.0%) | 78 (2.8%) |
| Occluded | 115 (15.1%) | 290 (10.5%) |
| Outward-occluded | 58 (7.6%) | 167 (6.0%) |
| Outward-facing | 269 (35.3%) | 946 (34.2%) |
Pocket-representative counts also vary across transporter–state groups. Among 188 groups, the mean is 4.04, the median is 2, the interquartile range is 1–5, and the range is 1–25; 26.1% have only one representative. Requiring would therefore exclude part of the benchmark, whereas using throughout would discard substantial conformational information.
We use max aggregation under a multiple-instance interpretation: a ligand is considered compatible with a state if at least one representative supports the interaction. To assess sensitivity to representative count, we constructed balanced- cohorts requiring every candidate state to have at least two or three distinct representatives. Across 100 label-independent repetitions, representatives within each state were randomly ordered, and the same queries were evaluated using the first representatives with max aggregation.
Table Y. Sensitivity of MRR to balanced pocket-representative count.
| Minimum representatives per candidate state | Query instances | Splits | |||
|---|---|---|---|---|---|
| 2 | 997 | 21 | 0.7217 ± 0.0192 | 0.7335 ± 0.0169 | — |
| 3 | 638 | 18 | 0.7201 ± 0.0260 | 0.7282 ± 0.0235 | 0.7383 ± 0.0233 |
The reported deviations reflect variability across the 100 selections. MRR increased by 0.0118 from to in the first cohort and by 0.0182 from to in the second; Top-1 accuracy followed the same qualitative trend. Ranking performance is therefore relatively stable within the tested balanced-count range, with modest benefits from additional representatives. We will clarify these limitations and provide detailed curation, expansion, and sampling procedures in the revised manuscript and appendix.
Response to Reviewer EsWk(1/3)
W1/Q1/Q4. Fairness of Baseline Comparisons and Additional Task-Adapted Evaluation
We thank the reviewer for raising this important concern and apologize for not sufficiently clarifying the purpose of our original comparisons.
(1) Clarification of the original evaluation. The original comparisons assess zero-shot transfer from general protein–ligand models to conformational-state recognition: the six baselines use released pretrained checkpoints without SLCState adaptation, whereas SLCHier is trained on the corresponding SLCState-Exp partitions. This is a fair and meaningful comparison under the intended task-transfer setting, as all methods rank identical held-out queries and candidate states without test-label adaptation. This evaluation examines whether SLCState-specific learning can generalize to unseen transporters beyond direct transfer of established models. Notably, the original SLCHier uses a randomly initialized ProFSA-based pocket encoder without pretrained ProFSA weights.
Test-set composition (Q1). The table reports mean counts across three valid assignments per protocol. No test query has only one candidate state. Detailed split statistics are provided in Appendix A.9.
Mean counts across three assignments; fully held-out proteins are absent from training. In LH, complete ligand–transporter pairs rather than proteins are held out; IOF includes both fully held-out and other test transporters.
(2) Additional task-adapted comparisons. To address the supervision mismatch, we adapted all six baselines on the same SLCState-Exp training partitions across three assignments for each of the seven protocols. They were initialized from official pretrained checkpoints and optimized with a shared state-ranking objective, head warm-up, and partial encoder fine-tuning. Checkpoints were chosen exclusively by validation Top-1 accuracy (MRR as a tie-breaker), with the original pretrained checkpoint included as a no-update option. The no-update option is determined entirely by validation, never test performance, guarding against detrimental updates. We also evaluated a separate SLCHier variant initialized from pretrained ProFSA weights.
ProFSA-pretrained SLCHier; mean ± SD across three train/test assignments.
SLCHier retains the highest mean Top-1 accuracy and MRR across all seven protocols, outperforming the strongest task-adapted baseline by 3.62–16.18 percentage points in mean Top-1 accuracy, with particularly substantial gains on IOF (+16.18 points), LS (+8.99), and LH (+7.77). The full comparisons and adaptation procedures are reported in Appendix E.
(3) Fine-tuning behavior and task-specific modeling. General pretrained protein–ligand models do not consistently benefit from additional adaptation: validation selects epoch 0 in 15/21 assignments for DrugCLIP and TANKBind and 21/21 for RTMScore, compared with only 3/21 for BindNet. This likely reflects both a mismatch between general binding-compatibility objectives and within-transporter conformational discrimination and the limited number of independent transporters with correlated training records. These heterogeneous outcomes indicate that some models benefit from adaptation while others lose transferable performance.
In contrast, SLCHier integrates state-specific representations, ranking supervision, state-aware negatives, and transporter-level hyperbolic hierarchy modeling. State-level ranking separates competing conformations within a transporter, while hyperbolic centers encode structural hierarchy for knowledge sharing across proteins. Its continued advantage under task-adapted comparisons, together with component-wise ablations, supports the combined effectiveness of these task-aligned components.
Together, the original zero-shot and task-adapted evaluations provide complementary evidence for SLCHier while directly addressing the supervision difference raised by the reviewer.