- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
DrugPrism extends HypSeek with spherical, Euclidean, and hyperbolic projection heads. A pocket-conditioned network predicts weights over the three squared geodesic distances, producing a target-specific ranking score. The model retains HypSeek’s backbone and most training objectives, with geometric supervision adapted to the product metric.
The paper reports improvements over HypSeek on Merck and Hermite, slightly lower performance on JACS, and promising few-shot adaptation on one OpenBind target. It also examines how the learned weights vary across protein families.
Critical strengths
Conditioning the comparison metric on the pocket is a reasonable extension of shared-metric affinity models. It adds flexibility through a small prediction head while retaining reusable ligand representations. The product-metric formulation also provides a consistent way to define scoring and geometric supervision.
The improvements on Merck and Hermite persist after five-model ensembling. Ensemble Spearman correlation increases from 0.5447 to 0.6113 and from 0.5929 to 0.6906, respectively. Using the same backbone and pretrained initialization as HypSeek provides a useful basis for comparison. The few-shot result is also encouraging, although it covers only one target.
Critical weaknesses
The experiments do not isolate the proposed contribution. Mixed-curvature product representations are established prior work (Gu et al., 2019), and much of the architecture and supervision is inherited from HypSeek. The contribution therefore rests on the particular combination of heterogeneous geometries and pocket-conditioned weighting. However, the ablations omit both globally learned weights and a capacity-matched model with three Euclidean branches and the same conditioning network. Uniform weights are a weak control because the component distances can have different scales. The current results cannot separate gains from mixed curvature, additional projection capacity, distance calibration, and target conditioning. The rank-invariance result applies to scalar rescaling of fixed representations; it does not establish a limitation of more flexible single-space models.
Several reporting gaps limit confidence in the empirical conclusions. The full model’s Merck Spearman correlation is 0.6326 in Table 2, compared with 0.5731 for the mean and 0.6113 for the ensemble in Table 1, without an explanation of the different settings. Ablations lack uncertainty estimates, and the paper does not diagnose the decline on JACS. Section 4.3 points to Appendix B for component dimensions and optimization details, but that appendix mainly specifies the metric head. The broad practical claims also need narrower wording: FEP+ remains better on Merck and Hermite, while the Boltz-2 timing comparison includes structure prediction and uses a different input and deployment protocol. Joint structure and affinity prediction is part of Boltz-2’s task, so this timing gap does not isolate scoring efficiency.
Questions for authors
Contribution and controls: Can you provide results for globally learned component weights and a capacity-matched three-Euclidean-branch model with the same pocket-conditioned weighting? Please clarify how component distance scales are controlled. These comparisons would materially affect my assessment of the geometric contribution.
Experimental consistency: What accounts for the full-model discrepancy between Tables 1 and 2? Were all ablations retrained under the same split, initialization protocol, training budget, and model-selection procedure? Please report variation across seeds and clarify whether single-geometry variants preserve the total representation dimension.
Implementation: Please specify the geometry-head dimensions, layer configurations, parameter sharing, mapping safeguards, and optimization settings. Figure 2 appears to feed mapped query embeddings to the metric head, whereas Eq. 16 and Appendix B specify pocket tangent coordinates. Which data flow is implemented, and how are the pocket and sequence scores used at inference?
Scope of the gains: Which JACS targets account for the decline relative to HypSeek, and is the difference reliable across seeds? HypSeek also benefits slightly more from ensembling on all three benchmarks. Do the per-seed predictions suggest that DrugPrism mainly improves training stability, or that it corrects different ranking errors? The smaller ensemble gain is not itself a weakness, but this distinction matters for interpreting the improvement.
5 comments
Response to Reviewer VuWT (2/4)
W1/Q1 (Continued)
Explicit control for component distance scales. We agree that uniform coefficients are a weak control when component distances have different scales. Although SEH-G allows globally learned scale compensation, we further tested whether explicit distance normalization eliminates the SEH–EEE advantage.
For both models, we estimated fixed component-wise squared-distance scales from 2,048 training assays and 16,887 assay–ligand pairs, using identical sampled pairs and an assay-balanced estimator. No evaluation data were used for calibration. We normalized each component's squared distance by its estimated scale before weighting and consistently applied the corresponding normalization to geometric supervision. Both models were then retrained under matched architectures, parameter counts, objectives, and optimization settings.
The following Merck results use the same fixed-seed evaluation setting as the original Table 2:
| Setting | SEH-T Pearson / Spearman | EEE-T Pearson / Spearman |
|---|---|---|
| Original distances | .6379 / .6326 | .5617 / .5276 |
| Scale-calibrated distances | .5651 / .5435 | .4970 / .4378 |
The mixed-curvature Spearman advantage remains approximately +0.105 before and after calibration. Under calibrated distances, SEH-T outperforms EEE-T on 7 of 8 Merck targets, with paired target-level bootstrap 95% CIs of [+0.0624, +0.1404] for Spearman and [+0.0253, +0.1063] for Pearson. Although normalization reduces absolute performance in this experiment, it does not eliminate the SEH–EEE difference.
These results provide direct evidence that the mixed-curvature advantage is not explained solely by additional projection capacity, target-conditioned weighting, or uncalibrated component-distance scales.
Theoretical and empirical scope. We agree that rank invariance under scalar rescaling applies to fixed representations; it neither rules out more flexible single-geometry models nor guarantees predictive improvement. Our theory characterizes when relative metric weighting enables ranking changes, while the controlled experiments establish its empirical value in the proposed architecture. Complementing these results, DrugPrism achieves 0.7793 Pearson and 0.7489 Spearman across 389 Uni-FEP[1] targets, providing additional evidence beyond the original benchmarks.
Overall, DrugPrism offers a simple, principled, and empirically validated approach to adapting geometric inductive biases across protein targets, without claiming novelty for mixed-curvature product spaces themselves.
W2/Q2. Experimental consistency, seed variation, and ablation reporting
We thank the reviewer for identifying this reporting ambiguity and apologize for not clearly distinguishing the evaluation settings in Tables 1 and 2.
Table 1 vs. Table 2. Table 1 reports results from five independently trained DrugPrism models. On Merck, 0.5731 is the mean Spearman across individual runs, while 0.6113 is obtained by averaging the five models' predictions before evaluation. In contrast, Table 2 reports ablations using one fixed training seed, where the full model achieves 0.6326. Thus, the difference arises from seed aggregation rather than changes in the benchmark, test data, or evaluation metrics.
Ablation consistency and uncertainty. All original Table 2 variants were retrained under the same data splits, pretrained initialization protocol, 50-epoch training budget, optimization settings, and model-selection procedure. To strengthen the statistical evidence for our central contributions, we additionally evaluated SEH-G and EEE-T across five independent seeds, using the same training and evaluation protocols as DrugPrism. These results, reported in W1/Q1, provide mean ± SD estimates for both target-conditioning and mixed-curvature comparisons.
Representation dimensionality. DrugPrism uses 128 intrinsic dimensions partitioned as 43/42/43 across spherical, Euclidean, and hyperbolic factors. The original one-hot single-geometry ablations select one component for scoring and therefore should not be interpreted as full-capacity 128-dimensional single-geometry baselines. Our new EEE-T control addresses this limitation by preserving the complete 128-dimensional three-branch architecture, target-conditioned weighting, and exactly 132,070,639 trainable parameters, while replacing all components with Euclidean geometry.
We will clarify these distinctions and the corresponding evaluation protocols in the revised manuscript.
[1] Rongfeng Zou, Liguo Wang, Xinyan Wang, Ye Ding, and Hang Zheng. Breaking Barriers in FEP Benchmarking: A Large-Scale Dataset Reflecting Real-World Drug Discovery Challenges. 2025.
Response to Reviewer VuWT (3/4)
W2. Scope of accuracy and runtime claims
We thank the reviewer for this important clarification. We agree that predictive accuracy and computational efficiency should be distinguished, and that our practical claims should reflect the different tasks and evaluation protocols.
Predictive accuracy. We acknowledge that FEP+ remains more accurate on Merck and Hermite, achieving Spearman correlations of 0.6798 and 0.8720, compared with 0.6113 and 0.6906 for the DrugPrism ensemble. We will therefore emphasize DrugPrism's improvements over the evaluated learning-based baselines and its computational efficiency, rather than claiming uniformly superior accuracy to physics-based methods.
Computational cost. DrugPrism and Boltz-2 were measured on single A100 GPUs, but their inference tasks differ: DrugPrism ranks ligands using prepared protein pockets, whereas Boltz-2 jointly predicts complex structures and affinity. Our Boltz-2 evaluation also uses per-ligand inference rather than optimized batching. Furthermore, the FEP+ estimates are derived from measured throughput reported in NVIDIA's 2022 DGX A100 white paper, rather than direct JACS measurements. We will explicitly distinguish measured runtimes from throughput-derived estimates and present these results as protocol-specific computational costs, not intrinsic speed comparisons under identical tasks.
Q3. Implementation details and metric-head data flow
We thank the reviewer for identifying these ambiguities. We agree that the implementation details should be more explicit and will expand Appendix B with complete architectural configurations, numerical safeguards, and optimization settings. We also acknowledge that the current Figure 2 is inaccurate in its depiction of the metric-head input, and we will revise it to ensure consistency with the implemented data flow and the mathematical formulation.
Metric-head input and inference. The implemented metric head receives the scaled pocket tangent coordinates before exponential mapping, exactly as specified in Eq. 16 and Appendix B, rather than the mapped manifold embeddings currently suggested by Figure 2. Three factor-specific residual-logit networks produce the metric coefficients through softmax normalization, with 17,414 trainable parameters in the metric head. During training, both pocket–ligand and sequence–ligand branches contribute to the objectives, sharing the geometric weights predicted exclusively from the pocket. At inference, only pocket–ligand scores are used for affinity ranking, following HypSeek's protocol; the sequence branch provides auxiliary training supervision. We will revise Figure 2 and clarify this training–inference distinction in Section 4.4.
Projection architecture. DrugPrism uses nine independent projection MLPs—one for each spherical, Euclidean, and hyperbolic component in the pocket, sequence, and ligand towers—without parameter sharing. The component dimensions are 43/42/43 (128 in total). Pocket and ligand features are 512-dimensional (Uni-Mol), while sequence features are 480-dimensional (ESM-2, esm2_t12_35M_UR50D). Each projection uses two linear layers with an intermediate ReLU: 512→512→d_j for pocket/ligand and 480→480→d_j for sequence, without LayerNorm or dropout. The projected tangent coordinates have learned multiplicative scales initialized to 1/√128 and bounded above by one before manifold mapping. The metric head uses factor-specific LayerNorm(d_j)→Linear(d_j,128)→GELU→Dropout(0.1)→Linear(128,1) networks, followed by global-logit addition and softmax.
Numerical safeguards. Spherical and hyperbolic curvature magnitudes are fixed at one. Exponential maps and geodesic distances are computed in FP32, including under mixed-precision training. We smoothly bound spherical tangent radii below π/2, cap hyperbolic sinh arguments, and apply valid-domain clamping, small-distance approximations, and a 10⁻⁶ numerical tolerance.
Optimization. All three pretrained encoders, nine projection MLPs, and the metric head are jointly fine-tuned, totaling 132,070,639 trainable parameters. Training uses four-GPU DDP (global batch size 96), AdamW (learning rate 10⁻⁴, zero weight decay), polynomial decay with 6% warm-up, and gradient clipping at 1.0. Models are trained for 50 epochs, with final parameters averaged over epochs 41–50, without benchmark-based checkpoint selection.
These revisions will make the architecture, training protocol, and inference procedure explicit and fully consistent across the figure, text, and implementation.
Response to Reviewer VuWT (1/4)
W1/Q1. Contribution and controlled evaluation of target-dependent geometry
We thank the reviewer for these important comments. We acknowledge that mixed-curvature product spaces are established prior work, including Gu et al. (2019). DrugPrism's contribution is not the product space or weighted-sum operation itself, but a principled approach to adapting geometric comparisons to individual protein targets, motivated by an empirical observation and supported by controlled experiments.
Motivation and geometric formulation. Despite sharing the same curated training data and similar pretrained backbones, spherical LigUnity and hyperbolic HypSeek exhibit striking target-wise performance reversals. This motivates a natural question: could different protein targets benefit from different geometric inductive biases, rather than one universally preferred geometry?
DrugPrism addresses this question through a product of spherical, Euclidean, and hyperbolic factors, with pocket-conditioned coefficients controlling their relative contributions. Intuitively, the three geometries provide complementary geometric components, while the learned weights specify each target's preferred combination. For fixed representations, scalar rescaling of a single geometry preserves ligand rankings (Theorem 4.2), whereas reweighting multiple components can change rankings when their pairwise preferences disagree (Theorem 4.4). Importantly, the weighted sum of component squared geodesic distances is exactly the squared distance induced by the target-conditioned Riemannian product metric. Thus, the simple scoring form is not an ad hoc aggregation rule, but a structured family of target-adaptive comparison metrics, with geometric representations and metric weights learned jointly.
Controlled evidence: target conditioning and mixed curvature. To isolate the proposed contributions, we introduce two additional baselines:
DrugPrism (SEH-T) and EEE-T both use a 128-dimensional representation and exactly 132,070,639 trainable parameters. Training data, objectives, optimization settings, training budget, and evaluation protocols are matched, with geometry-dependent operations adapted appropriately. The following results report five-seed mean ± SD (Pearson / Spearman):
Target conditioning improves mean Spearman over SEH-G by +0.0252/+0.0437/+0.0690, while mixed curvature improves over parameter-matched EEE-T by +0.0368/+0.0627/+0.0406 on JACS/Merck/Hermite, respectively. Both comparisons favor DrugPrism in Pearson and Spearman across all three benchmarks, providing evidence for the distinct benefits of target-specific weighting and heterogeneous geometry.