- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces HBDrug3D, a 3D dataset for linker generation in PROTACs, PDCs, and ADCs. The authors generate 3D conformations from curated molecules and evaluate four existing linker generation methods on the dataset. The benchmark includes both random and scaffold splits, with metrics for validity, recovery, 3D geometry, and molecular properties.
Critical strengths
The paper studies a useful setting that is not well covered by standard small-molecule linker benchmarks. The results also show that existing methods struggle with longer linkers, especially for ADCs, which I found useful.
Critical weaknesses
- I am not fully convinced that the 3D benchmark reflects the relevant linker design setting. The conformations are generated from complete molecules using ConfGen, without the biological context in which the linker needs to function. For PROTACs in particular, the relevant geometry depends on the target–PROTAC–E3 complex. It is therefore unclear to me how well performance on this benchmark reflects useful linker design in practice.
- I have concerns about the data split. The paper states that each conformation is treated as a separate data point in the random split. This seems to allow different conformations of the same molecule to appear in both training and test sets. The scaffold split is more convincing, but I could not find enough detail on how the “fragment scaffold” is defined or how many unique molecules are present in each split.
Questions for authors
1.How are the relative 3D positions of the input fragments obtained? Are they inherited directly from the ConfGen conformations of the complete molecule?
2.Can different conformations of the same molecule appear in both training and test sets under the random split?
3.How exactly is the “fragment scaffold” defined in the scaffold split?