- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper introduces a QSAR modeling approach that uses a set of 3D conformers as the molecular representation rather than a single conformer. The reported results suggest state-of-the-art performance on some tasks, although the experimental setup and evaluation tasks are difficult to understand from the text, tables, and figure captions.
The summary is based on checking figures and tables and careful reading of the first 3 pages. I stopped reading the paper after that due to the poor presentation.
Critical strengths
S1. An interesting and relevant problem in molecular representation learning.
The paper addresses an important problem in molecular representation learning: representing molecules using multiple 3D conformers rather than a single structure. Since molecules exist as conformational ensembles, incorporating information from multiple conformers is a potentially valuable approach for improving molecular representations and downstream QSAR modeling.
Critical weaknesses
W1. The presentation is substantially below the standard expected for an ICLR submission, preventing a reliable scientific evaluation.
The manuscript is exceptionally difficult to follow due to major problems with its writing, organization, and formatting. Essential information needed to understand the methodology and experiments is frequently omitted from the main text, while numerous concepts and implementation details are introduced without adequate definition, motivation, or context.
Almost every paragraph refers to other sections or appendices, forcing the reader to navigate repeatedly through the manuscript merely to reconstruct the basic experimental procedure. This is made considerably worse by the lack of hyperlinks in cross-references, despite their support in the ICLR template. The unusual citation formatting further reduces readability.
For example, the first paragraph of Section 3.2 introduces two regression models, multiple feature families, the "union" of the models, a novelty requirement, and a candidate-selection procedure without explaining the prediction task, how the labels are defined, what "union" means operationally, or how the models are used to select candidates. Instead, the reader is directed to multiple appendices for information essential to understanding the central experiment.
I stopped my detailed reading at approximately page 3 because I could not reliably reconstruct the methodology and experimental setup from the presentation. Consequently, I cannot provide a meaningful assessment of the technical soundness or claimed contributions.
Clear, coherent, and auditable presentation is an essential component of scientific work, particularly at a top-tier conference. In my assessment, the paper requires a drastic rewrite and reorganization before it can be properly evaluated. Such a revision is far beyond the scope of a rebuttal.
My recommendation is therefore rejection on presentation and evaluability grounds, independently of the potential scientific merit of the work.
Questions for authors
None. The presentation issues are too extensive to be addressed through individual clarification questions during the rebuttal.
4 comments
Presentation Concerns Remain Unresolved Despite Revisions
Thank you for your response. Fixing the broken cross-references and citation formatting is appreciated, but these are basic presentation requirements that should have been met in the original submission.
I also acknowledge the effort to clarify Section 3.2. However, even the revised version remains confusing. For example, the opening sentence introduces a continuous activity prediction task (suggesting regression) immediately followed by a binary positive-label definition (suggesting classification), without explaining the relationship between the two. The next sentence begins "As shown in Figure 2a, we fit two regression models [...]", yet Figure 2a provides no meaningful explanation beyond the label "Two regressors on ZAO and 2D features, ligand only."
More importantly, Section 3.2 was merely one example of a broader, systemic problem with the manuscript's clarity and organization, not an exhaustive list of issues to correct. While the revisions improve some passages, I do not see a comparable effort to systematically improve the clarity and organization of the manuscript. I disagree that "everything needed to follow the experiment is now in the main text." Important methodological choices still require consulting the appendices.
I therefore maintain my original assessment. Despite the revisions, I still consider the presentation substantially below the standard expected at a top-tier conference.
The revision beyond Section 3.2, and the two passages named
The body as a whole. The second revision works through the body of the paper. What a reader needs in order to follow the experiment is stated where it is first used, and what the appendices hold is the evidence behind a number rather than a definition the body depends on: the free-energy protocol, the probe design, the per-target tables, and the two control experiments added during this discussion. The paragraphs are shorter and each carries less at once.
The opening of Section 3.2. The reviewer is right that it set a continuous prediction task beside a binary label without relating the two. The paragraph now opens with one task, regression, and two cutoffs on the predicted scale: 6.0 defines the training positives that serve as the reference set for novelty, and stage (4) applies 7.0 to predictions. No model in the paper is trained as a classifier.
Figure 2a. The reviewer is right that the panel carried less than the sentence citing it implied. That citation is gone, and the panel is cited once, at the point where the funnel counts it shows are given.
If a further passage is as hard to follow as the former opening of Section 3.2, naming it would let us rewrite that passage within this period.
The third revision
A third revision has been uploaded. The wording has been made plainer and more consistent throughout, every section of the body now carries run-in headings, and one heading governs one block of text. The cross-references between sections, which the reviewer raised at the outset, have also been substantially reworked.
We thank the reviewer for the time spent on this paper and for the frankness of the assessment. It is what let us concentrate on the quality of the presentation.
Working cross-references and a self-contained opening to Section 3.2
We thank the reviewer for identifying plainly the passages where the presentation became hard to follow.
On both formatting points the reviewer is right: in the revision, all section, appendix, figure, table, and citation references are clickable, and the citations are author-year throughout.
Section 3.2 now opens self-contained in this revision, not in a later camera-ready version. Specifically, it states the prediction target and the positive label in the main text, says what the union of the models means operationally, and lists the six screening stages.
On the navigation cost, everything needed to follow the experiment is now in the main text. The pointers that remain lead to supporting evidence, and removing them would cost a reader who wants to verify the results more than it saves one who does not. Each remaining pointer is now a hyperlink. Feature blocks, the common configuration, early enrichment (BEDROC20), the strong-hit threshold, and the definition of a novel scaffold are all given where they are first used.
In the reviewer's judgment, the rewrite needed here is beyond the scope of a rebuttal. We would ask the reviewer to weigh that judgment against what the revised manuscript now contains: the review names three specific defects, all three are repaired, and none of them required rewriting the manuscript as a whole. If the revised PDF is now adequate on those counts, we would be glad to hear it; if it is not, naming one further passage that is as hard to follow as the former opening of Section 3.2 would let us rewrite that passage within this discussion period.