- Rating
- 4
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper presents a sampling framework for the connection between theoretical and experimental data, which are of different fidelities. This is a very widespread problem within chemistry, where are larger quantity of lower accuracy theoretical data is easier to access than experimental data, which is hence of lower quantity. Methods that provide some route to "correct" the lower fidelity data to higher fidelity data are therefore of significant interest in chemistry.
The paper focuses on a method to reduce the amount of the lower fidelity data that is required for the accurate prediction, also identifying data that is of lower quality. The approach is demonstrated across three different chemistry case studies. Ablation studies are carried out.
Critical strengths
- Such an approach has potential application across a wide range of chemistry areas, being related to a general problem. This increases the audience for the contribution.
- The authors have tested on three different case studies representing different sub-fields of chemistry, which again increases the audience for the contribution.
Critical weaknesses
- The paper could be written to be easier for a reader to follow in places, there are a few typos, missing introductions of acronyms. Several of the captions could benefit from expansion for the readers' ease.
- The three case studies are stated to relate to the combination of a larger computational dataset and a smaller experimental dataset. However, for the material band gap prediction, both datasets are computational I believe (assuming GWVD are high accuracy electronic structure calculations - the acronym is not introduced). The latter dataset however is referred to as "experimental", which is misleading.
Questions for authors
No further questions beyond the requests for clarifying edits to the paper made in the preceeding box.
Thanks for your thoughtful and constructive feedback. We sincerely appreciate the time and effort you have invested in reviewing our manuscript. We are encouraged by your recognition of our work. At the same time, we acknowledge that some aspects require further clarification.
Target GMM, KL alignment, and iterative selection use only target train+validation embeddings; held-out test samples are never used for GMM fitting, KL scoring, threshold calibration, or coreset pruning. For NREL-GWVD (52), ATcT (358), and CASF-2016 (285), we use repeated stratified 5-fold cross-validation; for CombiSolv-Exp (8,780), we repeat experiments with three random seeds.
Because comparisons are paired across splits, we report paired differences against the second-best method with 95% CIs. MDG-IS significantly outperforms the second-best method on all tasks.
Coreset size and selection mechanism vary together, so we add a fixed-size ablation keeping size consistent with the baseline. Under fixed size, full MDG-IS still outperforms all ablation variants on DTA and Band-gap, indicating component synergy; forcing a fixed size contradicts the auto-size design and degrades performance.
A target-only baseline performs reasonably only on CombiSolv, where data are sufficient, and degrades sharply elsewhere.
We compared the training efficiency—defined as the sum of data selection time and training time—of training on the full dataset, using 2nd-best method, and employing our proposed approach. It can be seen that our method demonstrates the best performance.
All of the aforementioned changes will be indicated in the revised PDF using highlighting (red text). Your feedback is very important for us to improve our work. If our response fully addresses your concerns, we sincerely hope that you will consider modifying your rating. We are also happy to provide further clarification or continue the discussion.