- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper builds a molecular property prediction pipeline on Claude Code’s agent SDK. A controller delegates setup, design, implementation, training, and selection to specialised agent sessions supplied with expert guidance. Experiments on PXR induction, hepatocyte clearance, and plasma protein binding evaluate guidance effects and compare performance with other coding agents.
Critical strengths
- The paper presents a functional pipeline covering environment setup, model design, implementation, training, selection, and prediction delivery, demonstrated on several molecular property prediction tasks.
- The evaluation includes comparisons with a single coding agent, AIDE, and MLEvolve, alongside predictive-model ablations and a control for additional training data. The authors openly report experimental deviations and limitations.
Critical weaknesses
- The methodological novelty is limited. The framework combines written expert guidance with a controller coordinating role-specific coding agents. Although the authors explain the design rationale, they do not clearly identify a new technical mechanism beyond existing agent orchestration practices. The contribution appears primarily to be an application of these practices to molecular property prediction.
- The effectiveness of the proposed framework is not convincingly demonstrated. The evaluation does not establish a clear benefit over existing coding agents supplied with the same guidance, or reliably isolate the contribution of expert guidance. The authors need stronger evidence that the proposed framework improves accuracy, reliability, or efficiency beyond executing a prescribed modelling solution.
Questions for authors
- Could the authors demonstrate what the proposed hierarchy adds over a single coding agent given the same guidance, data, and tools?
- Could the authors repeat the agent comparisons with consistent run counts and matched resource limits to establish whether the reported differences are reliable?
- Could the authors isolate the effect of expert guidance under otherwise identical conditions, using guidance fixed before access to evaluation outcomes and an untouched test set?