- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a reduced-order, tight-binding-like Hamiltonian model for DNA charge transport. DNA duplexes are represented as graphs, with nodes for bases/contacts and edges for backbone, hydrogen-bond, and contact interactions. A graph attention network reads the graph and outputs the onsite and coupling blocks of a small Hamiltonian, with 1–2 orbitals per base. A differentiable NEGF layer then converts this learned Hamiltonian into transmission , density of states, and local density of states. The model is trained only on DFT+NEGF transport observables, not directly on an ab initio Hamiltonian.
The headline claims are that the direct model is better in distribution, while the Hamiltonian model extrapolates better on longer held-out transmission spectra, and that two orbitals per base, four GNN layers, and LDOS+T supervision are preferred. The main contribution is therefore not a new ML architecture per se, but the combination of a reduced-order Hamiltonian, differentiable NEGF supervision, and DNA transport data. Validation is primarily through spectral fitting, ANOVA-selected design choices, and limited length extrapolation.
Critical strengths
-
The differentiable NEGF layer is a conceptually useful inverse-modeling setup. The paper’s main idea is to learn a Hamiltonian only through transport observables using a differentiable NEGF readout. This is scientifically interesting because it treats Hamiltonian construction as an inverse problem constrained by physical response functions. If it worked robustly, it could provide a compact, interpretable surrogate for expensive DFT+NEGF calculations and enable reasoning about onsite energies, couplings, and contact effects. This is consequential for the review because it gives the paper a genuine physics-informed ML contribution rather than just another spectral regression model.
-
The dataset and experimental design are unusually systematic for a domain paper. The authors generate a nontrivial DFT+NEGF dataset, run a full-factorial ANOVA over several architecture and supervision choices, use multiple seeds, and release code/data/checkpoints. The ANOVA helps expose trade-offs such as the benefit of two orbitals, the cost of four-layer message passing in terms of contact drift, and the irrelevance of geometry features for idealized B-DNA. This is consequential because reproducibility and careful ablation are strengths at ICLR, and the dataset itself may be useful to the DNA transport community even if the modeling claims are not fully convincing.
Critical weaknesses
-
The central motivation, which is a reduced-order Hamiltonian can faithfully describe DNA charge transport, is not established. The paper claims to produce a physically accurate reduced-order Hamiltonian that simplifies modeling of large DNA molecules. However, it never validates the learned Hamiltonian against a projection or downfolding of the DFT Hamiltonian, even though the dataset contains Fock and overlap matrices. It also does not show that 1–2 orbitals per base can capture the relevant physics. Prior work cited by the authors indicates that DNA transport involves many delocalized occupied orbitals rather than a simple frontier-orbital picture. The learned model cannot reproduce sharp localized LDOS peaks in heterogeneous sequences, and the learned onsite energies drift by a median of about 0.39 eV depending on the contact configuration. That means the “Hamiltonian” is not a clean, transferable molecular Hamiltonian. It is contact-dependent and effectively tuned to reproduce selected observables. This is consequential because it undermines the paper’s main scientific claim. Without evidence that the reduced Hamiltonian is physically meaningful or systematically connected to the DFT Hamiltonian, the model is better described as a physics-constrained spectral predictor, not a validated reduced-order electronic structure model.
-
The empirical evidence for the key out-of-distribution advantage is weak and partly selected on the test set. The final seed and architecture were selected using the 12-bp and 16-bp held-out losses, and the ANOVA also considered those same out-of-distribution metrics. The held-out set contains only 8 records. The Hamiltonian model wins on held-out transmission, but the direct model is equal or better on held-out DOS. The abstract’s claim that the Hamiltonian model wins “in each case” is therefore too broad. There are also inconsistencies: the in-distribution gap is reported as 1.9× in the abstract and 1.7× in the main text, and the final model uses LDOS+T supervision even though Table 3 suggests DOS+T is the best main effect for several transmission metrics. These issues are consequential because the main reason to prefer the Hamiltonian model over the direct baseline is its supposed length extrapolation. If that advantage is selected on the test set, based on only 8 records, and limited to transmission while DOS behaves differently, then the central empirical claim is not robust.
Questions for authors
- Can you justify the reduced-order Hamiltonian physically? Since the dataset includes Fock and overlap matrices, can you compare the learned Hamiltonian to a projected/downfolded DFT Hamiltonian? Without such a comparison, what evidence supports calling the learned matrix a “physically accurate” reduced-order Hamiltonian rather than a latent variable tuned to fit spectra?
- How should contact drift be interpreted? The learned onsite energies shift by a median of ~0.39 eV across contact configurations. Is this intended as a physical contact perturbation, or is it an artifact of message passing from contact nodes? Can you enforce a contact-independent Hamiltonian and still fit the transport observables?
- What happens on a truly untouched test set? The 12-bp and 16-bp records appear to have been used for seed and architecture selection. Can you lock the architecture and seed before evaluation and report results on a genuinely held-out set? How many independent sequences and contact configurations does that set contain?
- Why does the final model use LDOS+T when the ANOVA tables suggest DOS+T is often best? Table 3 lists DOS+T as the best supervision main effect for several transmission metrics, yet the final model uses LDOS+T. Can you clarify the selection rule and whether the reported final model is optimal under a pre-registered criterion rather than post hoc choice?
- Is the Hamiltonian advantage due to physics or to the loss and readout? The direct model captures peaks better but loses on off-peak and length-dependent values. Did you try a length-aware or peak-weighted loss for the direct model, or a length-conditioned direct baseline? If the direct model matches or beats the Hamiltonian model under such adjustments, what remains of the claimed benefit of the NEGF-constrained architecture?
Thank you for your thorough review of our work, it was helpful and inspired substantial changes described in the general response and improved clarity of which design parameters are important. Contact drift is gone by construction, [Sec. 2.2] and "physically accurate" has been changed to "an effective Hamiltonian whose base-resolved levels absorb the couplings of hundreds of basis functions". [Sec. 4] The new Hamiltonian model architecture does capture sharp LDOS peaks in heterogeneous sequences. [Sec. 4; Figs. 6-7] However, the direct model also improved substantially, and the Hamiltonian model is now lower only on the poly-G repeats. [Abstract; Sec. 4; Fig. 4] The 1.9x and 1.7x were two different quantities (selected pair versus the mean over all runs) and are now labelled. [Sec. 4] Every held-out duplex has all four contact configurations, so the set is 32 records ("8 records" in Section 2.1 was an error). [Sec. 2.1]
To address your questions directly:
While yes, we can justify the physicality of our Hamiltonian matrix with the LDOS comparison, no, we do not train or validate against downfolded matrices by design. In our previous theoretical works applying NEGF to large DFT matrices, the transmission patterns could not be explained by selecting a handful of energy levels. As an alternative approach, we were interested in a characteristic Hamiltonian that fit to the spectral weights (DOS and LDOS) to reproduce the measurable quantity (transmission). With the architecture changes, the fitting of energy levels to the local DOS peaks has improved substantially, but your point remains: this is an effective Hamiltonian that is not unique and does not match up with the DFT framework. We have added references to the work of Cignoni et al. (given by Reviewer 2), who make the same argument that a projected Hamiltonian is not a unique training target and likewise construct an effective one. [Sec. 1]
In the submission, we had hypothesized that contact drift was an additional fitting parameter that could represent orbital fluctuations caused by the application of the self-energy. This was disproven in the updated model: by eliminating the contacts in the input graph, the contact fluctuation was exactly zero and therefore was replaced with LDOS loss as an ANOVA metric. [Sec. 2.4; Table 2] With DOS+T supervision the contact-free model fits validation about as well (0.361 vs 0.356) and extrapolates better, so it is used in the updated submission.
Our selection criteria changed in the updated submission, using only the validation transmission loss for selection, and we have generated a new testing dataset that is untouched during the ANOVA analysis for final verification, scored once under a rule written down in advance. This set contains randomly generated 16-bp duplexes (8 random sequences x 4 contact configurations, 32 records). [Sec. 2.1; App. A.3, Table 5] On it the length-aware direct model has the lower transmission loss on every duplex (mean 0.90 vs 1.36), while every Hamiltonian configuration beats every length-blind (mean-pooled) direct configuration.
In the updated ANOVA, LDOS+DOS+T had a lower mean loss across all transmission metrics, but DOS+T with 2 orbitals per base was the best single configuration (main effects average over the other factors) [Sec. 3.1.1; Table 3]. We chose it by a rule written down before any held-out or untouched result existed: lowest 3-seed-mean validation transmission loss, then the seed with the lowest validation transmission loss. [Sec. 2.4; Sec. 3.2]
The benefit of the Hamiltonian model is that the base dependence is explicit and measurable: this information cannot come out of the direct model. This is especially helpful when looking for resonant effects that can be exploited for molecular electronics. With a length-aware pooling method (sum pooling) added to the direct model, the Hamiltonian model losses were higher everywhere with the exception of transmission loss on the poly-G sequences. The fitting actually flipped: now the Hamiltonian model fits transmission peaks well and only drifts away from the ground truth at off resonant values, while the direct model fits across all energies. [Sec. 4; Fig. 4] We did not try a peak-weighted loss, though fitting to Lorentzians was mentioned as a future approach. [Sec. 4, future work]
We hope the contact-independent Hamiltonian, the level placement against the DFT LDOS and the untouched test set address your concerns, and that you will reconsider your score.