acceptodds
Under review as a conference paper at ICLR 2027

UMA-DOS: Transfer Learning from Pretrained Atomistic Models for Density of States Prediction

Abstract

The Density Of States (DOS) is a fundamental spectral property of crystalline materials that governs a wide range of chemical, electronic, and optical properties. Despite its importance, fast but accurate DOS prediction based on machine learning remains challenging because it involves a high-dimensional structured target, the physically meaningful features of which depend on subtle relations between crystal structure and energy-resolved electronic states. Existing machine-learning approaches primarily focus on learning strong structural representations from crystal graphs, but often rely on DOS supervision alone and do not fully exploit the transferable information already learned by large pretrained atomistic models. In this work, we present UMA-DOS, a transfer-learning framework for total DOS prediction built on pretrained UMA backbones. UMA-DOS uses a pretrained atomistic encoder to represent crystal structure, aggregates node-level features into a graph-level representation, and maps this representation to an energy-resolved DOS through a structured spectral decoder with explicit shape–amplitude factorization. Under a unified Materials Project evaluation pipeline, UMA-DOS achieves the strongest controlled performance among the reproduced baselines, with its clearest advantages appearing in shape-sensitive measures of spectral fidelity. Transfer ablations further show that the value of pretraining is realized only through downstream adaptation: frozen transfer underperforms scratch training, whereas end-to-end fine-tuning yields the best results. These findings show that pretrained atomistic representations can transfer effectively to total DOS prediction when paired with a shape-aware spectral decoder and adapted end-to-end.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.