UMA-DOS: Transfer Learning from Pretrained Atomistic Models for Density of States Prediction
Abstract
The Density Of States (DOS) is a fundamental spectral property of crystalline materials that governs a wide range of chemical, electronic, and optical properties. Despite its importance, fast but accurate DOS prediction based on machine learning remains challenging because it involves a high-dimensional structured target, the physically meaningful features of which depend on subtle relations between crystal structure and energy-resolved electronic states. Existing machine-learning approaches primarily focus on learning strong structural representations from crystal graphs, but often rely on DOS supervision alone and do not fully exploit the transferable information already learned by large pretrained atomistic models. In this work, we present UMA-DOS, a transfer-learning framework for total DOS prediction built on pretrained UMA backbones. UMA-DOS uses a pretrained atomistic encoder to represent crystal structure, aggregates node-level features into a graph-level representation, and maps this representation to an energy-resolved DOS through a structured spectral decoder with explicit shape–amplitude factorization. Under a unified Materials Project evaluation pipeline, UMA-DOS achieves the strongest controlled performance among the reproduced baselines, with its clearest advantages appearing in shape-sensitive measures of spectral fidelity. Transfer ablations further show that the value of pretraining is realized only through downstream adaptation: frozen transfer underperforms scratch training, whereas end-to-end fine-tuning yields the best results. These findings show that pretrained atomistic representations can transfer effectively to total DOS prediction when paired with a shape-aware spectral decoder and adapted end-to-end.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.