Predicting macroscopic properties of crystalline materials from atomic structure remains a central challenge in computational materials science. We introduce Pformer, a modular crystal representation framework built around a Fourier-inspired source encoder. The source model is trained by supervised scalar-property regression from atom attributes and Cartesian coordinates; its Fourier analysis network (FAN) transformation applies sine, cosine, and GELU branches to learned latent projections before Transformer encoding. After source training, Pformer extracts the learned atom-embedding weight matrix, adapts its width when required, and uses it to initialize message-passing graph neural networks and transformer-based crystal encoders for downstream property prediction. We denote each initialized downstream variant as FAN-Backbone (e.g. FAN-PotNet); here FAN identifies the source-encoder component that produced the transferred weights, whereas Pformer denotes the complete transfer framework. On the Materials Project benchmark, FAN-PotNet reduces the bandgap mean absolute error (MAE) from 0.204 to 0.149 eV, and FAN-GATGNN lowers the shear modulus MAE from 0.075 to 0.022 log(GPa). On JARVIS-DFT, FAN-PotNet decreases the total energy MAE from 0.032 to 0.017 eV atom −1, and FAN-ComFormer improves the Ehull MAE from 0.048 to 0.045 eV. These benchmark comparisons show lower MAE for selected backbone–property combinations and ties for others, indicating that the effect of FAN-derived initialization depends on the downstream architecture and target property.
A unified AI-based framework for data-efficient property prediction and controllable crystal generation is established, demonstrating how graph learning, multimodal representations, and generative models can reduce computational cost and improve the scalability of materials.
Crystal structure prediction (CSP) is fundamental to computational materials discovery. Generative models including CDVAE, DiffCSP, FlowMM, and CrystalFlow learn stable-crystal distributions directly, but diffusion and flow-matching inference requires tens to thousands of sequential network evaluations per candidate. W...
Sourin Dey, Dipannoy Das Gupta, Wei Lai et al.· 1 citation
Protein mutation effect generation asks a model to describe the functional consequence of a point mutation in natural language. Existing protein-to-text systems typically encode mutation information into undifferentiated representations, overlooking the organization of mutation-induced evidence across structural and bi...
Liuzhenghao Lv, Yu-Yang Liu, Yu-Yang Gao et al.· 0 citations
This work introduces Wide Encoded Extended Connectivity Fingerprints with Substructure Rotary Graph-distance Encoding (SuRGE), a tokenized hierarchical Morgan representation in which graph-distance-dependent rotations are applied at the input and within transformer self-attention.
Identifying crystalline materials with intrinsically low lattice thermal conductivity (κL) remains a major challenge in thermoelectric design due to complex phonon transport mechanisms and the limited availability of high-quality datasets. Although first-principles methods provide accurate κL predictions, their high co...
The limited transferability of machine-learned interatomic potentials (MLIPs) to unseen chemical compositions constrains their utility in computational materials discovery. We present a systematic investigation into two interdependent design principleslearned atomic representations and cross-element parameterizationt...
M. Taleblou, Franco Pellegrini, Stefano de Gironcoli· Journal of Chemical Informat...· 0 citations
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
MIT News · Artificial Intelligence· news.mit.eduJul 15, 2026
Assistant Professor Pat Pataranutaporn describes a new interface that lets everyday users glimpse inside an AI's neural network before their chatbot ever says a word.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.