Skip to content
#small language model Open access

Protein Language Model Embeddings Recover Evolutionary and Functional Organization Across the Ras Superfamily.

Sep 2026 · Journal of Molecular Evolution · 0 citations · 24 references
Medicine

TL;DR

Analysis of a curated Ras superfamily dataset indicates that protein language model embeddings provide an effective alignment-free representation of Ras family and subfamily organization, and can highlight candidate sequence regions associated with functional specialization from sequence alone.

Abstract

The Ras protein superfamily comprises small GTPases that share a conserved G-domain but differ in flanking regions, regulation, and cellular roles. Because existing classifications rely mainly on G-domain phylogeny, this superfamily provides a useful test case for assessing whether protein language model embeddings recover biologically meaningful sequence organization consistent with established evolutionary classifications. Here, we analyzed a curated Ras superfamily dataset using three classification schemes: the classical five-family view, a G-domain phylogeny-based classification, and UniProtKB family annotation classification. We compared embeddings from multiple protein language models using supervised classification, unsupervised clustering, and residue-level ablation. Sequence-derived embeddings recovered known Ras superfamily organization across analyses. In supervised analyses, simple linear classifiers achieved high performance, indicating that Ras family and subfamily information is linearly accessible from sequence-derived embeddings. In unsupervised analyses, ESM-C-300 layer 12 gave the strongest full-protein recovery of the G-domain phylogeny-based classification, whereas ProstT5 performed best for G-domain embeddings. Residue ablation identified recurrent candidate subfamily-informative regions both within and outside the G-domain, including signals mapping to structurally coherent regions associated with subfamily-specific regulatory or interaction-related functions. Together, these results indicate that protein language model embeddings provide an effective alignment-free representation of Ras family and subfamily organization, and can highlight candidate sequence regions associated with functional specialization from sequence alone.

Read PDF

Similar papers

Open access Sep 2026

ContrasTED: contrastive domain embeddings for scalable remote homology classification

ContrasTED uses CATH-supervised center-contrastive learning to project structure-aware embeddings into a domain-level metric space for nearest-centroid superfamily assignment, which separates superfamilies while retaining structural information below 20% sequence identity.

David Miller, Nicola Bordin, Janusan Jeyananthan et al. · 0 citations
Oct 2026

Fast and accurate construction of multiple sequence alignments from protein language embeddings with ARIES.

Multiple sequence alignment (MSA) is a foundational task in computational biology, underpinning protein structure prediction, evolutionary analysis, and domain annotation. Traditional MSA algorithms rely on pairwise amino acid substitution matrices derived from conserved protein families. While effective for aligning c...

Minh Hoang, Isabel Armour-Garb, Mona Singh · 0 citations
Open access Aug 2026

Protein language models and the long tail of functional diversity

It is found that many GigaRef singletons belong to a cluster under alternative parameter settings, suggesting that genomic and metagenomic datasets may require dataset-specific clustering configurations, and it is shown that singletons share mutual information with clustered sequences, making them learnable by PLMs and...

R. Vinod, Samir Char, Ava A. Amini et al. · 0 citations
Preprint Aug 2026

Interpreting Latent Protein Language Model Features with Geometric Annotations

This work introduces an automated and scalable method for interpreting SAE features in ESM-2 by using geometrically inspired features of the protein $\text{C}_\alpha$ backbone, providing a robust method of annotating proteins activated within SAE neurons at a residue level, providing a bridge between mechanistic interp...

S. Setlur, Djordje Mihajlovic, Darrick Lee · 0 citations
Open access Aug 2026

DHST: A Deep Hybrid Structure–Topology Framework for Accurate Protein Function Prediction

DHST is proposed, a deep hybrid structure–topology framework that integrates sequence semantics from a pretrained protein language model with local structural information learned by a residual graph convolutional network and introduces site-specific persistent homology to encode multi-scale topological invariants and a...

Bin Lu, Fujun Xiang, Hai-Long Wang et al. · 0 citations
#protein folding Open access Sep 2026

Mechanistic Interpretability of Protein Language Models Reveals Encoded Structural and Functional Properties of Intrinsically Disordered Proteins

It is shown that ESM-2 exhibits reduced attention on disordered regions, yet still encodes meaningful biological signals, and that both the radius of gyration and individual dynamic contact maps, key characteristics of IDPs, can be obtained from the model logits and embeddings.

Lauren Naworski, Lydia L. Good, Rob M. Scrutton et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.