A trainable language model with potential to modulate translation rates in non-model organisms by generating upstream untranslated region sequence libraries
A simple generative approach for creating synthetic 5′-UTR libraries based solely on the genomic sequence statistics of any desired organism and demonstrates that simple statistical language model approaches applied to genomic data can generate functional translational regulatory sequence libraries without detailed mechanistic knowledge or explicit reference to consensus motifs.
Abstract
Tuning protein expression in non-model organisms is often constrained by the lack of validated genetic parts and predictive design tools. Translational tuning through the modulation of upstream untranslated regions (5′-UTRs) offers a potentially organism-agnostic route, but existing methods typically rely on mechanistic assumptions, prior knowledge that may not be available in non-model contexts, or the screening of sequence libraries. Here, we present a simple generative approach for creating synthetic 5′-UTR libraries based solely on the genomic sequence statistics of any desired organism. The method uses a sliding-window n-gram language model applied to native 5′-UTR sequences to produce novel sequences that preserve organism-specific base distributions and motifs without hard-coding specific motifs or mechanistic rules into inflexible statistical templates. We have applied this approach to the model bacterium Escherichia coli and the non-model probiotic Limosilactobacillus reuteri. Libraries of approximately 1,000 sequences were generated for each organism, from which about 100 unique sequences were experimentally tested for translation of a fluorescent reporter protein. In both organisms, the synthetic libraries yielded a broad range of translation levels from this relatively small number of tested variants. Sequences derived from an organism’s own genomic statistics provided a more uniformly distributed range of translation rates in that organism than sequences derived from the other species. Correlations of individual sequence performance across the two species were weak, and thermodynamic predictions of ribosome binding strength showed very little predictive power, especially in the non-model L. reuteri. The results demonstrate that simple statistical language model approaches applied to genomic data can generate functional translational regulatory sequence libraries without detailed mechanistic knowledge or explicit reference to consensus motifs. The approach requires minimal computational resources, avoids reproducing native sequences, and can be readily applied to any organism with a sequenced genome. This strategy may lower technical barriers to expression tuning in non-model organisms.
In vitro data showed that MLM-designed variants outperformed conventional and commercial-vendor-derived sequences in both transient and stably integrated expression, supporting the models’ ability to capture translational context beyond codon frequency.
Shushan Toneyan, Kerstin Scholz, C. de Donno et al.· bioRxiv· 0 citations
EPIC, the Eukaryotic Promoter and transcription Initiation prediction Challenge, relies on understudied animals spanning three phyla: octopus, oyster, milkweed bug, Indian meal moth, and shark and is open to everyone.
Ilya E. Vorontsov, Nikita Gryzunov, Bayley R. McDonald et al.· bioRxiv· 0 citations
GPN-Star substantially outperforms previous methods in prioritizing pathogenic and fine-mapped genome-wide association study variants, yields strong enrichments of complex trait heritability and improves power in rare variant association testing, which positions GPN-Star as a scalable, powerful and flexible tool for ge...
Cheng-Zhong Ye, Gonzalo Benegas, Carlos Albors et al.· Nature· 1 citation
A meta-model termed MetaTIS was implemented by combining outputs of genomic and protein language models fine-tuned on Ensembl annotations of transcripts and five different TIS datasets, which proficiently differentiates between spurious and true TIS in four distinct test sets, for both AUG and non-AUG instances.
Aram N. Papazian, Volkhard Helms· NAR Genomics and Bioinformat...· 0 citations
Protein Language Models (PLMs) have made remarkable progress following scaling laws established in natural language processing across sequence- and structure-based tasks, yet the potential of tokenization remains underexploited. Unlike human language, proteins preserve structure despite extensive sequence variation a p...
Biswajit Banerjee, Claudia A. Carreno, Anton S. Petrov· 0 citations
This work introduces LAMBDA, a benchmark designed to rigorously evaluate genome language model embeddings through phage-bacteria sequence discrimination across four categories of increasing complexity: probing tasks, fine-tuning assessments, diagnostic tests, and genome-wide prophage detection.
LeAnn M. Lindsey, Nicole L. Pershing, K. Dufault-Thompson et al.· NAR Genomics and Bioinformat...· 0 citations
Related blog posts
Microsoft Research Blog· microsoft.comOct 12, 2026
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.