Skip to content
#small language model Open access

A trainable language model with potential to modulate translation rates in non-model organisms by generating upstream untranslated region sequence libraries

Sep 2026 · PLoS ONE · Vol 21 · 0 citations · 35 references
Medicine

TL;DR

A simple generative approach for creating synthetic 5′-UTR libraries based solely on the genomic sequence statistics of any desired organism and demonstrates that simple statistical language model approaches applied to genomic data can generate functional translational regulatory sequence libraries without detailed mechanistic knowledge or explicit reference to consensus motifs.

Abstract

Tuning protein expression in non-model organisms is often constrained by the lack of validated genetic parts and predictive design tools. Translational tuning through the modulation of upstream untranslated regions (5′-UTRs) offers a potentially organism-agnostic route, but existing methods typically rely on mechanistic assumptions, prior knowledge that may not be available in non-model contexts, or the screening of sequence libraries. Here, we present a simple generative approach for creating synthetic 5′-UTR libraries based solely on the genomic sequence statistics of any desired organism. The method uses a sliding-window n-gram language model applied to native 5′-UTR sequences to produce novel sequences that preserve organism-specific base distributions and motifs without hard-coding specific motifs or mechanistic rules into inflexible statistical templates. We have applied this approach to the model bacterium Escherichia coli and the non-model probiotic Limosilactobacillus reuteri. Libraries of approximately 1,000 sequences were generated for each organism, from which about 100 unique sequences were experimentally tested for translation of a fluorescent reporter protein. In both organisms, the synthetic libraries yielded a broad range of translation levels from this relatively small number of tested variants. Sequences derived from an organism’s own genomic statistics provided a more uniformly distributed range of translation rates in that organism than sequences derived from the other species. Correlations of individual sequence performance across the two species were weak, and thermodynamic predictions of ribosome binding strength showed very little predictive power, especially in the non-model L. reuteri. The results demonstrate that simple statistical language model approaches applied to genomic data can generate functional translational regulatory sequence libraries without detailed mechanistic knowledge or explicit reference to consensus motifs. The approach requires minimal computational resources, avoids reproducing native sequences, and can be readily applied to any organism with a sequenced genome. This strategy may lower technical barriers to expression tuning in non-model organisms.

Read PDF

Similar papers

Open access Aug 2026

Assessing Codon Language Models for Context-Aware Codon Optimization in Nucleic Acid-Based Medicines

In vitro data showed that MLM-designed variants outperformed conventional and commercial-vendor-derived sequences in both transient and stably integrated expression, supporting the models’ ability to capture translational context beyond codon frequency.

Shushan Toneyan, Kerstin Scholz, C. de Donno et al. · 0 citations
Open access Sep 2026

EPIC: An open community challenge for sequence-based prediction of transcription initiation in five non-model metazoans

EPIC, the Eukaryotic Promoter and transcription Initiation prediction Challenge, relies on understudied animals spanning three phyla: octopus, oyster, milkweed bug, Indian meal moth, and shark and is open to everyone.

Ilya E. Vorontsov, Nikita Gryzunov, Bayley R. McDonald et al. · 0 citations
Open access Sep 2026

Predicting genome-wide functional constraints with GPN-Star.

GPN-Star substantially outperforms previous methods in prioritizing pathogenic and fine-mapped genome-wide association study variants, yields strong enrichments of complex trait heritability and improves power in rare variant association testing, which positions GPN-Star as a scalable, powerful and flexible tool for ge...

Cheng-Zhong Ye, Gonzalo Benegas, Carlos Albors et al. · 1 citation
Open access Aug 2026

MetaTIS: a tool to predict cognate and near-cognate translation initiation sites in human

A meta-model termed MetaTIS was implemented by combining outputs of genomic and protein language models fine-tuned on Ensembl annotations of transcripts and five different TIS datasets, which proficiently differentiates between spurious and true TIS in four distinct test sets, for both AUG and non-AUG instances.

Aram N. Papazian, Volkhard Helms · 0 citations
#machine learning Preprint Sep 2026

LEMON-ZEST: Evolution-Informed Tokenization for Efficient Protein Language Modeling

Protein Language Models (PLMs) have made remarkable progress following scaling laws established in natural language processing across sequence- and structure-based tasks, yet the potential of tokenization remains underexploited. Unlike human language, proteins preserve structure despite extensive sequence variation a p...

Biswajit Banerjee, Claudia A. Carreno, Anton S. Petrov · 0 citations
Open access Sep 2026

LAMBDA: a prophage detection benchmark for genomic language models.

This work introduces LAMBDA, a benchmark designed to rigorously evaluate genome language model embeddings through phage-bacteria sequence discrimination across four categories of increasing complexity: probing tasks, fine-tuning assessments, diagnostic tests, and genome-wide prophage detection.

LeAnn M. Lindsey, Nicole L. Pershing, K. Dufault-Thompson et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.