Open access
Jul 2026
Extending protein language models to a viral genomic scale using biologically induced sparse attention
A long-context protein language model is introduced, trained on entire viral genomes, leveraging a biologically informed sparse attention mechanism in which inter-protein links are inferred computationally and used as sparsity priors.
T. Dejean, Barbra D. Ferrell, Zachary D. Schreiber et al.
· GigaScience · 0 citations