Skip to content
#small language model Open access

scACORN: Context-engineered agent orchestration of specialized small language models for single-cell transcriptomic interpretation

Sep 2026 · bioRxiv · 0 citations · 46 references
Biology

TL;DR

The findings of scACORN support specialization and orchestration as complementary responses to the heterogeneity and evidentiary demands of single-cell analysis.

Abstract

Single-cell atlases now exceed 66 million cells, but turning a ranked expression profile and a free-form biological question into a reliable, evidence-grounded answer remains unsolved. Scaling a single model does not resolve this, because single-cell interpretation is a heterogeneous family of tasks whose correct answer depends on tissue, cohort, perturbation and annotation resolution. Here we present scACORN, an agentic alternative to monolithic single-cell language models that combines specialized small language models with context-engineered agent orchestration for their selection and composition at inference time. Each expert is built in two stages: domain-aligned contrastive adaptation fits a pretrained cell-to-text backbone to the transcriptomic geometry of a target dataset, and geometry-preserving specialization learns question-conditioned biological completions without eroding that geometry. A fixed orchestrating language model agent then selects and combines experts under a natural-language playbook that is itself optimized from textual feedback, with no gradient updates to the orchestrator. Across 10 Tabula Sapiens tissues, domain alignment raised transfer macro-F1 from 0.36 to 0.64 and Recall@5 from 0.87 to 0.97; specialized experts reached 0.89 mean exact-match annotation accuracy; and playbook optimization reduced unsupported gene citations from 14.5% to 3.5%. Our findings support specialization and orchestration as complementary responses to the heterogeneity and evidentiary demands of single-cell analysis.

Read PDF

Similar papers

Sep 2026

scGFormer: A Multi-Scale Graph-Transformer for Cell Type Annotation in Single-Cell RNA Sequencing.

ScGFormer is equipped with a biology-guided adaptive contrastive learning strategy, which is designed to account for zero inflation, balance class distributions, and refine dynamic graphs during training, thereby facilitating robustness and adaptability.

Ziqi Yuan, Hong-Wei Zhang, Cheng Liu et al. · 0 citations
Book Open access Aug 2026

Caduceus: MoE Foundation Models for Unifying Biological and Natural Language

This paper introduces Caduceus, a family of MoE-enhanced foundation models built with a hierarchical pre-training paradigm to jointly integrate biological and natural language, and incorporates a multi-task instruction tuning phase, enabling robust protein parsing and natural language question answering.

Ming-Ze Yin, Yiheng Zhu, Jialu Wu et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Towards a knowledge-enhanced single-cell foundation model

Single-cell foundation models (scFMs) increasingly rely on large-scale transcriptomic pretraining, yet expanding pretraining data can yield diminishing gains while substantially increasing computational cost. Our data scaling analyses showed that incorporating biological knowledge, including cell-level text annotation...

Han-Qing Zhang, Jie Bao, Mei Ma et al. · 0 citations
Open access Sep 2026

Deep generative embeddings of gene expression and splicing reposition the interpretation of single-cell transcriptomic signatures

Single-cell transcriptomic analysis predominantly derives cell identity from gene expression analysis, while alter-native splicing is processed separately despite its fundamental role for cell homeostasis. To overcome the limits of separate investigations, we developed a probabilistic deep learning framework, Crecerell...

Friedrich-Maximilian Weberling, Ioakeim Ampartzidis, I. Mohorianu et al. · 0 citations
Preprint Aug 2026

GenomeHarness: Harnessing Al Agents for Reliable Adaptation of Genome Language Models

GenomeHarness, an agentic harness for adapting genome language models through controlled search over fine-tuning recipes, improves mean test MCC in 47 settings, and shows gains on Genomic Benchmarks and on tasks where the root recipe is unstable or poorly matched.

Weicai Long, Yusen Hou, Houcheng Su et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ProtLingo: Efficient Protein Language Modeling via Conditional Memory and Expert Routing

Proteins perform diverse cellular functions, and even single amino-acid substitutions can alter stability, activity, or molecular interactions. Protein language models (PLMs) provide a scalable approach for modeling such sequence--function relationships from unlabeled sequences, but increasing the size of dense Transfo...

Ming-Rui Li, Si-Xian Shen, Min-Zhang Li et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.