Skip to content

Category

small language model

2,925 papers

#machine learning Preprint Sep 2026

The Weight Is Over - Interactive Diffusion on Consumer GPUs

An embedding translator that maps a small text encoder into a large encoder space to cut weight and latency; a reproducible sweep recipe for navigating the speed/quality/memory triangle in diffusion pipelines; and an interactive on-device image generation editor achieving sub-second TTFI on recent GPUs are made.

F. Ganz, Maximilian Mueller · 0 citations
#machine learning Preprint Sep 2026

IntBMoE: Integrating Block-Level Conditioning into Expert Composition for Full-Participation Mixture-of-Experts

IntBMoE is a block-conditioned MoE that decouples all three by pairing dense expert composition with sparse block execution, and shows consistent gains over representative sparse and dense MoE baselines on image classification.

Ran Cheng, Long-Fei Xu, Zheng Liu et al. · 0 citations
#machine learning Preprint Sep 2026

Fast And Accurate Text Content File Type Identification

A common requirement across organizations is to have a tool that can identify file types based on their contents, particularly in the cybersecurity domain where magic numbers and file extensions can not be trusted. While existing tools work well in practice, there is plenty of room for improvement either in terms of co...

Manu Nandan, Michael Brautbar, Edward Raff · 0 citations
#artificial intelligence Preprint Sep 2026

Samsone: A Family of Open Small Audio Language Models for On-Device Inference

The core model, Samsone-134M, establishes a new state-of-the-art for its size class across multiple benchmarks, and the scaling laws of SALMs are explored by introducing Samsone-99M and Samsone-356M, a family of SALMs designed for edge computing.

Piotr Masztalski, Michal K. Grzeszczyk, Olaf Sikorski · 0 citations
#artificial intelligence Preprint Sep 2026

SpecOpt: Contact-Diff Reasoning for Agentic Molecule Optimization Toward Binding Specificity

Off-target protein binding is a major source of adverse effects for small-molecule drugs, yet most structure-based molecular design methods focus on generating selective compounds de novo rather than improving the selectivity of existing, well- characterized drugs. We introduce specificity optimization (SpecOpt), a mol...

Thao Nguyen, Heng Ji · 0 citations
#small language model Review Open access Sep 2026

Using Bibliometric Analysis to Review Research on International Cooperation in Radiation and Nuclear Safety, Nuclear Security, and Nuclear Safeguards

Bibliometric analysis has become an essential methodological tool for mapping the intellectual and structural landscape of academic fields, yet it remains rarely applied to the study of international cooperation in radiation and nuclear safety, nuclear security, and nuclear safeguards. This paper uses a bibliometric ap...

Anh Thi Thuy Bui · 0 citations

Language Interpreter: Evaluating Speech Recognition Errors in Speech to Text Translation

This study presents a reproducible synthetic benchmark for evaluating error propagation in a speech-to-text pipeline that links acoustic condition, transcription-error type, deterministic normalization, phrase-aware mapping, sentence correctness, and semantic preservation on the same records.

U. A. D. Priyanka D. Vaidya · 0 citations
#small language model Open access Sep 2026

Interaction Profiles as a Universal Language for Generative Molecular Design with ShEPhERD–2

The application of a single model to bioisosteric fragment merging, dual-target design, selectivity engineering, and modality hopping without task-specific retraining is demonstrated and established interaction profiles as a chemotype-agnostic interface between structure hypotheses and molecular design.

Kento Abeywardane, Kenji Walker, Connor W. Coley · 0 citations
#artificial intelligence Review Open access Aug 2026

The Coordination Compression Trap: A Dynamic Model of AI-Enabled Productivity, Verification Debt, and Organisational Resilience in Global Knowledge Firms

Aims: This study develops a dynamic explanation for the gap between task-level artificial intelligence productivity and durable enterprise value. It introduces verification debt, the accumulated stock of unverified assumptions, weak review, concealed dependencies, deferred validation, and capability loss. Study Design:...

Kwan-Hong Tan · 2 citations
#small language model Open access Sep 2026

RIFA: A Family of Efficient Small Language Models for Practical Bilingual Text Generation

We present RIFA, a family of efficient small open-weight language models designed for practical bilingual text generation. The series consists of five models ranging from 0.5B to 3B parameters: Rifa- Nano (0.5B), RIFA-CODE (0.6B), RIFA-Edge (0.6B), RIFA-FLASH (1.7B), and RIFA-PRO (3B). Each model is fine-tuned for conv...

SM Shahbaj · 0 citations
#small language model Open access Sep 2026

NUMEN Verified Core Library v3.0: Formal Specification & Architectural Synthesis

NUMEN is an integer-oriented operating-system substrate whose mechanisms include exact arithmetic, quaternary strand representations, residue lanes, admission checks, and hash-linked records[1]. The NUMEN Verified Core Library v3.0 provides standalone mathematical reference specifications for these core mechanisms and...

LLC Dragolich Research Labs · 0 citations
#small language model Open access Sep 2026

RIFA: A Family of Efficient Small Language Models for Practical Bilingual Text Generation

We present RIFA, a family of efficient small open-weight language models designed for practical bilingual text generation. The series consists of five models ranging from 0.5B to 3B parameters: Rifa- Nano (0.5B), RIFA-CODE (0.6B), RIFA-Edge (0.6B), RIFA-FLASH (1.7B), and RIFA-PRO (3B). Each model is fine-tuned for conv...

SM Shahbaj · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.