Skip to content

Category

small language model

2,967 papers

#small language model Preprint Sep 2026

SSD-LLaMA: SSD-Native Inference for Trillion-Parameter MoE at 1+ Token/s on a Consumer PC

An SSD-native local MoE inference system that addresses challenges with an SSD I/O pipeline optimized for expert delivery, a native three-tier storage hierarchy that delivers and retains experts dynamically, and balanced CPU--GPU hybrid execution.

Fang-Zhou Liang, Yibin Shen, Jian-Min Hu et al. · 0 citations
#small language model Review Sep 2026

Single-Token Expected-Value Scoring for Cold-Start Candidate Ranking

A fine-tuned Small Language Model is fine-tuned with a hybrid ordinal regression loss combining a Mean Squared Error term, which preserves ordinal distance, with a categorical Cross-Entropy term, which sharpens class boundaries, which sharpens class boundaries.

Qi-Hang Wang, Jin-Wei Tan, Meng-Yuan Shi et al. · 0 citations
#edge computing Open access Sep 2026

roseNNa

roseNNa is now a code generator. A model is lowered to Fortran 2008 or C11 with literal loop bounds, no runtime shape logic, no allocation and no mutable global state, so infer inlines into a solver's own compute kernel -- including a device kernel. The previous runtime library (fLibrary/) is retired. It parsed a model...

Ajay Bati, Spencer H. Bryngelson · 0 citations
#computer vision Preprint Sep 2026

RankGround: Efficient High-Resolution GUI Grounding via Lightweight Reranker-Guided Crop Selection

RankGround is a two-stage framework that achieves accurate GUI grounding with a single VLM call per query and achieves 1.4 times faster inference and improves localization accuracy by 5.5% on average over the second-best method across all backbones and screen scales, establishing a new state of the art in both efficien...

Li-Yang Fan, Xin-Ping Bi, Yi-Tai Li et al. · 0 citations

TeochewBench: A Human-Reviewed Benchmark for Teochew Hanzi Translation

Teochew has a substantial speaker community and exhibits distinctive lexical, syntactic, and pragmatic features, yet textual resources for evaluating large language models remain limited. We present TeochewBench, a human-reviewed benchmark comprising 300 Teochew Hanzi expressions for evaluating translation from Teochew...

Jia-Nan Wu · 0 citations
#machine learning Preprint Sep 2026

Variational Quantum Transformer Architecture for Synthetic Language Generation

We propose a compact NISQ-compatible quantum transformer architecture for synthetic QNLP sequence modelling. The model preserves the autoregressive next-token interface of a classical transformer, but replaces attention and feed-forward sublayers with variational quantum encoder blocks, connector circuits, decoder bloc...

Julian Hager, Michael Kölle, Gerhard Stenzel et al. · 0 citations
#machine learning Preprint Sep 2026

Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulation

A metric interaction framework that models object-level and scene-level interactions in physical Cartesian space at a shared metric scale and improves diverse VLA and WAM baselines with a small number of additional parameters and training steps is introduced.

Li-Jie Wang, Zheng Lu, Yi-Ming Wang et al. · 0 citations
#machine learning Preprint Sep 2026

Bias Amplification in Multi-Agent Network: How Biased Agents Shape Opinions and Rhetoric

Large language models (LLMs) are increasingly deployed in applications involving interaction between agents, where their output plays a role in collective reasoning and decision-making processes. Despite significant research into the functioning of LLMs in such multi-agent systems, the processes of bias propagation in...

Omran Berjawi, G. Fenza, Rida Khatoun · 0 citations
#machine learning Preprint Sep 2026

Long-Context Demonstration Selection Using State Space Models

We study the problem of demonstration selection, which involves selecting a subset of examples for prepending to a query to a language model. This problem is closely related to in-context learning and language model inference. Since the inference cost of a transformer model scales quadratically with sequence length, th...

Zi-Niu Zhang, Zhen-Shuo Zhang, Ruoxuan Xiong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

A Zeroth-Order Paradigm for LLM Preference Alignment

This paper proposes and analyzes Comparison-based Preference Optimization (ComPO), a zeroth-order alignment method based on comparison oracles, and establishes a convergence guarantee for its basic offline scheme under smoothness, gradient sparsity, and compatibility between the oracle and a latent objective.

Peter Chen, Xi Chen, Wo-Tao Yin et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models

This work introduces physical rank consistency (PRC) to measure how well tokenization preserves local physical distance rankings after reconstruction, and presents ActionPiece, which preserves physical action relationships through joint supervision of representation learning and quantization.

Shijie Lian, Bin Yu, Zhao-Long Shen et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Scaling Articulated Rationales for MLLM-based Recommendation

These findings establish articulated rationales as a useful complement to behavioral and content signals, and demonstrate a practical role for MLLMs in scaling sparse human explanations into preference information that improves industrial recommendation.

Hao-Ke Xiao, Yue-Yang Liu, Yu-Hui Zhang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.