Skip to content

Category

small language model

3,366 papers

#small language model Preprint Aug 2026

Apodex 1.1: Scaling Agentic Intelligence for Complex Work

Apodex 1.1 reaches the leading performance band despite using a substantially smaller model than many frontier systems, and the 35B-parameter Apodex 1.1 Mini further retains strong working capability in a locally deployable form.

B. An, B. Li, B. Wang et al. · 3 citations · ⚡1
#small language model Open access Aug 2026

MGQL: An Executable, Small-Step Semantics of GQL

MGQL is presented, the first mechanized, small-step operational semantics for a substantial read-only fragment of GQL that is grounded in the ISO/IEC 39075 standard, and it is proved that the type system is sound, ensuring an end-to-end guarantee of well-formed queries yielding results that conform to their declared sc...

Aditya Thimmaiah, Tong-Tong Lin, Milos Gligoric · 1 citation
#small language model Preprint Aug 2026

OPDSearch+: On-Policy Distillation with RL Refinement for Search-Augmented Reasoning

The role of a frozen off-the-shelf instruct model as the teacher in on-policy distillation is investigated, and a key insight is revealed: the teacher reshapes the student's policy distribution so that subsequent RL converges to a superior solution that RL alone cannot reach.

Qi Ye, Zhi-Yuan Gu, Jingjie Xia et al. · 3 citations
#small language model Preprint Aug 2026

Dataset Scarcity Limits Robust Evaluation of Multilingual Embedding Models: A Case Study of Slavic Languages

A two-dimensional framework, specifically tailored for analyzing multilingual embedding benchmarks under dataset scarcity, is proposed and applied on the Slavic-language subset of the MTEB benchmark, revealing severe benchmark sparsity.

Ana Gjorgjevikj, B. Seljak, T. Eftimov · 0 citations
#small language model Preprint Aug 2026

Low-Rank Ternary Adaptation for Fine-Tuning Transformers

Ternary multiplicative adaptation is proposed, which represents discrete updates of ternary weights such as sign flips or zeroing through a low-rank Kronecker factorization into two small ternary matrices applied element-wise to ternary weights.

Alexandru-Dragos Manolache, Yun-qiang Li, Jan van Gemert · 0 citations
#machine learning Preprint Aug 2026

When Do Supervised UQ Ensembles Improve LLM Hallucination Detection? A Robustness Study

A supervised ensembling framework that trains a classifier over heterogeneous UQ-based scorer outputs on a small, domain-specific dataset of labeled LLM responses, then applies it to out-of-sample hallucination classification without retrieval, tools, or reference documents is studied.

Mohit Singh Chauhan, Vipin Gyanchandani, Dylan Bouchard · 0 citations
#small language model Preprint Aug 2026

Parason: Revealing Subtask and Trial Parallelism in LLM Reasoning

Parason is introduced, which reveals and learns both forms of parallelism in LLM reasoning, and identifies Trial Parallelism as the majority of parallelizable reasoning computation, and it becomes increasingly dominant on hard problems.

Zhengyang Zhang, Zijian Zhang, Jiaxuan Gao et al. · 0 citations
#small language model Review Open access Aug 2026

Mechanical Contact Conditions in Wearable Reflectance Photoplethysmography: Scoping Review.

A multilevel conceptual pathway in wearable reflectance PPG is supported, in which mechanical conditions at the sensor-skin interface are associated with changes in PPG signal characteristics, derived features, and, in a smaller body of studies, downstream physiological estimation.

Chenxi Yang, Jiahang Xie, Zifei He et al. · 0 citations
#small language model Preprint Aug 2026

Most of the LLM Routing Gap Is Task Type

This paper argues that a small win does not show that routing did anything, the authors' or anyone else's, and argues that a small win does not show that routing did anything, theirs or anyone else's.

Janghoon Lee · 4 citations
#small language model Open access Aug 2026

The role of linguistic knowledge in verbal fluency tests: How individual differences in language skills shape the mental lexicon.

"List as many words as you can that start with M." The verbal fluency (VF) task is simple, yet even a typical university student only manages to produce about 15 words within 1 min, and there is substantial variability around this mean. The present study examined how linguistic and domain-general abilities contributed...

Kyla McConnell, Berit Reise, Antje S Meyer · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.