Skip to content

Category

small language model

2,906 papers

#natural language process... Preprint Sep 2026

Euston: Training Away Mathematical Sycophancy Without Losing the Mathematics

Euston is presented, an 8B mathematical claim-verification model trained to resist the all-false composition of the official evaluation sets and the low precision implied at realistic error prevalence, which is principally the all-false composition of the official evaluation sets.

Ze-Hua Cheng, Wei Dai, Jia-Hao Sun · 0 citations
#artificial intelligence Preprint Sep 2026

Block-Sparse Attention with Semantic-Geometric Decoupled Routing

Semantic-Geometric Decoupled Routing is proposed, a training-free block routing framework that shifts semantic aggregation to the pre-RoPE space and reconstructs geometric bias with an offline structural prior and relative block distances and yields an explicit closed-form block routing score without token-level search...

Xin-Wei Long, Wei-Gao Sun, Wei-Bo Gao et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Toward Personalized Sleep Guidance from Wearable Data Using Language Models

Experimental results demonstrate the method outperforms commercial general and medical LLMs and open-source models and human evaluation further supports the quality of the generated guidance and the feasibility of personalized sleep guidance with SLMs.

Yu-Sheng Tan, Run-Ning Zhao, Sofia Angel et al. · 0 citations
#natural language process... Preprint Sep 2026

Apollo Restore: A Foundation LLM for Historical Greek Optimized for Fill-in-the-Middle Restoration of Ancient Greek Texts

We present Apollo Restore, a 24-billion-parameter large language model for restoring lacunae---physical gaps---in fragmentary Ancient Greek texts. Fine-tuned from Mistral Small with a fill-in-the-middle objective, Apollo Restore reconstructs missing spans without requiring oracle knowledge of their length. To our knowl...

Hope McGovern, A. Dolganov, Samuel Belkadi et al. · 0 citations
#machine learning Preprint Sep 2026

PSD: Pseudo Self-Distillation of Memory Representation Capabilities for LLM Agents

Pseudo Self-Distillation is presented, a framework that enables small language models to construct hierarchical memory representations by distilling behavior from a strong black-box oracle through a multi-stage training pipeline, with off-policy PSD achieving the strongest results across most conditions.

Pirzada Suhail, Meng-Lin Xia, Xu-Chao Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

MolSC: Leveraging Substituent Contributions to Enhance Fine-grained Molecular Understanding in LLMs

Recent advances in natural language processing have led to molecular Large Language Models (LLMs) with strong performance across diverse chemistry tasks. However, they still struggle to capture fine-grained structure-property relationships, particularly how small, localized modifications alter a molecule's behavior. To...

Hyuntae Park, Sooyeon Kim, J. Park et al. · 0 citations
#machine learning Preprint Sep 2026

Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, but fine-tuning them with reinforcement learning (RL) remains constrained by the cost of real-world robot interaction. Model-based reinforcement learning (MBRL) reduces this cost by using a learned world model to generate...

Yi-Fei Sheng, Hao-Xiang Ren, Zhilong Zhang et al. · 0 citations
#small language model Open access Sep 2026

Small Models, Big Claims: Choosing and Quantizing Local LLMs on an Integrated GPU

Running large language models locally on integrated graphics is now practical, but the community's model-selection advice is dominated by vibes: "just grab a 2B at Q4." This report presents a controlled, single-machine measurement study of twelve model/quantization configurations across three model families (Qwen2.5-1....

D. Zaragoza Rodriguez · 0 citations
#small language model Open access Sep 2026

Representation over Architecture: A Protocol-Controlled Attribution of Frozen ESM-2 Embeddings versus Encoder Design for Secondary Structure Prediction on CB513

Protein secondary structure prediction (PSSP) on the CB513 benchmark [30] has been near a plateau for close to a decade, and many recent models add protein language-model (pLM) representations on top of increasingly elaborate encoders. How much of a reported gain comes from the representation, and how much from the enc...

Afaque Alam, Mukesh Kumar · 0 citations
#small language model Open access Sep 2026

The "Sphere of Influence" Is Three Spheres, and Dividing the Mass Ratio by 1000 Shrinks Them Differently ── Earth's Hill radius is 1,496,433 km, Laplace's sphere of influence 924,554 km and the point of equal gravitational pull 258,781 km, the largest exceeding the smallest by 5.7826 ── the Moon lies inside the first two and outside the third ── [Paper 505]

A planet’s sphere of influence is taken to be one radius. This paper shows that there are three definitions, with exponents 1/3, 2/5 and 1/2──so changing the mass ratio moves the three apart. No new theorem or law is claimed. Scope of this paper (scope note): No new theorem or law is claimed──the Hill radius and Laplac...

Yuuki Yamagishi · 0 citations
#small language model Dataset Open access Sep 2026

Historical Detective Fiction: An Annotated Bibliographic Dataset of 301 Novels and Series (first publications 1594–2023)

About This is a single-author, source-verified bibliographic dataset of 301 works of historical detective fiction – single novels and whole series, first published between 1594 and 2023, in 36 original languages, in 46 countries. Each of the 301 entries is a bibliographic record carrying an annotation, describing why t...

Marina Bulakhova · 0 citations
#small language model Open access Sep 2026

The 2.5 in the Viscosity of a Suspension Comes Not from the Volume of the Particles but from the Stress They Place on the Flow Outside ── for the Stokes solution of a sphere in a uniform straining flow, the surface integral of the stress over the sphere (the stresslet) is 20π/3 times viscosity, radius cubed and strain, and dividing by the particle volume 4π/3 gives 2.5; solving viscosity and diffusion for two unknowns, a change of the coefficient from 1 to 2.5 moves Avogadro's number by a factor 1.581139 ── the separator is whether one counts the volume inside the particle or the stress outside it ── [Paper 1024]

A liquid with small spheres mixed in at volume fraction φ has, when dilute, (1 + 2.5φ) times its original viscosity. Einstein wrote the coefficient as 1 in his 1906 doctoral thesis and corrected it to 2.5 in 1911. This paper checks the Stokes solution for a sphere in a uniform straining flow by symbolic computation, ob...

Yuuki Yamagishi · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.