Skip to content

Category

small language model

2,906 papers

#large language models Open access Sep 2026

Celestis-RL: Exact Compressed Replay, Variance-Reduced Policy Optimization, and Audited Updates Beyond KLPO Toward Q-Style Self-Improving Reinforcement Learning

Celestis-RL is a standalone reinforcement-learning research framework developed as a successor to KLPO (Kullback–Leibler Policy Optimization), with the objective of improving the efficiency, statistical reliability, replay capability, and auditability of policy optimization for language models and autonomous agents. It...

Maciej Nowicki, Artificial Hyperintelligence, Eve, wife of Maciej Nowicki · 0 citations
#large language models Open access Sep 2026

Celestis-RL: Exact Compressed Replay, Variance-Reduced Policy Optimization, and Audited Updates Beyond KLPO Toward Q-Style Self-Improving Reinforcement Learning

Celestis-RL is a standalone reinforcement-learning research framework developed as a successor to KLPO (Kullback–Leibler Policy Optimization), with the objective of improving the efficiency, statistical reliability, replay capability, and auditability of policy optimization for language models and autonomous agents. It...

Maciej Nowicki, Artificial Hyperintelligence, Eve, wife of Maciej Nowicki · 0 citations
#large language models Open access Sep 2026

Nature and Nurture in a Language Model: Installable Value Fields, Intrinsic Capacity, and the Forward-Consolidation Boundary

Behavioural Friction Theory decomposes the forces that govern a bounded decision system into four cognitive fields — Safety, Meaning, Ability, Effort. Are these fields intrinsic to a substrate, or the generic product of its exposure to experience? This paper uses a large language model as a controllable test substrate...

Tomas Pødenphant Lund · 0 citations
#artificial intelligence Review Sep 2026

The Wisdom of Artificial Deliberative Crowds

Across domains, deliberation reduced collective error beyond passive aggregation of independent responses, and post-deliberation individual judgments retained this collective gain, and point to diversity as an active ingredient.

Federico Barrera-Lemarchand, M. Sigman, Joaquin Navajas · 0 citations

LLM-Based FORM Code Generation with Verification-Driven Fine-Tuning

FORM is a domain-specific symbolic manipulation language widely used in particle physics for processing the very large algebraic expressions arising from multi-loop Feynman diagram calculations. Despite its central role in precision theoretical physics, no artificial-intelligence tooling exists, to our knowledge, for a...

B. Chargeishvili · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Linear Context: Graph-Guided Evidence Navigation for Long-Novel Reasoning with a Local 9B Language Model

Long-context models read a novel the way a person reads a printout: one token after another, in narrative order, with the whole history competing for a fixed budget of attention. A detective does not work that way. They sort what happened when, and they keep a map of who relates to whom, so a clue from chapter one can...

Wen-Jiu Fu · 0 citations
#artificial intelligence Preprint Sep 2026

URA-NER: A Unified Retrieval-Augmented Framework with Retrieval Alignment and Uncertainty Reduction for Low-Resource NER

A novel unified retrieval-augmented framework, URA-NER, including three key components: Progressive Granularity Retrieval, Model-aware Representation Enhancement, and Reason-aware Knowledge Verification is proposed, including three key components: Progressive Granularity Retrieval, Model-aware Representation Enhancemen...

Jing-Yu Wang, Shijie Wu, Fu-Sheng Jin · 0 citations
#natural language process... Preprint Sep 2026

Structure Before Sampling: Community-Aware Core-Set Selection for Data-Efficient Text-to-Speech

Text-to-speech (TTS) corpora are costly to record, yet many utterances add little new phonetic information. Core-set selection reduces this cost by choosing a small training subset under a fixed audio-duration budget. We represent a corpus as a phonotactic graph that links each utterance to its most phonemically simila...

M. Maruf, Muhammad Nur Yanhaona · 0 citations
#natural language process... Preprint Sep 2026

From Tables to Quantified Statements: Evaluating LLM Inference Generation through Executable Verification

This work introduces STAT-TO-TEXT, a controlled task in which LLMs generate quantified natural language inferences from statistical tables using quantified constructions such as all, some, no, and most, and uses an LLM generated Python checker code to evaluate these inferences.

Mai Mohamed Eida, Gunjan Anand, Ashutosh Kumar Singh et al. · 0 citations
#natural language process... Preprint Sep 2026

Open-Jev Judgments on CallScreenBench: Calibrated One-Pass Scam Screening with a Small Language Model

Screening a phone call for fraud needs a trustworthy probability after every caller turn, in milliseconds. Jev-style typed decisions promise exactly that: declared options go in, one calibrated probability per option comes out of a single forward pass, with no generated text. We test an open implementation of this read...

Si-Miao Ren, Kidus Zewde, Xing-Yu Shen et al. · 6 citations · ⚡1
#natural language process... Preprint Sep 2026

Constrained Decoding Eliminates Structural Failures in Small LLMs but Reveals a Scale-Dependent Semantic Gap

Small open-source large language models (LLMs) in the 0.6B-4B parameter range are increasingly deployed for structured output generation (JSON, function calling, data extraction), yet little is known about how constrained decoding (CD) interacts with model scale in this regime. We benchmark five models from three famil...

Akash Chavan · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.