Skip to content

Category

small language model

3,366 papers

#small language model Open access Aug 2026

Pre-registered stakes against a tuned baseline: a one-day ledger of grokking interventions that mostly failed

A one-day, fully pre-registered study of grokking interventions on modular addition and small language models. Main results: (1) published grokking 'accelerators' largely reduce to artifacts of untuned baselines and first-crossing metrics; (2) an auxiliary per-example memory races the network for training CE and, via d...

Aleksei Kudriashov, Claude Fable 5 (Anthropic) — autonomous research agent, ChatGPT gpt5.6-sol (OpenAI) — deep research and review · 0 citations
#small language model Open access Aug 2026

Pre-registered stakes against a tuned baseline: a one-day ledger of grokking interventions that mostly failed

A one-day, fully pre-registered study of grokking interventions on modular addition and small language models. Main results: (1) published grokking 'accelerators' largely reduce to artifacts of untuned baselines and first-crossing metrics; (2) an auxiliary per-example memory races the network for training CE and, via d...

Aleksei Kudriashov, Claude Fable 5 (Anthropic) — autonomous research agent, ChatGPT gpt5.6-sol (OpenAI) — deep research and review · 0 citations
#small language model Open access Aug 2026

AEGIS: Real-Time Latent-Space Backdoor Detection for Dependable and Secure Small Language Model Inference

Backdoor attacks pose a serious threat to small language models (SLMs) because compromised models can behave normally on benign inputs while producing attacker-specified outputs when a hidden trigger is activated. Existing defenses commonly require model retraining, operate only before deployment, rely on input-level s...

Jamal Boussouf, Ismail Lamaakal, Ibrahim Ouahbi et al. · 0 citations
#small language model Open access Aug 2026

That the Same Ellipse Was Three Months Out Was the Evidence of a Different Cause ── Aberration Is 20.49552 Arcseconds Whatever the Distance, While Parallax Goes as Its Reciprocal ── A Factor of 26.6442 at Proxima and 20495 at a Kiloparsec ── [Paper 328]

Over a year a star traces a small ellipse on the sky. This paper asks whether that ellipse is one thing──the answer is that there are two, and they are told apart by phase. No new mathematical theorem and no new law is claimed. Scope of this paper (scope note): No new mathematical theorem and no new law is claimed──abe...

Yuuki Yamagishi · 0 citations
#small language model Open access Aug 2026

The geopolitics of Artificial Intelligence: Technological Dependence and Digital Sovereignty in Developing States

Artificial intelligence is becoming part of the way countries develop their economies, educate their populations and provide digital services. At the same time, the resources needed to build advanced AI systems are concentrated in a relatively small number of countries and companies. This creates an important question...

Gulira'no Abdullayeva · 0 citations
#small language model Open access Aug 2026

Two Curves Agree to Within 0.083 Per Cent and Are Not the Same Curve ── What Divides the Catenary from the Parabola Is Not Shape but Which Length the Load Is Counted Along ── [Paper 327]

A hanging chain and a suspension-bridge cable cannot be told apart by eye. This paper asks what divides them──the answer is not the shape, but which length the load is counted along. No new mathematical theorem and no new law is claimed. Scope of this paper (scope note): No new mathematical theorem and no new law is cl...

Yuuki Yamagishi · 0 citations

Capacity vs. architecture: an evaluation of SLMs for automated docstring generation

A reproducible, human-validated evaluation framework applied to 13 strategies—four architectural families crossed with four reasoning variants crossed with four reasoning variants—across three SLMs spanning 3B–14B parameters, plus targeted ablations.

Balaji Venktesh, Amsaprabhaa M, G. Sundaram · 0 citations
#small language model Open access Aug 2026

Contract-Grounded Cognitive Composition: Deterministic Topology, Interface Contracts, and Local Validation in LLM Multi-Agent Systems

This release presents Contract-Grounded Cognitive Composition (CGCC), an engineering framework for improving the reliability of LLM multi-agent systems through deterministic workflow topology, shared interface contracts, and local validation. The study reports three exploratory experiments conducted with a local qwen3....

Zhongren Wang · 0 citations
#small language model Review Open access Aug 2026

Toward Automating the Selection of Articles Reporting EQ-5D Data for Systematic Literature Reviews Using Large Language Models: Algorithm Development and Evaluation Study

The models reproduced human screening tendencies despite the small dataset size, demonstrating the technical feasibility of LLM-assisted article selection and providing the first demonstration of LLM-assisted identification of EQ-5D data in biomedical literature.

Gábor Kertész, J. Czere, Z. Zrubka et al. · 0 citations
#small language model Open access Aug 2026

The Length That Sets How Thick an Atmosphere Is Also Sets Whether It Stays ── Earth's Scale Height Is 7.319 km, 0.1149% of the Radius ── The Number Deciding Escape Is the Reciprocal of That Ratio ── [Paper 321]

An atmosphere has one length in it, H=kT/(mg). This paper asks what that length decides──the answer is both the thickness and whether the atmosphere stays. No new mathematical theorem and no new law is claimed. Scope of this paper (scope note): No new mathematical theorem and no new law is claimed──scale height, the is...

Yuuki Yamagishi · 0 citations
#small language model Open access Aug 2026

Stretching a Concept to Breaking Point: An Empirical Audit of a Taxonomy of Conceptual Tensions

A glass-box creativity engine, the Concept Collider, rests on a single primitive: a concept is not merely a point but a structure held under tension, and pressing it along one of seven fracture types breaks it in a characteristic way. That taxonomy is load-bearing—every profile, every homology score, every negative-spa...

Sebastian Wahl · 0 citations
#small language model Open access Aug 2026

That the Same Ellipse Was Three Months Out Was the Evidence of a Different Cause ── Aberration Is 20.49552 Arcseconds Whatever the Distance, While Parallax Goes as Its Reciprocal ── A Factor of 26.6442 at Proxima and 20495 at a Kiloparsec ── [Paper 328]

Over a year a star traces a small ellipse on the sky. This paper asks whether that ellipse is one thing──the answer is that there are two, and they are told apart by phase. No new mathematical theorem and no new law is claimed. Scope of this paper (scope note): No new mathematical theorem and no new law is claimed──abe...

Yuuki Yamagishi · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.