Skip to content

Category

small language model

3,366 papers

#small language model Preprint Aug 2026

StrategyBench: Evaluating Explicit Strategy Induction in Large Language Models

This work proposes StrategyBench, which selects strategy-inducible tasks from BIG-Bench, constructs reference strategies, and defines evaluation metrics along two dimensions: strategy quality and downstream utility, and experiments show that explicit strategy utility differs substantially across task categories and dep...

Jing-Han Tan, Yuanzhe Wang, Lu Chen et al. · 0 citations
#small language model Preprint Aug 2026

Systematic Bias in Green Patent Classification: Silent Green and False Green

Green-patent indicators based on Cooperative Patent Classification Y02 tags increasingly inform research, industrial policy, and climate-oriented investment, yet their construct validity has not been evaluated at corpus scale. We ask whether Y02 classification errors are random measurement noise or systematic, directio...

Hamid Bekamiri, Jan Auernhammer, Milad Abbasiharofteh et al. · 0 citations
#small language model Preprint Aug 2026

HelaBERT: Enhancing Sinhala Language Understanding with Dual Pooling Classification Head

We present HelaBERT, a family of two BERT-based masked language models pre-trained from scratch on approximately 1 billion tokens of Sinhala text sourced from MADLAD-400, CulturaX, and a custom corpus comprising news articles, Sinhala Wikipedia, and web crawl data. HelaBERT-Small (~23.3M parameters, 6 layers) and HelaB...

Thisen Ekanayake, Nisansa de Silva · 0 citations
#small language model Preprint Aug 2026

Predicting the scale limits of social mechanisms in agent societies

An audit is introduced that predicts a mechanism's fate as a population grows, asking how often the mechanism can act, whether agents use the information it supplies, and whether the measurement itself creates apparent scale effects.

Zeng-Qing Wu, Chuan Xiao · 0 citations
#natural language process... Preprint Aug 2026

FormuEvo: LLM-Guided Evolution for Discovering Solver-Efficient Mixed-Integer Programming Formulations

A solver-informed diagnosis mechanism that exploits fine-grained solver statistics as verbal gradients for targeted refinement and a structured memory abstracts prior experience into reusable modeling strategies, avoiding redundant exploration while enabling zero-shot transfer to unseen problems and bootstrapping small...

Haofeng Yuan, Jianing Peng, Jieyi Bi et al. · 0 citations
#small language model Preprint Aug 2026

A Reproducible, License-Aware Distillation Recipe for CPUDeployable Safety Classification

A reproducible, license-aware knowledge-distillation recipe addressing the constraint of deploying a safety layer for large language models on commodity hardware by partitioning the corpus into seven safety categories aligned to a public hazard taxonomy.

Edson Rodrigues da Cruz, Paulo Ricardo Ferreira Neves, P. H. Falsetti et al. · 0 citations
#small language model Preprint Aug 2026

From Subjective Judgments to Auditable Standards:Protocol-Guided AI Auditing of Website Redundancy

Website redundancy does not have a single fixed meaning. The same repeated element may distract during one task and provide backup during another. We introduce CORA (Counterfactual, Observable Redundancy Audit), which measures repetition load, normal-use tax, and failure-domain recovery reserve separately. Each run ret...

G. Kong, Yong-Tong Cao · 0 citations
#small language model Preprint Aug 2026

Decoupled Physical Modeling and Execution for Physics Reasoning

A unified framework is introduced that distills intermediate representations that explicitly encode the physical modeling process and adopt a two-stage post-training strategy, where supervised fine-tuning establishes structured modeling, and reinforcement learning with rubric-based feedback improves the quality of the...

Ye Zhang, Xue-Hang Guo, Rui Pan et al. · 1 citation
#small language model Preprint Aug 2026

PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understanding

PUMA (Polish Unified Multimodal Assessment) is proposed, a novel benchmark of 900 hand-crafted tasks designed to probe the limits of multimodal models in the Polish cultural and linguistic context and open-source the evaluation framework to advance localized multimodal AI research.

Slawomir Dadas, Michał Perełkiewicz, Rafal Poswiata et al. · 0 citations
#small language model Preprint Aug 2026

What actually runs: a measurement study of language model placement and decode speed on the Apple Neural Engine

This work sweeps a 64-shape matrix of LLM primitives that varies how a computation is expressed while holding what it computes fixed, recording per-operation device support and finds that placement is a property of how a computation is expressed, not of what it computes.

A. ShahirM · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.