Skip to content

Category

small language model

3,366 papers

#small language model Preprint Aug 2026

DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization

DAMP uses both quantization-error energy and decay-based persistence to identify high-risk channels during offline calibration and stores these channels at higher precision and the remainder in INT8, the first to study post-training quantization of recurrent states in GDN and KDA based language models.

Tao Zhang, Jian-Chao Tan, Ping-Wei Sun et al. · 6 citations · ⚡3
#natural language process... Preprint Aug 2026

AI Writers Have a Consistent Stylometric Footprint, but AI Editors Do Not

It is shown that AI generation leaves a consistent ``stylometric footprint'': a small subset of features, primarily entropy and lexical diversity, consistently separates AI-generated text from human writing across 8 LLMs and 5 domains, while the remaining features depend heavily on the domain and generator.

Zhengyang Shan, Yukyung Lee, Sophie Hao · 0 citations
#natural language process... Preprint Aug 2026

Speculative Probing: LLM Monitoring at Speculative-Decoding Cost

It is found that the speculative-decoding module in recent LLMs can be repurposed for efficient high-quality classification by appending a trained soft prompt at the end of the target sequence, which can repurpose the speculative-decoding module into a sequence classifier.

Collin Zhang, Tingwei Zhang, Vitaly Shmatikov · 0 citations
#small language model Preprint Aug 2026

Training-Free Temporal Abstraction for General Video Understanding

STITCH is presented, a training-free method that divides a video into semantically meaningful temporal chunks that are computed once per video and reused across tasks, suggesting that reusable temporal abstraction is a promising direction for general video understanding.

Etienne Casanova, S. Brodjian, Pietro Perona · 0 citations
#small language model Preprint Aug 2026

NumBench: Diagnosing Counting Failures in Text-to-Image Models

The Confidence-Weighted Numeric Precision Score (\cwnps), which aggregates three calibrated detectors and discounts uncertain proposals, is proposed for scalable evaluation and developed a process model in which requested instances compete for a finite set of resolvable image regions.

Sandeep Wadhwa, M. Vatsa, Richa Singh et al. · 0 citations
#small language model Preprint Aug 2026

Biologically Inspired Mechanisms for Facilitating Grokking in Multilayer Perceptrons

The results support the common principle that explicit regulation of neuron utilization and effective connectivity can improve the emergence of generalizable internal computation and motivate broader investigation of biologically inspired activity regulation and adaptive sparsification, including in large language mode...

Florin Leon · 0 citations
#small language model Preprint Aug 2026

From Documents to Reasoning: A Validated Synthetic Data Pipeline and Semantic-Aware Fine-Tuning for Financial Numerical Reasoning

This work proposes a comprehensive pipeline for improving financial QA systems through high-quality synthetic data generation and fine-tuning of smaller language models (SLMs) using Quantized Low-Rank Adaptation (QLoRA).

Lokendra Birla, Milind Savagaonkar, Visnu Srinivasan et al. · 0 citations
#small language model Preprint Aug 2026

uMOF: A Universal Database, Benchmark, and Machine Learning Interatomic Potentials for Metal-Organic Frameworks

Foundation machine learning interatomic potentials (MLIPs) deliver near-ab-initio accuracy at a fraction of the computational cost, yet their promise for Metal-organic Frameworks (MOFs) remains largely unrealized as large unit cells make first-principles training data expensive to generate, fine-tuned models are scarce...

T. J. Inizan, Prathami Divakar Kamath, Alin M. Elena et al. · 0 citations
#machine learning Preprint Aug 2026

TACIT-Switch: Cost-Aware Model Escalation for LLM Agents from Censored Supervision

This method learns permanent handoff policies from accumulated trajectory evidence and Teacher-Annotated Censored Intervention Times (TACIT) and represents each annotation as an interval-censored observation on a cumulative-risk scale and achieves the highest held-out success among learned policies on both ALFWorld and...

Ji'an Lei, Jian Huang · 1 citation
#small language model Open access Aug 2026

Evaluating teacher-supervised small medical language models for institution-constrained clinical QA.

For institution-constrained clinical QA, in-domain teacher-supervised fine-tuning was the most reliable evaluated adaptation path, and public-benchmark transfer was not a dependable proxy for local utility in the primary internal comparison.

Gao-Yuan Du, D. Dimitriadis, Xue-Ping Li · 0 citations
#small language model Open access Aug 2026

Balancing privacy and performance: the impact of facial defacing on AI in medical imaging

Summary Background Recent NIH Data Management and Sharing (DMS) policy updates and NIH controlled-access data security requirements have increased attention to facial anonymization and controlled-access handling of shared head imaging data. This is particularly relevant for datasets submitted to or hosted by the Cancer...

Yu-Li Wang, Yu-Wei Dai, Haoyue Guan et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.