Skip to content

Category

small language model

2,967 papers

#artificial intelligence Preprint Sep 2026

Local Sparsity Enables Unsupervised LLM Safety Detection

This work proposes a framework for locally masked SAE-based anomaly detection, supported by theoretical justifications, and demonstrates their ability to capture meaningful safety information while using only 1-2% of SAE neurons for computation.

Xin Chen, Gil Kur, A. Shevchenko et al. · 0 citations
#artificial intelligence Preprint Sep 2026

SoK: Trading Agents or Market Crashers? Dissecting Robustness and Security Failures in Academic Financial LLM Trading Schemes

FARSIGHT (Financial Agent Robustness and Security Investigation and Global Holistic Testing), a framework that performs scheme-level evaluation of financial LLM agents on two axes: robustness under market turbulence and security against three attack types: attacks on information sources, attacks on agents, and agent-as...

Meng-Xiao Wang, Nitesh Saxena · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Depth Truncation: Controlled Evaluation of Depth Utilization in Recursive Language Models

Depth-recurrent language models iteratively apply a small layer stack, decoupling per-token compute from distinct parameter count. To determine whether such a model genuinely utilizes its depth, both recurrence and layer-pruning literatures rely on a shared evaluation: truncating depth at inference time, plotting quali...

Ha Van Dau, Thanh Tung Khuat, Dung Thanh Nguyen · 0 citations
#artificial intelligence Preprint Sep 2026

QVAC Genesis III: A Large-Scale, High-Quality Open Synthetic STEM Corpus for Efficient Language Model Pre-Training

This work introduces QVAC Genesis III, a 191.43B-token, STEM-focused multi-domain synthetic corpus covering 19 domains across several difficulty levels and different educational styles, and introduces an LLM-as-a-parser evaluation protocol that extracts final answers from free-form outputs and tracks both accuracy and...

Davide Vitabile, N. Ranjan, Akshay Nambiar et al. · 0 citations
#small language model Open access Sep 2026

PEMBELAJARAN SASTRA LISAN BERBASIS KEARIFAN LOKAL MELALUI MEDIA DIGITAL STORYTELLING UNTUK MENINGKATKAN LITERASI DIGITAL DAN KETERAMPILAN KOMUNIKASI ILMIAH MAHASISWA

ABSTRACT Local wisdom-based oral literature learning needs to be designed not only to preserve cultural knowledge but also to provide opportunities for students to develop digital literacy and scientific communication skills. This study aims to develop oral literature learning through digital storytelling media integr...

Taslim Makatita, Juraid Somalua · 0 citations
#small language model Editorial Open access Sep 2026

Editorial: Generative AI and large language models in medicine: applications, challenges, and opportunities

Generative artificial intelligence has entered medicine through a heterogeneous set of uses rather than through a single technological pathway. Large language models now draft clinical text, interpret reports, answer patient questions, support knowledge retrieval, structure health data, assist education, and participat...

Fahim Sufi, Seedahmed S. Mahmoud · 0 citations
#small language model Open access Sep 2026

Utilization of a HIPAA-compliant large language model chatbot in an academic pediatric medical center

Despite growing interest in LLM chatbots, little evidence exists on usage patterns in hospital systems. This paper presents a mixed-methods case study of “InternalGPT,” a HIPAA-compliant LLM chatbot made available to employees of the institution. Survey responses and 14 months of system utilization data were analyzed a...

Benjamin Rader, Dinesh K. Rai, Melissa L. Stewart et al. · 0 citations
#small language model Open access Sep 2026

A trainable language model with potential to modulate translation rates in non-model organisms by generating upstream untranslated region sequence libraries

A simple generative approach for creating synthetic 5′-UTR libraries based solely on the genomic sequence statistics of any desired organism and demonstrates that simple statistical language model approaches applied to genomic data can generate functional translational regulatory sequence libraries without detailed mec...

A. Duggan, M. Newman, David R. McMillen · 0 citations
#small language model Review Open access Sep 2026

A Multilingual Media Analysis of Pediatric and Thyroid-Related Newspaper Communications Following the Chernobyl and Fukushima Nuclear Disasters

Public media communication, particularly through newspapers, plays a critical role in shaping public awareness, governmental response, and remediation efforts following large-scale crises, including nuclear power plant accidents. Because children are biologically more vulnerable to the effects of ionizing radiation, un...

Yoshitaka Nishikawa, Daria Lisus, Hiroaki Saito et al. · 0 citations

Investigating the Comprehensibility Paradigm: Key Fluency Predictors in L1 English Speakers' Evaluations of Japanese Speakers' L2 English.

The present study investigates the relationship between first language (L1) and second language (L2) oral fluency and their association with comprehensibility in lower-intermediate Japanese learners of English, examining which L2 fluency features are most closely associated with L1 English listeners' comprehensibility...

D. Clingwall, Gavin Brooks, Jon Clenton · 0 citations
#small language model Open access Sep 2026

Large Language Model-Based Text-to-Cypher Generation for Question-Answering on Biomedical Knowledge Graphs.

Few-shot prompting heavily improves query generation quality and enables effective use of smaller models, supporting the practical deployment of locally hosted LLMs for knowledge graph question answering.

Suteera Seeha, Adem Abdelmoula, M. Boeker et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.