Skip to content

Category

small language model

3,243 papers

#natural language process... Preprint Sep 2026

On Epistemic Diversity in Large Language Models

It is argued that epistemic diversity is a useful evaluation dimension for settings where LLMs are used to support knowledge-intensive tasks, and a preliminary framework for conceptualizing and measuring epistemic diversity in LLMs is proposed, and operationalized in two domains.

Elisabeth Kirsten, N. Krämer, Muhammad Bilal Zafar · 0 citations
#natural language process... Preprint Sep 2026

ConsensusBench: Benchmark of Consensus Nodes for LLM Reasoning via Outcome Reward Densifying

This work develops a new reinforcement learning signal named ConsensusPR, which directly reduces the reward sparsity of outcome reward across long reasoning trajectories, and introduces ConsensusBench, a novel dataset designed to provide rule-based process-level signals.

Shi-Qi Yan, Chao-Hong Tan, Qian Chen et al. · 0 citations
#natural language process... Preprint Sep 2026

MedProb: Probing Internal Representations of Vision-Language Models for Medical Question Answering

This work presents MedProb, a lightweight probing framework that predicts multiple-choice Med-VQA answers from frozen VLM representations without free-text generation, and shows the probe can be extended to open-ended generation via a rejection-sampling scoring procedure.

E. Nourbakhsh, Ke Yang, Anthony Rios · 0 citations
#machine learning Preprint Sep 2026

Training Large Language Models for Small-Molecule Design with Synthetic Task Scaling

This work investigates whether LLMs can learn molecular design strategies from cheaper synthetic tasks that generalize to expensive molecular lead optimization settings and suggests that scaling post-training using synthetic tasks is an effective strategy for adapting LLMs to high-cost experimental scenarios that are t...

Frank Hu, Shriram Chennakesavalu, Zi-Cheng Wang et al. · 0 citations
#artificial intelligence Review Sep 2026

A Roadmap for MEG Foundation Models

This perspective lays down the basic concepts needed to understand MEG foundation models and provides a didactic overview of the field's key design choices, including tokenization, sensor- versus source-space representations, sensor-geometry encoding, backbone architectures, self-supervised objectives, and pretraining...

Philipp Thölke, Hamza Abdelhedi, Yorguin-José Mantilla-Ramos et al. · 1 citation
#artificial intelligence Preprint Sep 2026

PLUME: Parameter-Efficient Personalization of Large Language Models via Low-Rank User Modulation in Shared Subspaces

PLUME (Personalized Low-Rank Adaptation through User Modulation and Shared Subspace), a lightweight framework that achieves efficient and expressive per-user adaptation by leveraging a shared task-specific subspace, is proposed as a scalable and semantically grounded approach to LLM personalization.

Xin-Yu Li, Hao Zhou, Jian-Feng Zhu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Extremely Sparse Supervision Incentivizes Reasoning Ability

Overall, the results challenge the assumption that effective post-training must be token-intensive and point to a new direction for understanding and designing more efficient post-training algorithms.

Zhi-Shuai Liu, Xingzi Xu, Mehmet Saygin Seyfioglu et al. · 4 citations
#small language model Open access Aug 2026

GSMultiAgent: A Multi-Agent Loop Framework atop Hermes Agent for Intelligent Design of Guidance Systems

GSMultiAgent is proposed, a multi-agent collaborative cascade framework built atop Hermes Agent, which transforms natural-language mission requirements into optimized guidance system models through structured agent cooperation with feedback-driven iterative refinement and establishes multi-agent coordination with struc...

Ji-Song Xiao, Chengwei Yang, Xiao Xu et al. · 0 citations
#small language model Book Open access Sep 2026

Code Transformation Rule Synthesis using LLMs: Potential and Limits

A novel empirical study targeting three domain- specific languages for transformation rules, namely Comby, GritQL, and Ast-Grep, which shows great potential for LLMs to generate sound, correct, generalizable, and reusable rules.

Axel Allain, Aymeric Blot, D. Khelladi et al. · 1 citation
#small language model Open access Sep 2026

COLD READ: The Anonymity Half-Life Is a Property of the Reader

How many words can you write before a language model can infer who you are? This work went looking for that number and found that the question is malformed, which is itself the finding. 72 authors from the Blog Authorship Corpus, balanced across three age bands and both genders, were shown to local language models in g...

Zaid Ali Syed · 0 citations
#small language model Open access Sep 2026

Section-specific gains in foundation-year laboratory reports after criterion-referenced self-assessment and progressive authorship

While self-assessment against marking criteria is widely advocated, its effects on different components of student work remain unclear. This study evaluates a redesign of a UK foundation-year engineering laboratory module incorporating a structured self-assessment coversheet and a progressive authorship scheme. Across...

J. G. F. Powell · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.