Skip to content

Category

small language model

3,113 papers

#artificial intelligence Preprint Sep 2026

Mirror, Mirror on the Wall: Prompt Echoing in Small Instruct Language Models

This work investigates prompt echoing small language models from different families and shows that echoing prompts are likely to have partial overlap with the training dataset but the phenomenon is primarily driven by the model's induction heads.

Inez Okulska, B. Naskrȩcki, Jan Piotrowski et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Online Language Adaptive Sampling for Better Distributed Cross-lingual Gains

This work proposes a simple yet effective adaptive sampling strategy that assigns trainable sampling probabilities to each language and employs an inner-outer optimization loop with a small overhead, leading to consistent performance improvements and, more importantly, distributing the gains across languages.

Quang Phuoc Nguyen, Félix Gaschi, David Anugraha et al. · 0 citations
#artificial intelligence Preprint Sep 2026

TriCalRAG: A Three-Strategy, Retrieval-Augmented Benchmark for On-Premise LLM-Based Root Cause Analysis in AIOps

This work presents TriCalRAG, a benchmark evaluating open-weight LLMs served locally via vLLM on a single high-memory workstation GPU against a classical LSTM-based log anomaly detector (DeepLog), across four real, publicly available log datasets (BGL, HDFS, Thun-derbird, OpenStack).

Rohit Patel, S. K. Mohanty, Jeenal Chaudhary · 0 citations
#artificial intelligence Preprint Sep 2026

ECAS: An Edge-Controlled Agentic System for Validation-Gated Scientific Application Execution

Results show the feasibility of delegating adaptive reasoning to the cloud while retaining execution control at the edge, and closed-loop repair improves application success from 0/6 to 6/6 over one-shot generation, validation gating prevents all three observed target-scale failures, and skill conditioning improves suc...

Bai-Xi Sun, Ming-Ze Xia, Hui-Huo Zheng · 0 citations
#artificial intelligence Preprint Sep 2026

Bangla Sentence Function Classification: Corpus Development, Model Benchmarking, and Interpretability

A corpus of 10,000 Bangla sentences, manually annotated into four functional categories, namely declarative, interrogative, imperative, and exclamatory is introduced, and Experimental results show that TF-IDF consistently outperforms Word2Vec, likely due to its ability to emphasize discriminative lexical cues associate...

Swapnil Kundu Argha, Abdullah Al Shafi, Rowzatul Zannat et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ReWeight: Leveraging Human Data for VLA Post-Training via Demonstration Retrieval and Sample Weighting

ReWeight is introduced, a framework that incorporates human data into VLA post-training through demonstration-level retrieval and sample-level weighting and learns a cross-embodiment visuomotor representation that combines visual observations with future actions to measure behavioral similarity between human and robot...

Chen-Wei Wang, Dian-Ye Huang, Match W. L. Ko et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Not all Negation Cues are Equal: Affixal Negations Yield Better Negation Understanding

Negation remains a longstanding challenge for both language models (LMs) and large language models (LLMs). Prior work mainly focuses on a small set of high-frequency single-word negation cues, such as not and never, with limited exploration of broader negation types and modern LLMs. To address this gap, we construct Ne...

Tian-Jue Tan, Eduardo Blanco · 0 citations
#artificial intelligence Preprint Sep 2026

Domain-Specific Jargon in Large Language Models: A Comparative Analysis between General-Purpose and Specialist Models

The results provide a case study in which a medically fine-tuned checkpoint does not improve jargon comprehension over its general-purpose counterpart, highlighting that domain adaptation should not be assumed to yield better performance on specialized terminology.

Darin Keng, Zhewei Sun · 0 citations
#artificial intelligence Preprint Sep 2026

How Many Thoughts Can a Vector Hold? The Capacity of Reasoning by Superposition

Large language models solve hard problems through intermediate computations across multi-step reasoning. Traditional chain-of-thought encodes these computations as tokens. Recent continuous and recurrent methods instead move partial computations into fixed-dimensional latent states, where a single thought can superpose...

Hong-Yuan Gu, Chang Liu, Jing-Wen Fu · 0 citations
#artificial intelligence Preprint Sep 2026

OrchSLM: Probing the Dynamics of Small Language Model Orchestration

OrchSLM is introduced, a routing framework that unifies existing non-interactive orchestration methods and exposes their underlying design choices as controllable parameters, and reveals how orchestration behavior emerges from diverse knobs, including the task structure, model-pool composition, and multi-agent consensu...

Cheng-Xi Zhang, Yu-Rong Yao · 0 citations
#artificial intelligence Open access Sep 2026

An Explainable Multimodal Deep Learning Framework for Alzheimer's Disease Classification Using MRI, PET, and Clinical Data

Abstract Alzheimer's disease (AD) often remains undetected until memory loss and cognitive decline become clinically apparent, at which point substantial neurological damage has already occurred. Early and reliable diagnosis therefore, remains one of the most pressing challenges in dementia care. This study presents a...

Dr. K R Shylaja, Chaitra Shree K · 0 citations
#artificial intelligence Open access Sep 2026

An Explainable Multimodal Deep Learning Framework for Alzheimer's Disease Classification Using MRI, PET, and Clinical Data

Abstract Alzheimer's disease (AD) often remains undetected until memory loss and cognitive decline become clinically apparent, at which point substantial neurological damage has already occurred. Early and reliable diagnosis therefore, remains one of the most pressing challenges in dementia care. This study presents a...

Dr. K R Shylaja, Chaitra Shree K · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.