Skip to content

Category

small language model

3,317 papers

#artificial intelligence Preprint Sep 2026

Latent Recurrent Thoughts: Recurrent Refinement of Proposed Latents for Reasoning with Frozen LLMs

Latent Recurrent Thoughts substantially outperforms prior frozen-decoder continuous-space reasoning methods under an identical decoder, prompt, data, and training budget, and outperforms non-thinking-mode chain-of-thought prompting on the same backbone at a small fraction of its inference compute.

Zhao-Xing Chen, Jie Fu · 0 citations
#artificial intelligence Preprint Sep 2026

Drift-Aware LLM Routing with Sparse Contexts and Shared Budgets

This work proposes Drift-Aware Sparse Routing (DRS), a nonstationary sparse contextual routing with multiple knapsack constraints and an optional shadow-audit stream that evaluates a small fraction of prompts on several models.

Cheung-Hao Lee, Patrick Wong · 0 citations
#artificial intelligence Preprint Sep 2026

Same Request, Different Boundary: Evaluating Cybersecurity Assistance across Conversational Contexts

3R-Bench (Refusal, Repetition, and Revision), a benchmark of 150 real-world cybersecurity requests augmented with two adversarial conversational settings, is introduced and eight LLMs are evaluated, finding that prior assistant behavior strongly changes responses to an unchanged request.

Rui Yang, Yang Hong, Yi-Chao Xu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Residual Sparsification via Output Importance for Compressing Mixture-of-Experts LLMs

PARSER is a new residual sparsification method that shifts the compression objective from minimizing isolated matrix errors to preserving the expert output error, and achieves this by introducing output importance, which measures the actual contribution to the expert output error.

Seung-Woo Jung, Dohyeok Kwon, Seung-Min Cha et al. · 0 citations
#artificial intelligence Preprint Aug 2026

EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models

The Evidence-Grounded Typed Knowledge Graph (EGT-KG), a retrieval framework to improve information retrieval with local SLMs is proposed, showing that EGT-KG outperforms the vanilla RAG method in most settings, with the best improvement from llama3:8b.

Mu-Ran Yu, Jie-Chao Gao, Yuan-Dong Pan et al. · 0 citations
#artificial intelligence Preprint Aug 2026

SIR: Self-improving Red-teaming for Compute Use Agents

SIR is presented, a black box IPI attack that composes stealthy injections from a small library of reusable principles stated in plain language and wraps composition in an iterative feedback loop that diagnoses the victim's failed trajectories and distills the bypasses into new, named strategies that are reapplied acro...

Chen Xiong, Zhi-Yuan He, Pin-Yu Chen et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Auditing and Mitigating Privacy Leakage in Cloud-Edge Collaborative Decoding

CoVeil is proposed, a defense mechanism which dynamically optimizes transmitted signals to suppress leakage during decoding time while preserving the collaborative quality, and consistently improves the privacy-utility trade-off over existing baselines by reducing data leakage.

Ke-Jia Zhang, Tianyuan Zou, Zi-Xuan Gu et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.