Skip to content

Category

small language model

3,243 papers

#natural language process... Preprint Sep 2026

Q2D-Web: A Large-Scale Benchmark for Retrieval in Agentic RAG Systems

Q2D-Web is introduced, a large-scale agentic retrieval benchmark consisting of a 190M-document web corpus and 70k agentic search queries in ten languages, reformulated from real-world user queries in production systems, and benchmark 13 retrievers including lexical, dense, and late-interaction models.

Maximilian Schall, Sedigheh Eslami, Markus Krimmel et al. · 0 citations
#computer vision Preprint Sep 2026

From Coordinates to Candidate Regions: Temporal Change Localization via Region Selection in Remote Sensing Multimodal LLMs

This work presents an RS-specific formulation of the region selection paradigm, previously explored in natural-image MLLMs, and extends it to temporal change localization over multi-image sequences, and constructs a multi-task training and evaluation suite spanning localization, referring expression, visual grounding,...

J. Chung, Sungjune Park, Yeongyun Kim et al. · 0 citations
#natural language process... Preprint Sep 2026

Which Forms of Caregiver Feedback Support Grammar Learning? A Reinforcement-Learning Study of Child-Like Language Models

Social interaction is central to children's language learning, but the effects of different forms of caregiver feedback are difficult to isolate in naturalistic data. We use child-like language models as controlled learners to test which forms of feedback support grammatical development. Small GPT-2-style models are pr...

Jing Liu, Marianne Schweitzer, Abdellah Fourtassi · 0 citations
#natural language process... Preprint Sep 2026

Popular Knowledge Propagates More Errors in LLM Knowledge Updating

The results reveal a pattern distinct from prior findings on long-tail vulnerability during acquisition and retention: among facts that models already answer correctly, those associated with highly connected entities are more likely to be corrupted by neighboring updates, and updates to such facts propagate errors more...

Yu-Ji Zhang, Wei-Bing Wang, Cheng Qian et al. · 0 citations
#natural language process... Preprint Sep 2026

Deadline-Aware Adaptive Prefill Chunking for Efficient Large Language Model Serving

This work introduces SLOWeave, an online scheduling method that selects the largest prefill chunk predicted to finish before the earliest active decode deadline, and proves that, whenever a decode-only iteration is feasible and the cost predictor is accurate, SLOWeave maximizes immediate prefill progress among decision...

Si-Yu Song, Qi-Wei Bai, Jin-Bo Hao et al. · 1 citation
#natural language process... Preprint Sep 2026

Signed Rescue Routing: Harm-Aware Cascades for Efficient LLM Inference

Signed Rescue Routing is introduced, a budgeted routing method that predicts these two events separately and ranks requests by their difference and shows that predicting incremental value, rather than model uncertainty, is a simple and effective objective for efficient LLM cascades.

Zhe-Yuan Wang, Si-Yu Li, Pei-Qiao Song et al. · 1 citation
#natural language process... Preprint Sep 2026

CEDAR: Error-Bounded Residual Routing for Efficient Long-Context Attention

This work introduces Coarse-to-fine Error-aware Dynamic Attention Routing (CEDAR), a coarse-to-fine method that keeps the language model frozen while preserving global coverage and derives an output-error bound governed by within-chunk key/value dispersion and uses it to allocate a variable refinement budget.

Si-Yu Li, Dong Wang, Jie Zhou et al. · 0 citations

LLMs Mirror Country-Specific Gender Patterns If Asked, but Skew Male When Generating Media in Local Languages

Large language models (LLMs) are increasingly used to generate media, but whether their content perpetuates gender stereotypes is unknown: standard benchmarks rely on selection-based formats rather than long-form generation, and surveyed baselines for local gender associations are scarce outside the West. We collect ge...

Sharif Kazemi, Tanya Popli, N. K. R. Sehgal et al. · 0 citations
#natural language process... Preprint Sep 2026

Generating Adversarial Texts for Machine Translation via GRPO

This work proposes a scalable reinforcement-learning-based approach for rewriting existing source texts into instances that are more difficult to translate for MT systems, using a large language model with Group Relative Policy Optimization (GRPO) and fine-tune a large language model with Group Relative Policy Optimiza...

Florian Zogaj, Jakob Hütteneder, Giovanni De Muri et al. · 1 citation
#computer vision Preprint Sep 2026

CONDUIT: A Unified Residual-Stream Restoration Framework for KV Cache Reuse in Vision-Language Models

CONDUIT, a training-free refresh policy that unifies single- and multi-image reuse as residual-stream restoration, is proposed, building on norm-weighted attention and an accessible pre-output cached-value-norm proxy, then applies empirical image-level relevance amplification before one global selection.

Pengan Chen, Kai-Sheng Zheng, Liang Hong et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.