Skip to content

Category

small language model

2,728 papers

#machine learning Preprint Oct 2026

Input-Blind Controls Produce Substantial Oracle Headroom for Layer Programs in Multiple-Choice Evaluation

Adaptive computation aims to improve language-model inference by tailoring execution to each input. For layer programs, oracle evaluations use known answers to estimate the potential gain from this flexibility, before a practical selector is available. However, a gain from selection does not by itself explain why the c...

Yi-Bei Guo, Rui Liu · 0 citations
#machine learning Preprint Oct 2026

The Dichotomy Between Pattern Recognition and Step-by-Step Reasoning

We argue that pattern recognition and step-by-step reasoning are two ends of a spectrum. A large language model (LLM) learns to reason step-by-step when data is structured such that the next token depends on a small amount of preceding context. Inference in LLMs resembles pattern recognition when the next token depends...

Amrut Nadgir, Pratik Chaudhari, Vijay Balasubramanian · 0 citations
#machine learning Review Oct 2026

Multi-Label Topic Assignment via LLM Distillation: A Comparative Analysis of Generative vs. Discriminative Student Models

Multi-label topic assignment for user-generated content (UGC) -- including product reviews and buyer-seller conversations -- poses unique scalability challenges in large-scale e-commerce due to informal language, extreme label sparsity, and rapidly evolving taxonomies. While utilizing Large Language Models (LLMs) as la...

Sourabh Kasliwal, Shubhranshu Singh · 0 citations
#artificial intelligence Preprint Oct 2026

Decoupling Logic from Persona: Structural Immunity of Edge LLM Agents to Context Pollution

Small language-model agents on edge devices must hold a persona and reason correctly at once, inside one context window that fills with conversational history and persona instructions. We study what happens to the logical part of such an agent when that history is long, misleading and persona-heavy (persona-logic inter...

Masaaki Nakatsu, Ren-Xiong Wang · 0 citations
#artificial intelligence Preprint Oct 2026

Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning

Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting. We propose the Language-Aware Skeleton Exploration Framework (LASEF) to study skeleton-language choice in multilingual mathematical reasoning. Across math be...

HyeonSeok Lim, Seung-Woo Song, Inho Won et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Collaborative Reasoning Distillation via Cross-Feedback and Coherent Curation

Reasoning capabilities are critical for advancing Large Language Models, yet current approaches either require massive computational budgets or struggle to effectively distill reasoning to smaller models. Standard distillation methods rely on outcome-based rewards, failing to distinguish between sound reasoning and luc...

Tae-hong Kim, Seunggeun Cho, Dong-Su Han · 0 citations
#artificial intelligence Preprint Oct 2026

Correspondences as Decisions: JevNexus for Decision-Centric Schema Matching

Schema matching increasingly uses generative language models to rerank retrieved column candidates, although the underlying task is a bounded correspondence decision. We present JevNexus, which combines typed pairwise decisions with schema/instance evidence and invokes listwise refinement only when the evidence disagre...

Run-Ze Li, Han-Chen Wang, Ying Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Mixture of Layers: Dynamic Layer Routing for Visual Reasoning

Pre-trained vision encoders contain layer-wise visual representations that differ in spatial granularity, semantic abstraction, and sensitivity to local details. However, most Multimodal Large Language Models (MLLMs) rely on only the final or penultimate vision encoder representations or fixed aggregation rules, making...

Jeonghwan Kim, S. Stoica, Ji-Wan Chung et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Multi-Objective Aligned Small Language Model Framework for SUD Patient Dialogue Generation

Substance Use Disorder (SUD) counseling requires patient responses that reflect underlying cognitive states such as beliefs, coping strategies, and readiness for change. Although large language models (LLMs) can generate fluent text, they often fail to produce cognitively coherent and clinically realistic patient behav...

Thushara Manjari Naduvilakandy, Hyeju Jang, M. Al Hasan · 0 citations
#artificial intelligence Preprint Oct 2026

sk-bench: A Native-First Benchmark for Evaluating Large Language Models in Slovak

Multilingual LLM benchmarks omit Slovak, a morphologically rich West Slavic language of five million speakers, or cover it only by machine translation. We present sk-bench, a native-first Slovak benchmark with 30 datasets (33 scored task variants) across ten skill categories. Eleven resources are introduced or first pa...

Marek Suppa, Ivan Vykopal, Andrej Ridzik et al. · 0 citations
#artificial intelligence Preprint Oct 2026

UniSkill: Learning Actor-Aligned Skill Proposals for an Evolving Policy

Large language model agents can improve across tasks by retaining reusable skills distilled from prior interactions. Recent work jointly optimizes task execution and skill extraction, enabling the policy and skillbank to co-evolve. However, as the actor continues learning, rewarding skill proposals through their reuse...

Yi-Fei Lu, Cheng Liu, Dian-Zhi Yu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Efficient Reasoning with Flow Language Models

Flow Language Models (FLMs) have emerged as a continuous-state alternative to discrete diffusion language models, yet the role of their continuous representations in reasoning remains unclear. We investigate this question by comparing the reasoning efficiency of FLMs and discrete diffusion models, measured by solution...

Han-Ru Bai, Faissal Izermine, Oscar Davis et al. · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.