Skip to content

Category

small language model

3,243 papers

#small language model Dataset Open access Sep 2026

User study result and dataset

This record contains the human annotation study underpinning the MSc thesis"Exploring Semantic Consistency in Image Super-Resolution" (Master in ComputerVision, Universitat Autònoma de Barcelona / Computer Vision Center). Super-resolution is normally evaluated on fidelity and perceptual quality — howclose an output is...

Valentin Micu-Hontan · 0 citations
#edge computing Open access Sep 2026

Epistemic Inventory and Taxonomy of Claims

Here we present four companion documents for the program corpus listed below. The Taxonomy of Claims lists the theory's claims and assigns each one a status. The claims are grouped in four tiers: Framework (the laws and constants, which the theory does not derive), Derived from Framework (quantities computed from the f...

Scott Weller · 0 citations
#small language model Open access Sep 2026

Don't Train From Scratch: Persistent Gains from Pruning-Initialised Distillation for Edge Language Models

Preprint notice: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Deploying a language model on an embedded accelerator can fix its architecture, vocabulary and weight footprint before accuracy is consid...

Cong Xu, Ravi Sankar · 0 citations
#small language model Open access Sep 2026

Don't Train From Scratch: Persistent Gains from Pruning-Initialised Distillation for Edge Language Models

Preprint notice: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Deploying a language model on an embedded accelerator can fix its architecture, vocabulary and weight footprint before accuracy is consid...

Cong Xu, Ravi Sankar · 0 citations
#small language model Open access Sep 2026

It's the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectories

Reasoning traces of large language models are widely read as containing "breakthrough" moments and early-legible fates. Both readings rest on measurements missing a counterfactual control at the level of the claim; we supply both controls. First, a restart-controlled truncation probe separates when a solution fits the...

Yiğit Utku Bulut · 0 citations
#small language model Open access Sep 2026

HERMES-OT: Hierarchical Embedded Reasoning Models for Predictive Cyber-Physical Defence in Industrial Control Systems

A small-language-model architecture for AI-driven detection, prediction and safe defence of operational technology. Operational technology (OT) and industrial control systems (ICS) increasingly connect information technology, industrial networks, programmable logic controllers (PLCs), SCADA, distributed control systems...

Yasir Musawar · 0 citations
#small language model Open access Sep 2026

Morphological Hijacking in Frozen Language Models: A Contrastive, Symmetry-Regularized Projection Head for Algebraic Structure Recovery

Preprint. Not yet peer-reviewed. Abstract: Frozen autoregressive language models cluster surface-similar tokens together even when a stronger, task-relevant structure is available in the input. We construct an adversarial lexicon (LUXVAR Core-30) in which word meaning is defined by orbit membership under the finite alg...

Nirouyar Reza · 0 citations
#small language model Open access Sep 2026

It's the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectories

Reasoning traces of large language models are widely read as containing "breakthrough" moments and early-legible fates. Both readings rest on measurements missing a counterfactual control at the level of the claim; we supply both controls. First, a restart-controlled truncation probe separates when a solution fits the...

Yiğit Utku Bulut · 0 citations
#small language model Open access Sep 2026

Self Agent— A Reflective, Self-Modifying Task-Completion Runtime

Self_agent is a locally-run, tick-based autonomous process built on small open-weight language models (via Groq) that maintains its own goal queue, reflects on its own behavior, executes work through short-lived stateless task nodes, and — under a sandboxed, test-gated pipeline — proposes and applies changes to its own...

Ashad Brooks · 0 citations
#small language model Dataset Open access Sep 2026

HIPPOGRID evidence pack for the preliminary results (2026)

HIPPOGRID — evidence pack for the preliminary results (2026) Raw result files and figures behind the preliminary results cited in the MSCA-PF proposal HIPPOGRID (SEP-211387371, call HORIZON-MSCA-2026-PF-01). Researcher: Álvaro González-Redondo (University of Granada). Each bundle below backs one claim of the proposal;...

Álvaro González-Redondo · 0 citations
#small language model Open access Sep 2026

Localising Context Length Degradation in a Mixture of Experts Language Model: Retrieval Head Collapse, Not Router Failure

Long-context "context rot" (accuracy degradation as input length grows, even when task difficulty is held fixed) is localized here to a specific, causal mechanism inside a small Mixture-of-Experts language model (OLMoE-1B-7B-0924), then tested for generality across two further architectures. Forced-choice retrieval acc...

Manjunath Bhaskar · 0 citations

Can Generative Large Language Models Serve as Raters for Test Development? A Systematic Evaluation Across Tasks, Models, and Inference Configurations

Overall, the findings suggest that LLMs can function as effective supplementary raters in test development and validation processes, although greater caution is warranted for certain rating tasks.

Mi-Kyung Son, Philseok Lee · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.