Skip to content

Category

small language model

2,897 papers

#natural language process... Preprint Sep 2026

Mizar: A 159M-Parameter Audio-Language Model for Audio Understanding

Mizar, a 159.3M-parameter ALM, is introduced, a recipe that brings together architecture, data, and three-stage training to build Mizar, a 159.3M-parameter ALM that surpasses the previous best-performing ALM below 200M parameters on all three benchmarks.

Kai-Yang Li, Shaobo Han, Yue Tian et al. · 0 citations
#artificial intelligence Preprint Sep 2026

PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety

As Large Language Models (LLMs) evolve into autonomous agents that alter real-world states, ensuring operational safety across multi-step workflows has become a critical challenge. While recent work has moved beyond single-turn evaluation toward multi-turn paradigms, key limitations persist: step-level methods treat ac...

Jia-Peng Sun, Yu-Jin Zhou, Han Zhu et al. · 0 citations
#natural language process... Preprint Sep 2026

Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understanding

Jev has the lowest cost and median response time among the evaluated configurations, while hosted language models achieve higher baseline accuracy and Rankings by baseline accuracy differ from rankings by correctness across every condition and repeat, although small differences in the latter do not establish a general...

Fan Zhang, Yan-Kai Chen, Zhuo-Han Xie et al. · 6 citations · ⚡1
#artificial intelligence Preprint Sep 2026

The Path Matters: Evaluating Small Language Models Beyond Answer Accuracy in KGQA

This work isolates SLM graph reasoning from navigation and traceability capability by employing the THESEUS navigation and traceability framework and using frozen, off-the-shelf SLMs as local action policies, and results motivate evaluating SLM graph reasoning beyond endpoint accuracy alone.

Eduin E. Hernandez, Sergio A. Diaz, Luis F. Garcia et al. · 0 citations
#machine learning Preprint Sep 2026

Less Language, More Latents: Annotation-Efficient VLAs for Driving

A three-stage pipeline that transforms abundant unlabelled observation-trajectory pairs into a substrate for language-conditioned control and achieves a Driving Score of 87.98 and a Success Rate of 70.46%, matching or surpassing fully supervised baselines on the closed-loop Bench2Drive benchmark.

Alexey Zakharov, Kemal Oksuz, P. Dokania · 0 citations
#machine learning Preprint Sep 2026

Feed the Panel Dimensions, Not Verdicts: Rubric-Decomposed Fusion of Vision-Language Aesthetic Judges

Vision-language models (VLMs) are deployed as zero-shot judges of image aesthetics, and panels of several models are recommended, on thin evidence, as the way to make such judges reliable. On two human-rated datasets, EVA and PARA, we find that a panel of holistic judges never significantly beats its best member, wheth...

Amit Jadhav, Shaurya Beriwala, Beomjin Kim · 0 citations
#machine learning Preprint Sep 2026

Learning from Failures: Heterogeneous Graph Memory for Small Language Model Tool-Using Agents

This paper proposes FRESH, a Failure-aware Retrieval framework over Experience-Structured Heterogeneous graphs, which transforms historical successes and failures into structured external experience for tool-using agents and consistently improves task success and tool-use reliability over no-memory agents and represent...

Jia-Xing Li, Lei Song, Rui Dong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

KITE: KV-Invariant Transformer Expansion for Efficient Agentic LLM Scaling

KV-Invariant Transformer Expansion (KITE) is introduced, a scaling paradigm that trains the model from a smaller size to a larger size (i.e., saving training costs via upcycling), while places newly added parameters in regions that do not affect attention KV.

Zhi-Heng Hu, Yi-Xun Wei, Jian Zhou et al. · 0 citations
#small language model Open access Sep 2026

Ethical and Socially Aware English–Norwegian Hate Speech Detection: A Systematic Design Framework

A comprehensive English–Norwegian framework that unifies multi-class, multi-label, and multi-task learning for hate speech detection while embedding fairness, transparency, and accountability is proposed.

Ehtesham Hashmi, Sule YAYILGAN YILDIRIM · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.