Skip to content

Category

small language model

3,243 papers

#small language model Dataset Open access Sep 2026

Fine-tuned and AWQ-quantized checkpoints for "Not All 4-bit Quantizers Are Equal"

Model checkpoints used by the artifact's second claim: the fine-tuned Qwen 0.5B checkpoint (wave 1, seed 42) and its AWQ 4-bit quantization. With these, a reviewer replays the claim instead of retraining. Data component of the research artifact of the paper Not All 4-bit Quantizers Are Equal: Deployment-Time Mitigation...

Cristhian Kapelinski, Diego Kreutz · 0 citations
#small language model Open access Sep 2026

Not All 4-bit Quantizers Are Equal: Deployment-Time Mitigation of PII Leakage in Fine-Tuned Small Language Models (research artifact)

Research artifact of the paper Not All 4-bit Quantizers Are Equal: Deployment-Time Mitigation of PII Leakage in Fine-Tuned Small Language Models, published at SBSeg 2026 Main Track (full paper). Artifact evaluation (CTA/SBSeg 2026): this artifact was awarded all four seals: Available Artifacts (SeloD), Functional Artif...

Cristhian Kapelinski, Diego Kreutz · 0 citations
#small language model Review Open access Sep 2026

Analysis of Approach Variations in Arabic Language Curriculum Development: A Literature Study on Models and Their Implementation

Curriculum is a fundamental component of the education system that determines the direction, content, and process of learning. This study analyzes the various approaches used in Arabic language curriculum development and identifies the strengths and weaknesses of each approach within the context of Arabic language lear...

Badrul Islam, Maharani Suryadie Putri · 0 citations
#small language model Open access Sep 2026

The Elephant and the Ant: A Philosophical Study of Magnitude, Fear, Possibility and Existential Power - Vedanta 2.0 | 99+1 Model and Pancha-Sutra

This paper explores the philosophical mystery hidden within the relationship between the Elephant and the Ant. What appears vast is not necessarily complete, and what appears subtle is not necessarily powerless. Through this simple contrast, the study questions human assumptions about magnitude, power, fear, knowledge...

Vedanta2.0 Agyat Agyani · 0 citations
#small language model Open access Sep 2026

A Framework for Pluralistic Value Assessment (MindOrder)

We present a computational framework for multi‑dimensional value assessment, designed to address a structural problem shared by historical evaluation and AI value alignment: how to adjudicate among incommensurable values without collapsing them into a single score. Mainstream approaches to value aggregation seek a corr...

Wei Wan · 0 citations
#small language model Open access Sep 2026

GQLSA: Grouped-Query Latent Sparse Attention: A Hardware-Native Architecture for Efficient and Effective Sequence Modeling

We introduce Grouped-Query Latent Sparse Attention (GQLSA), a novel attention mechanism that integrates latent compression, grouped-query sharing, and block-sparse attention into a unified hardware-native architecture. GQLSA achieves linear O(T) complexity in sequence length, a 3.8x speedup over multi-head attention at...

Fardin Sabid · 0 citations
#generative ai Open access Sep 2026

PREreview of "Training Large Language Models for Small-Molecule Design with Synthetic Task Scaling"

This Zenodo record is a permanently preserved version of a PREreview. You can view the complete PREreview at https://prereview.org/reviews/22662611. Review of "Training Large Language Models for Small-Molecule Design with Synthetic Task Scaling" Summary This preprint asks whether LLMs can be post-trained for expensive,...

Sneh Pankajbhai Vora · 0 citations
#large language models Open access Sep 2026

Retrieval-Augmented Generation for Question Answering over a Research Paper: A Hybrid Dense-Keyword Retrieval Study on the Transformer Architecture Paper

Retrieval-Augmented Generation (RAG) combines information retrieval with language generation to improve the grounding of generated answers in a source document, addressing a central weakness of purely parametric large language models: the tendency to produce fluent but unsupported statements. This study designs, implem...

Dileep Choudhary · 0 citations
#small language model Open access Sep 2026

In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning

Retrieval-augmented generation (RAG) grounds a language model in retrieved documents, which reduces hallucination but creates a new attack surface: if retrieved text is tampered with, the model may repeat the falsehood. We study how much a small quantized model, Llama 3.1 8B, degrades when a fraction of its retrieved c...

Iliano Fasolino · 0 citations
#small language model Open access Sep 2026

Toledo — Equation Library of the Human–AI Readout Programme (v1.6.0): Information Discrete Mathematics as root extension R2, resistance ladder with reproduction evidence, 1,267 coded entries, MCP server, static API, website, catalogue

v1.8.0 (2026-09-08). Version DOI: recorded once minted (concept 10.5281/zenodo.22537318). Commits `d786116`/`8954bcf` (Religious Attribution Non-Collapse), `8be7433`/`ef3adc7`/`270c2af` (executable-equations registrar review), `cb03ab6` (Internal-Consistency ladder + mechanical clearing fixes), `fd57ffd` (consistency-g...

Yaoharee Lahtee · 13 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.