Skip to content

Category

small language model

3,243 papers

#natural language process... Preprint Sep 2026

Beyond Shallow Alignment: How Post-Training Methods Determine Refusal Circuits And Steering Robustness

No post-training method achieves all three properties the authors would want from safe alignment at once: refusal that isn't concentrated in a few fragile components, safety gains that don't cost general capability, and safety behavior correctable through small, targeted edits.

Hoang Cuong Nguyen, M. Dras, Usman Naseem · 1 citation
#natural language process... Preprint Sep 2026

FrameBench:A Language Understanding Benchmark Based on Frame Semantics

This work introduces FrameBench, a benchmark grounded in frame semantics that test whether models distinguish the frames evoked by the same verb across contexts, and constructs the benchmark for English and Japanese using FrameNet-style resources and a generation-and-verification pipeline with native-speaker judgments.

Chihiro Yano, Ryohei Sasano · 0 citations
#natural language process... Preprint Sep 2026

Contextual Tamil Spelling and Grammar Correction Using Progressively Fine-Tuned Sequence-to-Sequence Transformers

An end-to-end sequence-to-sequence formulation and fine-tune mT5-small and mBART-50 on a synthetic corpus of up to 657,720 noisy-clean Tamil sentence pairs spanning ten error categories, showing that a Tamil-adapted instruction model does not transfer to specialised sentence-level correction without task-specific super...

A. Karthikeyan, S. JayaNirmala, Sangeetha Sivanesan et al. · 0 citations
#natural language process... Preprint Sep 2026

LLMs Learn Better In-Context from Rules than from Examples

It is found that models generally learn more reliably from rules than from examples alone, and additional examples on top of rules or simply scaling up the number of examples do not lead to consistent and significant gains.

Xiang Fu, Seungmin Cho, Yukyung Lee et al. · 0 citations
#machine learning Preprint Sep 2026

ALRA: Adaptive Local Relational Alignment for Logit-Based Pre-training Distillation of Autoregressive Language Models

This work proposes Adaptive Local Relational Alignment (ALRA), a position-specific framework combining student proposals with teacher guidance, which replaces the teacher-mass coefficients of the two conditional terms with unit coefficients, preventing either term from being downweighted solely because its region has l...

Quang Hoang Trung, Quang Huu Hieu, Phuc-Thanh Nguyen et al. · 0 citations
#machine learning Preprint Sep 2026

RecurTrace: Adaptive Latent Reasoning with Loop-Time Memory

RecurTrace introduces Loop Memory Attention, which lets each looped layer attend to its own states from previous iterations along the loop-time axis, so the model can revisit earlier computations instead of relying on the latest state alone.

Yu-Xiang Wang, Kun-Yu Feng, Ying-Da Shen et al. · 7 citations
#machine learning Preprint Sep 2026

From Zero to Hero: An Open LLM Ecosystem for Armenian

It is found that the largest public Armenian corpora overlap web-derived evaluation panels heavily, including a train/test self-overlap inside FineWeb-2.0, and that a small share of verified translated STEM data reverses the loss.

Erik Arakelyan, Khatun Avetisyan, M. Davtyan et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Compile by Training: Turning Natural-Language Specifications into Local Neural Functions

Many recurring text functions are easy to describe but difficult to implement with rules, while calling a large remote model for every input introduces repeated cost, latency, and dependency on a provider. We present compile by training, which turns a natural-language specification into a reusable neural function. At c...

Yun-Tian Deng, Peng-Yu Nie, Stuart M. Shieber · 0 citations
#artificial intelligence Preprint Sep 2026

Knowledge Acquisition During Pre-training? Large Language Models Learn Better With Auxiliary Views

Gaps remain in our understanding of how large language models (LLMs) acquire knowledge during pre-training. We posit that auxiliary views, reformulations of knowledge, are causally helpful for learning. We design controlled experiments to isolate this. First, we confirm that repetition is necessary for acquisition and...

Joseph Lee, Yi-Di Huang, Dokyoon Kim et al. · 0 citations
#artificial intelligence Preprint Sep 2026

It's the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectories

Two restart-controlled truncation probes separate when a solution fits the continuation budget from when a prefix carries value that fresh computation cannot buy, and a pre-registered, difficulty-controlled test finds no detectable outcome information in early-window internal signals beyond a problem-difficulty baselin...

Yigit Utku Bulut · 1 citation
#artificial intelligence Preprint Sep 2026

LLM4CKD: Large Language Models for Early Stage Chronic Kidney Disease Screening

This study evaluates the effectiveness of large language models for CKD screening under zero-shot and few-shot in-context learning settings and compares them with traditional ML and DL methods and proposes a framework that uses clinically selected tabular features and structured prompt templates to enable LLM-based inf...

Muhammad Ashad Kabir, S. Munira · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.