Skip to content

Category

natural language processing

6,756 papers

#artificial intelligence Preprint Sep 2026

Gender bias across LLMs is common and highly heterogeneous

Understanding gender biases in large language models (LLMs) is increasingly important as these systems become embedded in decision-support tools with real consequences. Prior research has focused only on a small set of models, leaving open the extent to which gender biases are common and heterogeneous across LLMs. We a...

E. Bolzoni, Valerio Capraro · 0 citations
#artificial intelligence Preprint Sep 2026

Dr. OPD: Learning What to Follow for Optimal On-Policy Distillation of Large Language Models

On-policy distillation (OPD) trains a student on its own generated responses using dense, token-level supervision from a stronger teacher. Vanilla OPD treats all teacher signals equally, assuming that the teacher's supervision is equally important for every token. However, teacher signals at different tokens may have v...

Zhen-Yu Wang, Tian-Ze Wang, Lin-Jun Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Auditable Long-Term Memory: A Deterministic Retrieval Chain Measured at 479/475 of 500 on LongMemEval-S

We evaluate an auditable long-term memory system on LongMemEval-S. Its retrieval chain uses hybrid candidate retrieval, cross-encoder reranking, coverage-first packet compilation, and deterministic reasoning scaffolds; an LLM is used only as a replaceable final reader. The chain places all gold sessions in the candidat...

Christopher J. Chanhnourack · 0 citations
#artificial intelligence Preprint Sep 2026

$S^3$: Spectral Null-Space Swap Makes Reasoning Models Efficient

This work is the first to unveil the critical role of the null space and harness it for model optimization, and uses a simplified analytical model about optimization to demonstrate why null-space can effectively reduce attention entropy, thereby improving the efficiency of reasoning.

Hong-Bo Ma, Sansheng Cao, Jia-Jun Fan et al. · 0 citations
#artificial intelligence Preprint Sep 2026

On Trajectory-Aware Training for Masked Diffusion Language Models

Masked diffusion models (MDMs) generate text by unmasking several tokens per step, but they are trained and sampled under different conditions. The model is trained on randomly masked sequences, whereas inference follows a trajectory shaped by the model's own predictions. Additionally, each step has no access to what t...

Manuel Madeira, Amitis Shidani, Alice Bizeul et al. · 0 citations
#artificial intelligence Preprint Sep 2026

The Unequal Influence of Bad Advice: Using Training Data Attribution to Modulate Emergent Misalignment

This work uses training data attribution to quantitatively estimate how much each harmful example contributes to EM and benchmark the quality of the attribution via retraining -- a sound attribution score should enable us to enhance or attenuate EM by filtering data on that score.

Gonçalo Paulo, Louis Jaburi, Nora Belrose et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Learning Beyond What You Sample: Off-Policy-Aware Cross-Model Trajectory Exchange for RLVR

Reinforcement Learning with Verifiable Rewards (RLVR) methods such as GRPO rely on successful self-generated trajectories, but finite rollout budgets can produce all-fail groups with no reward-based policy-gradient signal. While additional rollouts improve the chance of success at higher cost, successful trajectories m...

Doohyuk Jang, Y. Park, Gyouk Chu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

It's Not What the Image Shows: Irrelevant Context Destabilises VLM Judges Without Informing Them

MIST, the Misleading-Image Stress Test: 200 English sentences, each built around a phrase readable either figuratively or literally and shown with an aligned image depicting its reading, a misleading image depicting the opposite, or no image at all is introduced.

Nagham Omar, Mahmoud Jabarin, Kinan Ibraheem et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Thinking in Depth, Speaking Directly: Recurrent Latent Reasoning for Paralinguistically Grounded Spoken Dialogue

LoopSLM builds on looped Transformers for latent reasoning, reusing a decoder block to refine hidden states with acoustic grounding at every pass, and further narrows the perception-reasoning gap by separating learning to reason from learning to respond, enabling direct inference without CoT.

Sheng-Bo Cai, Yu-Xiang Wang, Jing-Ran Xie et al. · 2 citations
#artificial intelligence Preprint Sep 2026

A Proposed Rubric for Evaluating Expressed Clinical Reasoning in Large Language Model Responses

We propose a rubric for assessing expressed clinical reasoning in model responses, drawing on three bodies of work: medical education assessment frameworks (ART, SCT, Key Feature Problems and OSCE); clinical LLM benchmarks (MedR-Bench, HealthBench, TIMER-Bench, DR. BENCH, PrIME-LLM and PatientSafeBench); and general LL...

Zhang Jiang, Zina Ibrahim, J. Teo · 0 citations
#artificial intelligence Preprint Sep 2026

When Models Don't Manipulate Manifolds: The Geometry of a Comparison Task

This work characterize precisely the geometry of computation in a number-comparison task, as an abstraction of comparison for decision making, and how models utilize geometry in an elegant fashion to implement it, demonstrating that the manifold hypothesis can co-exist with linear representations.

Sai Sumedh R. Hindupur, Hadas Orgad, Thomas Fel et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.