Skip to content

Category

natural language processing

6,756 papers

#natural language process... Preprint Sep 2026

Offline Guidance, Online Reasoning: Reusing LLM Feedback for Small Language Models

Reusable Latent Correction (RLC) is proposed, which converts one-off natural-language guidance from a black-box LLM into persistent corrective experiences in the hidden space of an SLM, enabling the SLM to reuse LLM-derived corrections during inference without any online LLM calls.

Bo-Han Zhang, Li-Nan Yue, Weibo Gao et al. · 0 citations
#natural language process... Preprint Sep 2026

MGhana-ST: A Low-Resource Speech Translation Dataset for Ghanaian Languages and an Analysis of Multilingual Training Trade-offs

Comparing empirical cross-lingual transfer with typology-based similarity, it is found that transfer BLEU identifies closely interacting language pairs better than URIEL similarity, though neither predicts which varieties benefit from joint training.

Frank Lawrence Nii Adoquaye Acquaye, Eric George Parakal, Jesse Johnson et al. · 0 citations
#natural language process... Preprint Sep 2026

Scaling Parameter and Context in Attention: Native Sparse Attention from Mixture-of-Head

NAMOH, an architecture-native sparse attention mechanism that activates only its assigned tokens and performs causal attention within this subsequence, is introduced, and it is hoped this work offers a new path for scaling attention, with parameter scaling directly enabling context scaling.

Zi-Zhuo Fu, Run-Sheng Wang, Meng Li · 0 citations
#natural language process... Preprint Open access Oct 2026

Voices of Freelance Professional Writers on AI: Limitations, Expectations, and Fears

The rapid development of AI-driven tools, particularly large language models (LLMs), is reshaping professional writing. Still, key aspects of their adoption such as language support, ethics, and long-term impact on writers' voice and creativity remain underexplored. In this work, we carried out a questionnaire (N = 301...

Anastasiia Ivanova, Natalia Fedorova, Ekaterina Artemova · 0 citations
#natural language process... Preprint Sep 2026

JuryFlow: Disagreement-Guided Human-in-the-Loop Multi-Agent Evaluation

Large language models (LLMs) are increasingly deployed as automated judges for AI-generated content, yet a single judge is unreliable and even a panel of judges leaves a hard residue: when judges disagree, majority voting discards the conflict instead of resolving it. We present JuryFlow, a disagreement-guided, human-i...

Mu-Feng Yang, Jun-Wei Yu, Yepeng Ding · 0 citations
#natural language process... Preprint Open access Oct 2026

DuplexAct-Bench: Broadening Full-Duplex Speech Evaluation toward Proactive Interaction across Diverse Behavioral Requirements

Existing full-duplex speech benchmarks cover only subsets of real-time interaction behaviors, often under limited contextual conditions. We introduce DuplexAct-Bench, a bilingual benchmark that systematically covers six complementary behaviors, from interruption and yielding to proactive initiation, active silence, and...

Keyue Xing, Wentao Ding, Mengmeng Wang et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Anthropomorphism in the age of Large Language Models: An overview of potential risks and mitigations

Large Language Models (LLMs) and more broadly Artificial Intelligence (AI) systems are often described and understood in human-like terms, a phenomenon known as \emph{anthropomorphism}. This paper provides a synthesis of recent literature on anthropomorphism in AI, covering theoretical frameworks, the role of language...

Ismael T. Freire, Marceau Nahon, Maud van Lier et al. · 0 citations
#machine learning Preprint Open access Oct 2026

KVEraser: Learning to Steer KV Cache for Efficient Localized Context Erasing

Post-hoc context erasing over the KV cache is challenging because a local edit has a global consequence: once a span has been processed, its influence propagates into the cached states of all subsequent tokens. This issue arises naturally in long-context LLM applications, where stale, incorrect, or harmful context may...

Mufei Li, Shikun Liu, Dongqi Fu et al. · 0 citations
#machine learning Preprint Open access Oct 2026

When In-Distribution Gains Fail: Evaluating Weak-to-Strong Reward Models under Preference Shift

Weak-to-strong (W2S) generalization is a promising framework for scalable oversight, yet existing evaluations often test students under matched train-test distributions. Therefore, we study W2S preference learning under zero-shot distribution shift and find that strong students trained on weak preference labels can app...

Khoi Le, Tri Cao, Phong Nguyen et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Sequential Bayesian Evaluation of Large Language Model Behavior

It is increasingly important to evaluate the characteristics of systems based on large language models (LLMs). Evaluations in this context often rely on a curated benchmark set of input prompts provided to the LLM, where the output for each prompt may be assigned a binary or ordinal score and the aggregation of scores...

Saatvik Kher, Shang Wu, Rachel Longjohn et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Listening to the Wise Few: Query-Key Alignment Unlocks Latent Correct Answers in Large Language Models

Large language models (LLMs) routinely fail to output the correct option in multiple-choice question answering (MCQA) while encoding the answer internally. We expose this latent knowledge via the Query--Key (QK) score, defined for an attention head as the inner product between the last-token query and the key at the en...

Eduard Tulchinskii, Kristian Kuznetsov, Laida Kushnareva et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Fork-Think with Confidence

Parallel thinking has enjoyed great success for boosting LLM performance on reasoning tasks without the need for any re-training. However, existing methods follow a think-first-then-decide paradigm, i.e., they first sample multiple reasoning paths, which inevitably leads to overgeneration, then prune or stop unnecessar...

Zena Al-Khalili, Rafi Hakim, Dietrich Klakow et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.