Skip to content

Category

natural language processing

6,613 papers

#natural language process... Preprint Open access Oct 2026

Do Language Models Need a Trainable Input Embedding Table? Fixed Minimal Token Codes at 1.7B-Class Scale

A trainable input embedding table assigns each vocabulary item an independently adjustable vector. We investigate whether this token-specific parameterization is required for substantial language-modeling capability, or whether a shared Transformer can learn from fixed token identities. We compare three decoder-only la...

A. Bochkov · 0 citations
#natural language process... Preprint Oct 2026

BAIBAICHUCHU at the NTCIR-19 FinArg-3 Task: When Is Maximum Possible Profit Predictable from Investor Text?

The BAIBAICHUCHU team participated in the Social Media Subtask of NTCIR-19 FinArg-3, ranking Chinese investor posts by Maximum Possible Profit (MPP). A three-track ensemble of lexical features, a FinArg-2-pre-finetuned MacBERT ranker, and an LLM judge reaches 0.734 in post-grouped development evaluation, but our best o...

Zong-Han Bai, Po-Yen Chu · 0 citations
#natural language process... Preprint Oct 2026

General Decision Models: Benchmarking and Insights Beyond Jev

General decision models, such as Jev, have recently emerged as efficient alternatives to LLMs for structured judgment and selection. But what kinds of decisions can these models reliably make, and how does their behavior change when individual decisions are composed into larger systems? To study this, we introduce JEVa...

Fei-Yu Duan, Jia-Yu Lin, Jia Wang et al. · 1 citation
#natural language process... Preprint Oct 2026

When Evidence Changes: Evaluating Memory Repair and Re-reading in Language-Model Agents

When documents supporting an agent's derived facts are revoked or replaced, should it repair memory or re-read current evidence? We introduce an evidence-revision evaluation on medication- and problem-list tasks from public ICU records. Under revocation, replacement and control events, we compare full and source-filter...

Wen-Hui Chu · 0 citations
#natural language process... Preprint Open access Oct 2026

Fine-Grained Emotion Classification from Mobile App Reviews: An Empirical Study with Large Language Models

Context: Fine-grained emotion classification of mobile app reviews enables requirements engineering activities that go beyond polarity-based opinion mining, including emotionally informed issue prioritisation and feature-oriented feedback analysis. However, automatic fine-grained emotion extraction from app reviews rem...

Quim Motger, Carlota Catot, Marc Oriol · 0 citations
#machine learning Preprint Open access Oct 2026

Message Passing Enables Efficient Reasoning

While inference-time scaling has improved the reasoning abilities of large language models (LLMs), the need to generate long chains-of-thought (CoTs) is a computational bottleneck. Thus, in contrast to sequential scaling methods like CoT, recent parallel scaling techniques instead use fork and join (FJ) primitives to d...

Xuecheng Liu, Daman Arora, Gokul Swamy et al. · 0 citations
#machine learning Preprint Open access Oct 2026

REFLEX: Reflective Evolution from LLM Experience

Large multimodal language models (MLLMs) have emerged as powerful tools for guiding evolutionary search toward interpretable programmatic policies. In existing program-evolution systems, however, reusable knowledge is usually carried by whole programs in the population, and it is difficult to trace how a visual observa...

Pan Wang · 0 citations
#machine learning Preprint Open access Oct 2026

Function-Vector Heads Are Two Populations: Writers and Cancellers in In-Context Learning

In-context learning lets a language model perform a task specified by examples in its prompt. Function vectors capture task information in a compact activation assembled from attention-head outputs. Across two rule families and three Pythia models, we find two opposed functional populations among candidate function-vec...

Han-yu Wang · 0 citations
#machine learning Preprint Open access Oct 2026

Machine Learning for Coding Retail Product Names to Consumer-Price Categories: A Rule-plus-Bag-of-Words Pipeline with Reliability-Weighted Human-in-the-Loop Labeling

Price statistics increasingly draw on scanner, web-scraped and receipt data, whose product descriptions are short, noisy and carry no standard product code, so each item must be coded to a consumption classification such as COICOP. National statistical offices already report that lightweight text classifiers are adequa...

Vladimir Beskorovainyi · 0 citations
#machine learning Preprint Open access Oct 2026

Flip-Flop Consistency: Unsupervised Training for Robustness to Prompt Perturbations in LLMs

Large Language Models (LLMs) often produce inconsistent answers when faced with different phrasings of the same prompt. In this paper, we propose Flip-Flop Consistency ($F^2C$), an unsupervised training method that improves robustness to such perturbations. $F^2C$ is composed of two key components. The first, Consensus...

Parsa Hejabi, Elnaz Rahmati, Alireza S. Ziabari et al. · 0 citations
#machine learning Preprint Open access Oct 2026

RFG: Self-Improving Diffusion Large Language Models with Reward-Free Guidance

Diffusion Large Language Models (dLLMs) have shown strong reasoning capabilities, yet further improving them typically requires costly post-training with additional data and supervision. We ask whether a post-trained dLLM can improve itself at inference time without additional training, data, or reward models. This req...

Tianlang Chen, Minkai Xu, Jure Leskovec et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Logit-Gap Steering: A Forward-Pass Diagnostic for Alignment Robustness

RLHF-style alignment trains language models to refuse unsafe requests, but how much operational margin does this refusal rest on? We introduce the refusal-affirmation logit gap: the difference between the top refusal-token logit and the top affirmative-token logit at the first decoding step. This single scalar quantifi...

Tung-Ling Li, Hongliang Liu · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.