Skip to content

Category

natural language processing

7,776 papers

#machine learning Preprint Sep 2026

Distributional sentiment modeling and anomaly detection for consumer complaint assessment

This study links sentiment extraction, bounded response modeling, and anomaly detection in a unified framework for consumer complaint assessment and finds that negative sentiment intensity is not a sharp classifier of outcomes on its own; combined with monetary and categorical attributes, it isolates unusually severe c...

Pei-Heng Gao, Chen Yang, Shi-Min Zhang · 0 citations
#machine learning Preprint Sep 2026

Rethinking Personalized Generation: Test-Time Alignment via Factorized Ranking Models

This work uses empirical studies to reveal the existence of a massive, untapped performance headroom for personalized generation through test-time alignment, and proposes a parameter-efficient framework utilizing million-parameter scale multi-layer perceptron (MLP) ranking models.

Qi-Yao Ma, Jun-Shan Zhang, Zhe Zhao · 0 citations
#machine learning Preprint Sep 2026

SANTA++: Sampling Attention through Representative Keys

Attention often concentrates on a small subset of tokens in the context, but which subset matters changes from one query to the next. To exploit this changing structure, we introduce SANTA++, a training-free stochastic attention method that uses representative keys for memory-efficient selection without scanning the en...

Kyle Lee, Christian Z. Pratt, Ruo-Yu Fang et al. · 0 citations
#machine learning Preprint Sep 2026

LLMs are General Asynchronous Agents

This work develops an asynchronous LLM framework that lets users (or the agents themselves) define inference coroutines with overlapping memory states and showcases that Qwen 3.x models are capable of asynchronous operation for streaming video understanding, videogames, and monitoring, without task-specific training.

George Yakushev, Denis Mazur, В. Д. Бартенев et al. · 0 citations
#machine learning Preprint Sep 2026

TANGO: Watermarking Masked Diffusion Language Models in Token Pairs

TANGO is presented, a watermark for masked-diffusion language models that keys each new token to a nearby token that is already unmasked, and TANGO biases the new token toward a color determined by the key and the nearby token's color.

Kasra Arabi, Nir Weinberger, Micah Goldblum et al. · 0 citations
#machine learning Preprint Sep 2026

ORPG: Reconciling Multiple Reward Objectives through Objective-wise Policy Gradients

Objective-wise Reconciled Policy Gradient (ORPG), which constructs a separate clipped policy objective for each reward and reconciles the resulting gradients into one policy update, achieves the highest average full-budget accuracy and three-budget hypervolume among the compared methods.

Shi-Cheng Fang, Yi-Wen Zhao, Wen-Bo Tian et al. · 0 citations
#machine learning Preprint Sep 2026

See it, Say it, Sorted: Mechanistic Diagnosis and Parameter-Space Mitigation of Emergent Misalignment in LLMs

Safety-aligned LLMs can exhibit emergent misalignment (EM): narrow domain adaptation unexpectedly triggers catastrophic safety failures across unrelated domains. Prior static analyses leave training dynamics unmapped, while existing defenses rely on heuristics that degrade utility. We present a dynamic, second-order ge...

Wei-Qiao Que, Rui-Zhe Li, Cheng-Yu Wang et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Sample What You Say: Aligning Language Models to Sample the Distributions They State

Language models are increasingly used to sample from a specified distribution, for instance, to simulate survey respondents or generate synthetic data. Instruction-tuned models can state such a distribution correctly and still fail to sample from it. Prompting and changes to decoding reduce this mismatch only partly, w...

Kasra Arabi, Virginia Smith, Chhavi Yadav · 0 citations
#machine learning Preprint Sep 2026

Quality Determines Direction, Length Shapes Magnitude: Length Control for Open-Ended Reinforcement Learning

Quality-Gated Length Advantage Shaping (QGLAS), which first computes advantages from quality rewards alone, then adds bounded bonuses only to shorter positive-advantage responses, leaving all other advantages unchanged, consistently achieves a stronger quality--length trade-off than representative baselines.

Zi-Jun Weng, Zhong-An Bi, Xuan-Ang Gao et al. · 0 citations
#machine learning Preprint Sep 2026

When Can Attention Heads Be Statically Defined?

Some attention heads learn similar patterns across inputs. Reusing these patterns could reduce training cost by avoiding repeated query-key score computation and softmax. Through controlled pretraining comparisons, we identify Selective Attention Freezing (SAF), which selects heads with low attention-pattern variance a...

Weixian Waylon Li, Yin-Tao Tai, Marcio Fonseca et al. · 0 citations
#machine learning Preprint Sep 2026

Low-Confidence Remasking Traps Flexibility: Realizing Arbitrary-Order Potential for Diverse Rollouts in Diffusion LLMs

Masked diffusion language models support arbitrary-order generation, suggesting a natural way to produce diverse outputs. However, recent work argues that this flexibility reduces diversity by delaying high-uncertainty tokens that can lead to different generation paths. We trace this diversity loss not to arbitrary-ord...

Moongyu Jeon, Dongjae Jeon, Bumjun Kim et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.