Skip to content

Category

natural language processing

6,613 papers

#natural language process... Preprint Open access Oct 2026

When Guessing is Rewarded: Rethinking Language Model Evaluation with Distributional Uncertainty Scoring

Standard language model evaluation assigns scores to single predicted answers, rewarding high-confidence responses regardless of how residual probability mass is distributed over alternative options. This creates a systematic pressure toward overconfident guessing: under accuracy-based schemes, a model maximises its ex...

Thomas F Burns · 0 citations
#natural language process... Preprint Open access Oct 2026

PUMA: Learning a Mutation-Aware Vocabulary of Protein Units

Modeling protein sequences as a language has made language models a powerful tool in computational biology, yet the language itself remains poorly understood. A key step toward understanding it is identifying its constituent units. In natural languages, morphemes can occur in multiple forms; similarly, in proteins, mut...

Burak Suyunu, \"Ozdeniz Dolu, Ibukunoluwa Abigail Olaosebikan et al. · 0 citations
#natural language process... Preprint Oct 2026

Where LLMs Fail with Visualization DSLs

As LLMs take up the role of authoring charts using visualization domain-specific languages (DSLs), the human constraints that shaped those languages may no longer apply, as what is easy for a person is not necessarily easy for a model. To understand how LLMs might work better with DSLs, we explore where and how they fa...

Hang Chang, Andrew M. Mcnutt, Katherine E. Isaacs · 0 citations
#natural language process... Preprint Open access Oct 2026

From Rules to Neural Graphs: Scalable Structured Prediction for Patent Prior Art Search

Patent search requires processing documents routinely exceeding tens of thousands of tokens. Most neural retrieval approaches operate on truncated inputs, limiting their effectiveness. Graph-based retrieval addresses this by representing each patent as a structured invention graph, but constructing these graphs relies...

Nikolai Zenovkin, Sebastian Bj\"orkqvist · 0 citations
#natural language process... Preprint Oct 2026

OverAct: Measuring and Mitigating Proactive Over-Authorization in LLM Tool-Calling Agents

LLM agents with tool-calling capabilities can access external services and private user data, but they may retrieve more information than a user's request explicitly requires. We study this behavior in structured tool-calling agents and term it proactive over-authorization. This setting differs from filesystem-level co...

Tao-Lin Zhang, Jiu-Heng Wan, Han-Yu Wang et al. · 0 citations
#natural language process... Preprint Oct 2026

Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization

Neural speech codecs increasingly serve as tokenizers for speech language models (SLMs). Lowering the frame rate reduces the computational and memory costs of SLMs, but makes it difficult to preserve both linguistic information and acoustic detail. Existing approaches rely on rule-based compression: average pooling can...

Jeeyoung Yun, Seohwan Yun, Sungwoong Kim · 0 citations
#natural language process... Preprint Open access Oct 2026

Code-Switching Spoken Language Identification as Multi-Label Set Prediction

Code-switched (CS) speech leaks through the monolingual language identification (LID) filters used to curate massive speech corpora, calling for CS-aware LID (CS-LID). We formulate utterance-level CS-LID as multi-label language-set prediction and propose a set generator that directly outputs the languages in an utteran...

Shunsuke Mitsumori, Matthew Wiesner, Shigeo Morishima et al. · 0 citations
#natural language process... Preprint Oct 2026

Do Multilingual Encoders Produce Language-Consistent Semantic IDs?

Semantic IDs (SIDs) compress item embeddings into discrete code sequences used in generative retrieval. We ask whether a multilingual encoder is sufficient for different-language renderings of the same product to receive language-consistent SIDs. Using Amazon ESCI listings rendered in English, Spanish, and Japanese, we...

Abhinav Bohra, Anuj Bohra · 0 citations

AuraForge: Scaling Security Supervision for Training Coding Agents

Coding agents are now proficient enough to generate complex software applications from a single prompt. As their capabilities have grown, human oversight has increasingly shifted from line-by-line code review toward hands-off evaluation of outcomes. However, recent studies have shown that such a transition exposes a cr...

Dan-Qing Wang, Song-Wen Zhao, Harsh Sharma et al. · 0 citations
#computer vision Preprint Sep 2026

Paying for Too Many Tokens? Valid and Cost-Efficient Multimodal LLM Annotation with Simple Heuristics

Vision-Language Models (VLMs) enable video annotation at scale, but costs accumulate quickly: processing a typical 60-second short-form video at one frame per second requires millions of tokens. To reduce costs, researchers rely on heuristics such as sampling a subset of frames, compressing videos into image grids, or...

Zhi-Xiu Zhu, Kristina Gligoric · 0 citations

From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM

Over twenty editions, the ICWSM community has examined social life online as platforms, interactions, and research methods have changed. What can this body of research tell us at this critical juncture, as AI increasingly reshapes how people communicate online? We analyzed 2,139 indexed contributions from 2007 to 2026,...

Koustuv Saha, Eshwar Chandrasekharan · 0 citations
#natural language process... Preprint Open access Oct 2026

On-Device Commercial Intent Retrieval Under Size, Latency, and Privacy Constraints: A 3 MiB Retrieval System with Typed Egress Boundaries

We study commercial intent inference that runs entirely on the user's device, under three constraints frozen before the work began: the downloaded payload under 3 MiB, Tier-0 inference under 20 ms at p95, and no raw text, content embedding, or stable identifier leaving the device. Under them we build a retrieval path o...

Hyojung Han · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.