Skip to content

Category

natural language processing

7,304 papers

#artificial intelligence Preprint Sep 2026

The First Token Is Not the Verdict: Hidden Costs of Reading LLM Judges Without Generating

Reading an LLM judge's verdict from the logits of its first generated token is cheap, requires no generation, and is exactly what constrained decoding and likelihood-scoring evaluation harnesses produce. We show that this readout distorts position bias in one direction: it overstates it in every condition we test, so f...

Gnaneswar Villuri, Hashmath Shaik, Alex Doboli · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Ask a Language Model for Lottery Numbers: Concentration in Repeated Six-of-49 Outputs

We evaluate six language-model configurations on requests for six distinct random integers from 1-49. Across 1,200 attempted calls using four English prompt variants, 1,184 responses yielded valid tickets. Effective diversity of number frequencies ranged from 9.9 to 18.0, compared with simulated fifth-percentile thresh...

Dmitrij \.Zatuchin · 0 citations
#artificial intelligence Preprint Open access Oct 2026

On-Device Named-Entity Recognition: A Deployability Study of Accuracy, Cost, Reliability, and Confidence

Named-entity recognition (NER) is increasingly wanted on-device (no API, low latency, data kept local). The practitioner's question is not the leaderboard but which model is deployable, how to evaluate it without human annotation, and whether its confidence can be trusted. We answer these jointly. We place nine systems...

Vinay Kumar Chaganti · 0 citations
#artificial intelligence Preprint Oct 2026

ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research

What makes great scientists great? Even as AI systems start to make progress on open problems, scientists remain far ahead of them at sensing which prior idea, buried in an ever-growing archive of research, a new problem needs. To study this skill, we draw on researchers who know firsthand which earlier work advanced t...

Sohyeon Kim, Yoonho Lee, Bo Liu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

A Comparative Explainability Framework for DeBERTa-v3 in Zero-Shot Medical Abstract Classification

A comparative explainability framework is presented to audit DeBERTa-v3 under zero-shot classification of medical abstracts. The work addresses the disagreement problem in Explainable Artificial Intelligence, where different attribution methods produce divergent explanations for the same input and prediction. A natural...

Javier Diaz Esteban-Herreros, David Mu\~noz-Valero, Raquel Mart\'inez-Espa\~na et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Mingbird: A Local-First Agent Harness Enabling Small Open Models to Complete Real Tasks

Small open-weight models (2-9B) run on ordinary laptops, but under cloud-scale agent harnesses they rarely complete real tasks: tool prefill overflows the context, self-correction diverges, tool demonstrations loop, and tasks are silently abandoned. We present evidence, from a controlled single-machine comparison and o...

Hao Wang, Ting Huang · 0 citations
#artificial intelligence Preprint Oct 2026

Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage

Emergency department (ED) triage is a high-stakes prioritization task in which demographic, socioeconomic, and system-context information may improperly influence acuity assignment. Although open-source large language models (LLMs) are increasingly considered for local and privacy-preserving clinical decision support,...

Manar Aljohani, Brandon Ho, Kenneth W. McKinley et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Gacha Decoding: Eliciting Diverse Generations Through Instruction Following

We introduce Gacha Decoding, an inference-time method for eliciting diverse language model generations that scales with model capability. Across open-ended domains (in-the-wild chat, creative writing, planning for image generation, and protein design), Gacha Decoding significantly outperforms existing generation divers...

Scott Geng, Yu-Fei Zhang, J. Lee et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Generation Provenance Before Behavior Attribution: Auditing Synthetic Speech Research Objects

Attributing model behavior to synthetic training data requires knowing what produced each training item before estimating what that item caused. A waveform-label pair does not preserve this knowledge. We propose a generation-provenance substrate in which a synthetic research object binds source specification, generated...

Sidi Chang, Peiying Zhu · 0 citations
#artificial intelligence Preprint Oct 2026

DAYJOB: A Benchmark for Long-Horizon Professional Work

Professional work often starts with a brief request that leaves the professional to work out what is needed, which documents matter, and whether the request's premise holds. We introduce DAYJOB, a benchmark of 130 tasks built by professionals in healthcare (50) and finance (80). The tasks are estimated to take a profes...

Stephanie Finley, Liudas Panavas, T. Mikkelson et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

SCOPE-AD: Sequential cost-aware ordinal-belief planning with energy-based models for diagnostic agents

Alzheimer's disease (AD) diagnosis requires sequential evidence acquisition under heterogeneous test costs and patient burden. Fixed-modality predictors do not jointly decide which test to acquire or when the available evidence is sufficient for diagnosis. We propose SCOPE-AD (Sequential Cost-Aware Ordinal-Belief Plann...

Ziwen Yu, Ivan Koychev, Elizabeth Coulthard et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Revision-Aware Independent Agent Graphs for Dynamic Reasoning

Conventional reasoning protocols present a fixed, preselected task, so they cannot test whether an agent propagates relevant updates, preserves unaffected work, or reconstructs a historical task binding. We therefore study \emph{dynamic task routing}, in which an event stream revises task bindings and a system must sel...

Yang-Hao Luo, Selim-Antoine Lali, Jeremy Moebel et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.