Skip to content

Category

natural language processing

8,786 papers

#artificial intelligence Preprint Sep 2026

Multilinguality in Hybrid Attention LLMs

This work presents a first study of how hybrid attention impacts the multilinguality of LLMs, showing that cross-lingual representations in hybrid models develop in patterns tied to the ordering of recurrent and full-attention layers.

Lucas Bandarkar, Jun-Ling Hu, Chen-Yuan Yang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Do Coding Agents Reuse Existing Code or Reinvent the Wheel?

Coding agents are increasingly deployed for iterative development on real repositories, yet existing evaluation barely answers a basic question: \emph{do coding agents reuse existing code or reinvent the wheel?} The question matters: every duplicated implementation is a fix applied twice and agents produce code far fas...

Dong-Sheng Ma, Si-Zhe Wang, Xin-Yi Huang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

A mechanistic study of language model introspection

Across three model families, two small groups of attention heads are identified with distinct roles in introspective reporting supporting introspective detection and localization of large language models.

Jia-Hong Zou, Xiang-Kun Sun, Ling-Kai Kong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Echoes of Deeds: Moral History Can Shape and Steer LLM Behavioral Choices

Evaluations of Large Language Models (LLMs) morality typically consider decisions in isolation, thus overlooking whether an individual's unrelated prior conduct influences the model's subsequent choices. This leaves open the question of whether, and to what extent, moral history shapes LLM decisional behaviors. Prior w...

Lucio La Cava, Andrea Tagarelli · 0 citations
#artificial intelligence Preprint Sep 2026

VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation

The VEX-Bench is introduced, a unified benchmark for evaluating the verification complexity of LLM-generated misinformation, as perceived during screening, across models and generation methods, and shows that no single method dominates all dimensions, underscoring the need for multi-dimensional evaluation.

Hanxun Huang, Yu-Tao Wu, Qi-Zhou Wang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Semantic Uncertainty Quantification Needs Factual Equivalence

A single encoder trained contrastively to isolate the targeted fact, utilizing synthetic data generated by an LLM and dataset both disjoint from all evaluation settings improves performance on 120 of 126 evaluation settings (95%) spanning 18 model dataset combinations across language and vision-language models.

Joseph Hoche, Quentin Guimard, Gianni Franchi · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Verbalized Confidence: Calibrating Reasoners with Differentiable Readouts

CREDO reads the confidence from a dedicated token pair in the model's output distribution and trains it by differentiable regression, turning the trained confidence into a signal for accuracy, weighting rollouts by how far confidence and outcome disagree, so that accuracy and calibration improve together.

Chen-Xiao Fan, Chong-Ming Gao, Gang-Yi Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Token Alignment: Event Completion for Cross-Tokenizer On-Policy Distillation

ESCD aggregates prefix-related teacher events and supervises the total probability of byte-compatible one-step student completions, avoiding tokenizer-dependent probability splits among individual tokens, and support event entry and event completion as complementary supervision targets for cross-tokenizer knowledge tra...

Jia-Cheng Liu, Jing-Wei Song, Qi-Tuan Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Using LLMs to Detect LLM-Generated Texts: A Cross-Generation Analysis

This work systematically evaluates 15 LLMs spanning three model generations as both generators and detectors, revealing that detection efficacy is primarily driven by detector capability rather than generator provenance, although outputs from newer generators remain notably harder to detect.

Hai-Yue Yuan, Jie Guo, Wei-Dong Qiu et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.