Skip to content

Category

natural language processing

9,049 papers

#natural language process... Preprint Sep 2026

The Illinois Social Attitudes Aggregate Corpus (ISAAC): An Open Tool and Reproducible Pipeline for Analyzing Social Group Discourse at Scale

We introduce the Illinois Social Attitudes Aggregate Corpus (ISAAC), an open, modular, and accessible corpus of 527 million+ English-language Reddit posts selected for relevance to six key social group distinctions based on race, sexuality, age, ability, body weight, and skin tone, covering the 17-year period from 2007...

Babak Hemmatian, Sarah Hadjarab, Jessica Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Recognized but Not Produced: A Generation Benchmark for Culturally Specific Kinship Terms

Current literature evaluates large language models (LLMs) on multilingual kinship understanding using multiple choice benchmarks, treating it as a recognition problem. We instead prompt five open weight LLMs to generate kinship terms in three non Western languages (Hindi, Tamil, and Korean) across two communicative tas...

Sahil Pardasani, Madhusudan Singh · 0 citations
#artificial intelligence Preprint Sep 2026

COMED: The Missing Middle Between Routing and Collaboration in Multi-LLM Inference

No single Large Language Model (LLM) is uniformly reliable across queries, motivating multi-model inference systems that either route among models or combine their outputs. However, routing stops after selecting an initial model, while dense collaboration invokes peers on every query. We show that collaboration is non-...

Norah Alballa, Wen-Xuan Zhang, Salma Kharrat et al. · 0 citations

PHONOS: PHOnetic Neutralization for Online Streaming Applications

PHONOS is a streaming module for real-time SA that performs accent neutralization in a privacy sense: reducing accent-origin cues by converting non-native segmental realizations toward a chosen target accent domain.

Waris Quamer, Mu-Ruei Tseng, Ghady Nasrallah et al. · 1 citation

The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices

Probability-floor samplers substantially narrow the blind spot, demonstrating that the choice of truncation criterion matters for retaining human-used tokens and motivate decoding methods that preserve contextually appropriate low-probability choices while maintaining generation quality.

E. Arias, Nurzhan Sapargali, Christian Heumann et al. · 2 citations
#machine learning Preprint Aug 2025

VMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark

VMMU, a Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark, is introduced to evaluate how vision-language models (VLMs) interpret and reason over visual and textual information beyond English, showing that the primary source of failure is not OCR, but instead multimodal grounding and reasoning over t...

V. Dang, A. Vo, Emilio Villa-Cueva et al. · 0 citations
#machine learning Review Open access Jul 2025

InsurTech innovation using natural language processing

This paper applies various NLP techniques to demonstrate feature de-biasing, feature compression, and industry classification in the commercial insurance context to show that NLP is not merely a supplementary tool but a foundational element of modern, data-driven insurance analytics.

Pan-Yi Dong, Z. Quan · 2 citations

Self-Improvement as Coherence Optimization: A Theoretical Account

It is proved that coherence optimization is equivalent to description-length regularization, and that among all such regularization schemes, coherence regularization with a prior derived from a pretrained model optimizes a lower bound of worst-case accuracy for semi-supervised learning.

Tianyi Alex Qiu, A. Ismail, Zhonghao He et al. · 1 citation
#machine learning Preprint Open access Sep 2026

Contrastive Learning for Authorship Verification

A ModernBERT Bi-Encoder model is developed that achieves 98.4% accuracy on the PAN21 authorship verification task and identifies loss function, batch size, training duration, pre-trained model, input context length, and random text span data augmentation as important factors of model performance.

Peter Kirby · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.