Skip to content

Category

natural language processing

7,776 papers

#natural language process... Preprint Sep 2026

ManiEdit: Sequential Unstructured Knowledge Editing for Language Models from a Manifold Perspective

This work reframe knowledge editing from a manifold perspective, viewing it as a localized displacement of an edit sub-manifold within the global knowledge manifold, and proposes ManiEdit, a novel manifold-aware autoregressive editing framework consisting of two core components: Pivot Localization and Manifold-Aware Pr...

Rui Liu, Chen-Heng Zhang, Hao-Xuan Li et al. · 0 citations

DISCO: Distributed Long Context Scaling with Grounding-Reasoning Disaggregation

Inspired by distributed computing frameworks like Apache Spark, DISCO partitions long context across a fleet of Worker LLMs dedicated exclusively to parallel, localized grounding, establishing a highly efficient paradigm for robust long-context inference.

Guan-Zheng Chen, Viet Dac Lai, Subhojyoti Mukherjee et al. · 0 citations
#natural language process... Preprint Sep 2026

GSM: Efficient Language Modeling with Shared Global State

The Global State Model (GSM), a causal encoder--decoder architecture that concentrates the selection and aggregation of long-range information in the encoding stage, is introduced, offering a shared-state architecture for efficient language modeling.

Yun Zheng, Bin Wen, Xiao-Jie Wang et al. · 0 citations
#natural language process... Preprint Sep 2026

Rethinking Token Reweighting for SFT: Suppress, Reverse, and Extrapolate Learned Features

SCALE (Selective Control of Adaptation via Local Entropy), an entropy-guided adaptation-strength-control method that freezes the pretrained model and the SFT delta and learns bounded token- and module-specific gates by minimizing predictive entropy alone is proposed.

Cun-Chun Li, Hao-Nan He, Yi-Fan Gao et al. · 0 citations
#natural language process... Preprint Sep 2026

MIC: Explaining Image-Claim Inconsistencies in AI-Generated Multimodal Misinformation

Claims paired with AI-generated images are a rapidly growing form of misinformation. Existing automated fact-checking (AFC) methods mainly treat this as a provenance problem, detecting low-level synthesis artifacts to decide whether an image is AI-generated. However, such methods do not verify what human fact-checkers...

Rui-Hong Zeng, Jonathan Tonglet, Preslav Nakov et al. · 0 citations
#natural language process... Preprint Sep 2026

TeacherGRPO: Closing the Capacity Gap in Reasoning Distillation via Teacher Alignment

Teacher Alignment is proposed, which directly adapts the teacher toward the student's distribution without discarding data or degrading reasoning quality, and which significantly outperforms baselines across diverse reasoning benchmarks and distillation methods.

Zhen-Yu Lei, Zi-Han Chen, Yao-Chen Zhu et al. · 0 citations
#natural language process... Preprint Sep 2026

Grounding Memory Summarization in Utility Intent

This work proposes MemSuit, a self-distillation framework in which a teacher summarizer, conditioned on observed query-answer pairs, produces utility-aware memory entries that a student learns to reproduce from the raw conversation alone, confirming the value of grounding memory in downstream utility.

Zhen-Yu Lei, Ming-Jia Shi, Xing-Bo Fu et al. · 0 citations
#natural language process... Preprint Sep 2026

Dense Is Not Enough: Hierarchical Supervision Allocation for Long-Horizon On-Policy Distillation

This work forms long-horizon OPD as hierarchical supervision allocation as well as a coarse-to-fine framework that organizes supervision through Locate, Validate, and Refine and suggests that effective long-horizon distillation requires teaching at the right depth, the right decision, and the right token.

Yu-Hao Sun, Bin-Rui Wu, Zhuo-Er Xu et al. · 0 citations
#natural language process... Preprint Sep 2026

Language Discrimination Improves Linguistic Learning in Multilingual Speech Models

It is shown that strengthening the model's ability to discriminate languages during pretraining reduces and, on some measures, closes this multilingual gap on continuous phonetic and higher-level linguistic measures, while preserving substantial cross-language sharing.

Maureen de Seyssel, Jie Chi, Zakaria Aldeneh · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.