Skip to content

Category

natural language processing

9,261 papers

#machine learning Preprint Aug 2026

DiFA: Dual Evidence Fusion and Aggregation for Token-Level Text Anomaly Detection

A Dual-evidence framework with adaptive Fusion and Aggregation (DiFA) for token-level anomaly detection, which derives anomaly scores from form-structural and semantic views to capture visible structural abnormality and contextual inconsistency, thereby providing complementary evidence for identifying diverse anomalies...

Yan-Yu Qian, Peng-Cheng Weng, Yue Tan et al. · 0 citations
#machine learning Preprint Aug 2026

Correlation-Aware Structured Pruning for Large Language Models

This work forms the pruning objective as a cardinality-constrained binary quadratic program that explicitly models cross-unit dependencies in the reconstruction error, and develops a greedy interaction algorithm based on dependency-aware marginal costs to optimize unit selection.

Si-Cheng Xu, Hao Shi, Wei Zhang et al. · 0 citations
#machine learning Preprint Aug 2026

Evaluation Awareness Shifts from Format to Context with Model Scale

A dual-pathway intervention is proposed that combines prompt sanitization with activation counter-steering to suppress both external evaluation triggers and their internal representations and suggests that effective mitigation requires jointly addressing both prompt-level and representation-level signals.

Navraj Singh, Maheep Chaudhary · 0 citations
#artificial intelligence Preprint Aug 2026

Context Poisoning as Extreme-Value Attention Interference in Long-Context Language Models

Under a softmax retrieval abstraction, a finite-sample upper bound is derived showing that maintaining a fixed accuracy target above base rate requires the evidence margin to scale as $\Omega(\sqrt{\log N})$, where N denotes the effective distractor count rather than necessarily the raw context length.

Meysam Ghaffari, Nina Fatehi, Bhaskar Sen et al. · 0 citations
#machine learning Preprint Aug 2026

AdaMem: Adaptive Memory Token Allocation for Soft Compression in Retrieval-Augmented Generation

AdaMem is a relevance-guided soft-compression framework that maps learned passage-relevance estimates to a query-dependent allocation of a fixed memory-token budget and retains an efficiency profile comparable to the uniform-compression baseline, while achieving up to $4\times lower inference latency than full-context...

A. Sakhno, G. Davydenko, O. Zoloev et al. · 0 citations
#machine learning Preprint Aug 2026

Token Signatures of Code: Comparing Coding Behaviors Across Large Language Models

An interactive visual analytics system is developed to navigate the comparison landscape, identify pairs of interest, and drill down into discriminative tokens and their code contexts, as well as defining two new metrics: robustness and concentration.

Jun-Peng Wang, Yuzhong Chen, Menghai Pan et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Summarize, Judge, Refine: Decoupled Content Understanding and Policy Learning for Multimodal Content Moderation

Content moderation systems traditionally entangle multimodal understanding with policy-specific classification, requiring full pipeline retraining for every policy change and suffering from label scarcity since multimedia cannot be meaningfully augmented. We propose Summarize-Judge-Refine (SJR), a two-model architectur...

Zeeshan Ahmed, Yang Qin, Hanqing Huang · 0 citations
#machine learning Preprint Open access Sep 2026

Critical-State RL: Diagnosing Trainable States for Multi-Turn Tool Use

Multi-turn tool-use failures can hinge on a single model call, yet reward variation alone does not reveal which call would benefit from training. When rewards depend on later interactions, their variation can reflect downstream randomness rather than differences between the current actions. We introduce Critical-State...

Zixiang Chen, Wenting Zhao, Zhepeng Cen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

RRSI: Regularized Recursive Self-Improvement of Agent Harnesses

An LLM agent's capability is largely magnified by its harness, namely the prompts, control flow, tooling, memory, and context management surrounding the frozen backbone model. Recent methods increasingly automate this process by iteratively proposing and selecting component-wise edits of an agent harness, practically e...

Peng Xia, Ru-Jun Han, Zifeng Wang et al. · 3 citations · ⚡1
#machine learning Preprint Sep 2026

Muon Can Outperform Dedicated Continual Learning Methods

This work trains a plain incremental LoRA (IncLoRA) with Muon, which orthogonalizes each update, and compares it against O-LoRA and ELLA over five seeds and three task orders on the Standard CL Benchmark and three seeds on TRACE.

Sebastian George Sincari, Bogdan Alexandru Gheorghe, Antonio Barbalau Faculty of Mathematics et al. · 0 citations
#machine learning Preprint Sep 2026

1% of Tokens Can Be Enough: On Gradient Estimation in On-Policy Distillation

An information-efficiency ratio (IER) based on a signal-to-noise decomposition and a candidate-set approximation enables token selection based on IER and its combination with existing usefulness scores, while retaining the sampled reverse-KL training objective.

Huan-Xin Sheng, Zhi-Ling Ye, Hao-Nan Wang et al. · 4 citations
#machine learning Preprint Sep 2026

SupportCal: Label-Free Calibration of Post-Trained LLMs via Reference Support and Corroboration

SupportCal is introduced, a label-free post-hoc method that retains agreement examples at unit weight and assigns disagreement examples continuous weights based on the own-base PLM's relative support and corroboration from pretrained references selected from a size-compatible candidate pool.

Linhan Luo, Le-Quan Lin, Dai Shi et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.