Skip to content

Category

natural language processing

7,968 papers

#machine learning Preprint Jun 2024

LaSEr-Edit: Localized Span-level Error Editing with Energy-based Localization

LaSEr-Edit is proposed, a constraint-satisfying text revision method that can be applied to any LLMs, black- or white-box, and it is found that lightweight, task-specific energy-based models (EBMs) achieve error-localization performance competitive with or even better than that of much larger LLMs, while operating subs...

H. Son, Saehee Eom, Mooho Song et al. · 3 citations

Epiphany-Aware KV Cache Eviction Without the Attention Matrix

EpiKV is introduced, which combines hidden-state shifts with the model's recent query--key relevance to rank cached tokens without materializing the attention matrix, and matches or outperforms the strongest attention-based eviction baselines while running directly in vLLM with unmodified attention kernels.

Steven Kolawole, Virginia Smith · 2 citations

The Interplay of Harness Design and Post-Training in LLM Agents

It is shown that harness-aware post-training not only improves in-distribution performance but also enables agents to robustly adapt to OOD settings, highlighting the importance of harness-aware post-training under such shifts.

Kyungmin Kim, Youngbin Choi, Seoyeon Lee et al. · 7 citations

Multi-Bitwidth Quantization for LLMs Using Additive Codebooks

Drop-by-Drop is proposed, a novel multi-bitwidth post-training quantization framework enabling inference-time precision control over LLM weights from a single quantized model, and it is proved that Gaussian sources are successively refinable under a weighted mean squared error distortion motivated by LLM loss functions...

Liza Babaoglu, Shuangyi Chen, Ashish J. Khisti · 1 citation

Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks

Claw-SWE-Bench is introduced, a unified benchmark that enables researchers to systematically assess the capabilities and efficiency of general-purpose harnesses on software engineering tasks and guide the development of more capable and efficient harnesses.

Meng-Yu Zheng, Kai Han, Bo-Xun Li et al. · 5 citations

EntmaxKV: Support-Aware Decoding for Entmax Attention

EntmaxKV is introduced, an entmax-native sparse decoding framework that exploits sparsity before KV pages are loaded, and a Gaussian-aware entmax selector that estimates the entmax threshold from lightweight page statistics, adapting the selected budget to the score distribution.

Gonçalo Duarte, Miguel Couceiro, Marcos V. Treviso · 0 citations
#machine learning Preprint Open access Sep 2026

To MRL or not to MRL: Text Embeddings are Robust to Truncation Without Matryoshka Learning, Except In Heavy Truncation Scenarios

Matryoshka Representation Learning (MRL) is a widely adopted approach for training text encoders so they provide useful text representations at various sizes, available by simply truncating the resulting vectors at sizes pre-determined at training time. Recent works have shown that randomly truncating text embeddings h...

Sotaro Takeshita, Yurina Takeshita, Simone Paolo Ponzetto et al. · 0 citations

MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Image

This work introduces MulTaBench, a benchmark of 40 datasets, split equally between image-tabular and text-tabular tasks, designed to enable the research of novel architectures which incorporate joint modeling and target-aware representations, paving the way for the development of novel Multimodal Tabular Foundation Mod...

Alan Arazi, Eilam Shapira, Shoham Grunblat et al. · 3 citations
#machine learning Preprint Open access Sep 2026

Let the Target Select for Itself: Data Selection via Target-Aligned Paths

Targeted data selection seeks training examples from a candidate pool that improve downstream task performance. While trajectory-based selectors effectively guide this process, existing approaches typically construct reference states by warming up on the candidate pool itself, thereby inheriting pool-dependent distribu...

Huitao Yang, Hengzhi He, Tung Sum Thomas Kwok et al. · 0 citations

Flux Attention: Context-Aware Hybrid Attention for Efficient LLMs Inference

Flux Attention is introduced, a context-aware framework that dynamically optimizes attention computation at the layer level by integrating a lightweight Layer Router into frozen pretrained LLMs, which adaptively routes each layer to FA or SA based on the input context.

Quantong Qiu, Zhiyi Hong, Yi Yang et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.