LaSEr-Edit is proposed, a constraint-satisfying text revision method that can be applied to any LLMs, black- or white-box, and it is found that lightweight, task-specific energy-based models (EBMs) achieve error-localization performance competitive with or even better than that of much larger LLMs, while operating subs...
H. Son, Saehee Eom, Mooho Song et al.· 3 citations
Granularity alignment, not algorithm choice, localizes when routing helps, and what category supervision buys when deployed through routing is quantified.
EpiKV is introduced, which combines hidden-state shifts with the model's recent query--key relevance to rank cached tokens without materializing the attention matrix, and matches or outperforms the strongest attention-based eviction baselines while running directly in vLLM with unmodified attention kernels.
Steven Kolawole, Virginia Smith· arXiv.org· 2 citations
It is shown that harness-aware post-training not only improves in-distribution performance but also enables agents to robustly adapt to OOD settings, highlighting the importance of harness-aware post-training under such shifts.
Kyungmin Kim, Youngbin Choi, Seoyeon Lee et al.· arXiv.org· 7 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
A post-hoc certification framework forparse autoencoders that provides a practical way to determine whether an SAE representation preserves enough of a frozen LM's predictive behavior to support certification of the original model.
Drop-by-Drop is proposed, a novel multi-bitwidth post-training quantization framework enabling inference-time precision control over LLM weights from a single quantized model, and it is proved that Gaussian sources are successively refinable under a weighted mean squared error distortion motivated by LLM loss functions...
Liza Babaoglu, Shuangyi Chen, Ashish J. Khisti· arXiv.org· 1 citation
Claw-SWE-Bench is introduced, a unified benchmark that enables researchers to systematically assess the capabilities and efficiency of general-purpose harnesses on software engineering tasks and guide the development of more capable and efficient harnesses.
Meng-Yu Zheng, Kai Han, Bo-Xun Li et al.· arXiv.org· 5 citations
EntmaxKV is introduced, an entmax-native sparse decoding framework that exploits sparsity before KV pages are loaded, and a Gaussian-aware entmax selector that estimates the entmax threshold from lightweight page statistics, adapting the selected budget to the score distribution.
Gonçalo Duarte, Miguel Couceiro, Marcos V. Treviso· arXiv.org· 0 citations
Matryoshka Representation Learning (MRL) is a widely adopted approach for training text encoders so they provide useful text representations at various sizes, available by simply truncating the resulting vectors at sizes pre-determined at training time. Recent works have shown that randomly truncating text embeddings h...
Sotaro Takeshita, Yurina Takeshita, Simone Paolo Ponzetto et al.· 0 citations
This work introduces MulTaBench, a benchmark of 40 datasets, split equally between image-tabular and text-tabular tasks, designed to enable the research of novel architectures which incorporate joint modeling and target-aware representations, paving the way for the development of novel Multimodal Tabular Foundation Mod...
Alan Arazi, Eilam Shapira, Shoham Grunblat et al.· arXiv.org· 3 citations
Targeted data selection seeks training examples from a candidate pool that improve downstream task performance. While trajectory-based selectors effectively guide this process, existing approaches typically construct reference states by warming up on the candidate pool itself, thereby inheriting pool-dependent distribu...
Huitao Yang, Hengzhi He, Tung Sum Thomas Kwok et al.· 0 citations
Flux Attention is introduced, a context-aware framework that dynamically optimizes attention computation at the layer level by integrating a lightweight Layer Router into frozen pretrained LLMs, which adaptively routes each layer to FA or SA based on the input context.
Quantong Qiu, Zhiyi Hong, Yi Yang et al.· arXiv.org· 0 citations
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduSep 24, 2026
A new method, called CW-Net, translates the reasoning process of an autonomous vehicle’s AI system into understandable concepts that explain its behavior.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.