Jev answers MMLU's calculation-heavy questions more accurately than other MMLU questions (94% vs. 91%), whereas both open models, and all three on C-Eval, find them harder.
Tobias Deußer, L. Sparrenberg, R. Sifa· 4 citations
RLTL;DR is introduced, a promising compacted training paradigm of the form"on this sort of task, keep this sort of thing in mind", which it is hoped will inspire future research on.
Michael Kirchhof, Eleonora Gualdoni, Andrew Szot et al.· 0 citations
It is found that a short round of training on corrections beats the same amount of training on generic chat data, that corrections on other medical prompts do roughly as well as corrections of the poisoned prompts themselves, and that instructing the correction writer to model a careful, harm-avoiding assistant adds no...
The analyses show how VLM evaluation behaves as model panels grow and evolve, providing guidance for designing future benchmarks that are more efficient, robust to model turnover, and explicit about the limits of evaluation-side pruning.
We propose RegLLM, a diagnostic harness for bounded autonomy in regulated agentic workflows. It instruments six trustworthiness signals: citation validity, source grounding, schema compliance, escalation correctness, constitutional alignment, and unsafe-action rate. Signals are distinguished by their source of supervis...
PriceCheck is introduced, which builds a compact family of decision rules from label-free checks such as re-solving a problem, and shows that choosing how checks are combined and stopped matters alongside how well a verifier ranks answers.
D. Lee, Jungseob Lee, Chanjun Park et al.· 2 citations
Retrieval-augmented language models are expected to answer from the retrieved evidence, but in practice they often keep answering when that evidence is missing. We trace this behavior to the training signal: answer-focused fine-tuning assigns no target to unsupported contexts, so it cannot distinguish a reader that abs...
Zeyan Li, Qi-Rong Guo, Si-Yuan Qiu et al.· 0 citations
This work introduces MERA (Missing-Evidence Retrieval Augmentation), which separates globally searchable memory from a question-specific evidence state, and trains a lightweight planner through reinforcement learning, rewarding queries that recover previously missing evidence.
Yi-Xuan Deng, Yi Zhang, Wei Liu et al.· 0 citations
Model adaptation is typically governed by a fixed recipe, even though different update programs can produce substantially different behavioral outcomes. We introduce adaptation compilation, which reframes where, how, and to what extent a model should adapt as a joint prediction and decision problem. Rather than searchi...
Test-time compute scaling has emerged as a cornerstone of advanced machine reasoning, yet performing iterative deliberation directly within continuous latent representation spaces reveals a catastrophic pathology: the Deliberation Drift Cliff. While unconstrained recurrent latent models achieve initial reasoning gains...
The theoretical and empirical results provide a holistic view of both the opportunities and the limitations of CoT monitoring, and show that the answer depends on the underlying task difficulty and the model size.
Mohammadali Mohammadkhani, M. Krishna, Yash Sarrof et al.· 0 citations
Answering questions and completing tasks over large document collections often requires connecting evidence spread across multiple documents, such as a project's approval recorded in one, its requirements in another, and its latest status in a third. Recent LLM agents approach this by iteratively searching the full cor...
Soyeong Jeong, S. Jauhar, Sung Ju Hwang et al.· 0 citations
A new method, called CW-Net, translates the reasoning process of an autonomous vehicle’s AI system into understandable concepts that explain its behavior.
MIT News · Artificial Intelligence· news.mit.eduAug 31, 2026
With millions of users across the world, Julia has been used to conduct cutting-edge research and to design new drugs, jet engines, heat pumps, and more.