Understanding gender biases in large language models (LLMs) is increasingly important as these systems become embedded in decision-support tools with real consequences. Prior research has focused only on a small set of models, leaving open the extent to which gender biases are common and heterogeneous across LLMs. We a...
On-policy distillation (OPD) trains a student on its own generated responses using dense, token-level supervision from a stronger teacher. Vanilla OPD treats all teacher signals equally, assuming that the teacher's supervision is equally important for every token. However, teacher signals at different tokens may have v...
Zhen-Yu Wang, Tian-Ze Wang, Lin-Jun Zhang et al.· 0 citations
We evaluate an auditable long-term memory system on LongMemEval-S. Its retrieval chain uses hybrid candidate retrieval, cross-encoder reranking, coverage-first packet compilation, and deterministic reasoning scaffolds; an LLM is used only as a replaceable final reader. The chain places all gold sessions in the candidat...
AccHMR, the accuracy multiplied by HMR, which reports the reward in proportion to the accuracy, is proposed, which reports the reward in proportion to the accuracy, and on which the revised rules would have scored 0.6549, 5th.
Julien Knafou, L. Mottin, Alexandre Flament et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work is the first to unveil the critical role of the null space and harness it for model optimization, and uses a simplified analytical model about optimization to demonstrate why null-space can effectively reduce attention entropy, thereby improving the efficiency of reasoning.
Hong-Bo Ma, Sansheng Cao, Jia-Jun Fan et al.· 0 citations
Masked diffusion models (MDMs) generate text by unmasking several tokens per step, but they are trained and sampled under different conditions. The model is trained on randomly masked sequences, whereas inference follows a trajectory shaped by the model's own predictions. Additionally, each step has no access to what t...
Manuel Madeira, Amitis Shidani, Alice Bizeul et al.· 0 citations
This work uses training data attribution to quantitatively estimate how much each harmful example contributes to EM and benchmark the quality of the attribution via retraining -- a sound attribution score should enable us to enhance or attenuate EM by filtering data on that score.
Gonçalo Paulo, Louis Jaburi, Nora Belrose et al.· 0 citations
Reinforcement Learning with Verifiable Rewards (RLVR) methods such as GRPO rely on successful self-generated trajectories, but finite rollout budgets can produce all-fail groups with no reward-based policy-gradient signal. While additional rollouts improve the chance of success at higher cost, successful trajectories m...
Doohyuk Jang, Y. Park, Gyouk Chu et al.· 0 citations
MIST, the Misleading-Image Stress Test: 200 English sentences, each built around a phrase readable either figuratively or literally and shown with an aligned image depicting its reading, a misleading image depicting the opposite, or no image at all is introduced.
Nagham Omar, Mahmoud Jabarin, Kinan Ibraheem et al.· 0 citations
LoopSLM builds on looped Transformers for latent reasoning, reusing a decoder block to refine hidden states with acoustic grounding at every pass, and further narrows the perception-reasoning gap by separating learning to reason from learning to respond, enabling direct inference without CoT.
Sheng-Bo Cai, Yu-Xiang Wang, Jing-Ran Xie et al.· 2 citations
We propose a rubric for assessing expressed clinical reasoning in model responses, drawing on three bodies of work: medical education assessment frameworks (ART, SCT, Key Feature Problems and OSCE); clinical LLM benchmarks (MedR-Bench, HealthBench, TIMER-Bench, DR. BENCH, PrIME-LLM and PatientSafeBench); and general LL...
This work characterize precisely the geometry of computation in a number-comparison task, as an abstraction of comparison for decision making, and how models utilize geometry in an elegant fashion to implement it, demonstrating that the manifold hypothesis can co-exist with linear representations.
Sai Sumedh R. Hindupur, Hadas Orgad, Thomas Fel et al.· 0 citations
A new method, called CW-Net, translates the reasoning process of an autonomous vehicle’s AI system into understandable concepts that explain its behavior.
MIT News · Artificial Intelligence· news.mit.eduAug 31, 2026
With millions of users across the world, Julia has been used to conduct cutting-edge research and to design new drugs, jet engines, heat pumps, and more.