The theoretical and empirical results provide a holistic view of both the opportunities and the limitations of CoT monitoring, and show that the answer depends on the underlying task difficulty and the model size.
Mohammadali Mohammadkhani, M. Krishna, Yash Sarrof et al.· 0 citations
Answering questions and completing tasks over large document collections often requires connecting evidence spread across multiple documents, such as a project's approval recorded in one, its requirements in another, and its latest status in a third. Recent LLM agents approach this by iteratively searching the full cor...
Soyeong Jeong, S. Jauhar, Sung Ju Hwang et al.· 0 citations
Mid-training equips pretrained large language models with specialized and reasoning capabilities, but the returns of this stage are bounded since additional serial compute yields little further downstream improvement and can even degrade some capabilities, which places a practical ceiling on how much compute mid-traini...
Zhehao Huang, Changxin Tian, Qingyuan Yang et al.· 0 citations
Reward-Free Policy Optimization (RFPO), which repurposes a single calibrated, frozen critic as a rollout-level reward, a value baseline for generalized advantage estimation, and a success forecaster for unfinished prefixes is introduced.
Hong-Yang Li, Xiao Li, Caesar Wu et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
These stages establish a constructive post-training path from English-pivoted capability to multilingual reasoning that is reliably delivered, and jointly track correctness, language adherence, termination, and delivery efficiency.
Hong-Yang Li, Xiao Li, Caesar Wu et al.· 0 citations
It is shown that useful explanations can extend beyond the model a verbalizer was trained to describe and show that pretrained verbalizers recover words that models have learned to conceal through fine-tuning, without additional verbalizer training.
Federico Torrielli, Gianluca Barmina, Andrea Blasi Núñez et al.· 0 citations
Knowledge concept tagging aims to assign specific concept or topic labels to educational content, which is essential for both educators and learners in traditional and online teaching practices. Recent work has explored large language models (LLMs) for this task, achieving promising performance. However, LLMs still str...
Zhiwei Yang, Jiahua Yang, Huiru Lin et al.· 0 citations
These measurements turn correlation from a post-hoc warning into an auditable allocation decision and turn correlation from a post-hoc warning into an auditable allocation decision.
Miao-Bo Hu, Shu-Hao Hu, Xiao-Bo Guo et al.· 0 citations
Large language models (LLMs) excel at token-level generation but may learn undesirable abstract semantics and lack comprehensive perception. LLM-JEPA mitigates this by aligning different views of the same underlying knowledge via a joint-embedding predictive architecture (JEPA). However, strong alignment does not neces...
BaLEEN (Biasing with Latent Encoded Entities), a lightweight, hypernetwork-based framework for dynamic contextual adaptation without fine-tuning the underlying ASR model, is proposed.
A bilingual Moshi-style model is trained that sustains coherent multi-party English-Chinese conversations over extended durations and substantially outperforms open-source baselines including Moshi, MiniCPM-o-4.5, and Qwen3-Omni-30B-A3B-Instruct on MultiTalkBench.
Ke Wang, Houxing Ren, Zi-Mu Lu et al.· 0 citations
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduSep 24, 2026
A new method, called CW-Net, translates the reasoning process of an autonomous vehicle’s AI system into understandable concepts that explain its behavior.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.