This work introduces PROOF, a profile-oriented benchmark for factual coverage in instruction-tuned language models, and measures factual coverage as a structured, intervention-aware profile rather than a single claim about what a model believes.
A. Chetvergov, Mikhail Solovev, Timofei Sivoraksha et al.· 0 citations
This paper examines Pythia and OLMo 2 across 66 pretraining checkpoints, three of the post-training stages of OLMo 2 that have been released, about 90,000 continuations, and four training corpora, and traces the provenance from end to end to show exactly where such descriptions came from.
Deep search requires LLM agents to decompose complex queries, search for evidence, and synthesize grounded answers, yet existing ReAct-style agents suffer from two limitations: role coupling, where one policy must handle planning, evidence use, and synthesis; and context accumulation, where growing search histories int...
Xing-Yu Wu, Yuchen Yan, Zhengxi Lu et al.· 0 citations
This work proposes Agentic-GER, an LLM-based agent for terminology correction in long-form speech, which uses global context from the full transcript to identify suspicious terms and resolve ambiguous hypotheses.
Yan-Qiao Zhu, Wu-Peng Wang, Zhifu Gao et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The main findings are that diverse, high-quality SFT establishes a strong capability floor and difficulty filtering keeps RL prompts within a productive learning range, and reward reliability provides a practical principle for ordering stages.
Chia-yuan Chang, Ren-Yuan Cheng, Rui Feng et al.· 0 citations
Science, technology, and innovation policies are crucial for competitiveness, yet their diversity and scale make them difficult to map and monitor consistently. Existing approaches rely heavily on manual survey efforts, which are costly and challenging to scale across countries. Large language models (LLMs) enable new...
Carolyn Cole, M. Deschryvere, Toqeer Ehsan et al.· FLINS-ISKE· 0 citations
Fine-grained meme classification in A2 was the most challenging setting, partly due to sparse labels and train-test distribution shifts, partly due to sparse labels and train-test distribution shifts.
Firoj Alam, Masudul Biswas, Mohamed Bayan Kmainasi et al.· 0 citations
The preamble worsens ten models, moving three out of the band into collapse and one into refusal, yet improves seven whose neutral prompts over-mark: the vulnerability replicates, but its direction is exam-specific.
A. Habibullah, Yazan Alshoibi, M. Alshiekh et al.· 0 citations
Chain-of-thought (CoT) instructions can distort multiple-choice VLM evaluation when a scorer appends a reasoning cue but reads answer-label logits before the model generates any rationale. We call this CoT-prefix scoring. On ScienceQA, Qwen2.5-VL-7B drops from 80.76% to 45.48%, and across five option-content permutatio...
Given a large corpus, the questions one might ask can vary -- from "When was the first human heart transplant?" to "What are all the contradictory claims in this literature?" -- but what makes some questions more challenging than others? In this work, we define a notion of Corpus Task Complexity (CTC) that characterize...
Prasann Singhal, Amanda Bertsch, Jacob Steinhardt et al.· 0 citations
Active Taskless Distillation (ATD) is introduced, which achieves capability transfer using only a single word from the teacher per prompt, and its strength tracks the teacher's update strength.
Zi-Yang Zhang, Yu-Bin Jing, Yuan-Hao Zeng et al.· 0 citations
Internet texts are replete with format tags that carry structural, semantic, and functional meaning. Current large language model (LLM)-based translation systems struggle to balance translation fluency with tag fidelity when processing tagged text. We argue that resolving this tension requires a systematic approach at...
Zhanglin Wu, Hengchao Shang, Dai-Meng Wei et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduSep 24, 2026