This work proposes MemSuit, a self-distillation framework in which a teacher summarizer, conditioned on observed query-answer pairs, produces utility-aware memory entries that a student learns to reproduce from the raw conversation alone, confirming the value of grounding memory in downstream utility.
Zhen-Yu Lei, Ming-Jia Shi, Xing-Bo Fu et al.· 0 citations
This work forms long-horizon OPD as hierarchical supervision allocation as well as a coarse-to-fine framework that organizes supervision through Locate, Validate, and Refine and suggests that effective long-horizon distillation requires teaching at the right depth, the right decision, and the right token.
Yu-Hao Sun, Bin-Rui Wu, Zhuo-Er Xu et al.· 0 citations
Downstream the effect is small: NER improves only on entities that contain words unseen in training, POS tagging and news classification do not change, and published Nepali tokenizers perform about as well.
It is shown that strengthening the model's ability to discriminate languages during pretraining reduces and, on some measures, closes this multilingual gap on continuous phonetic and higher-level linguistic measures, while preserving substantial cross-language sharing.
Maureen de Seyssel, Jie Chi, Zakaria Aldeneh· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Leading multi-bit watermarking methods for language models encode messages by biasing the model's next-token probabilities, creating a trade-off between message recovery and text quality. Their decoders typically return the highest-scoring candidate from accumulated token-level evidence, without a certified abstention...
Pawel Batorski, P. Spurek, Paul Swoboda· 0 citations
BatCheet is introduced, a multilingual dialogue corpus named after the Hindi term for conversation or chitchat, containing approximately 49,000 dialogues for dialogue translation across five translation directions and fine-tuning five open-source LLMs yields substantial gains over zero- and few-shot baselines.
Priyanka Dasari, Yuvrajsinh Bodana, V. Mujadia et al.· 0 citations
Reinforcement learning with binary correctness rewards trains correctness, not calibrated confidence. The confidence that reasoning models verbalize is systematically overconfident, and the problem is not merely one of scale: verbalized confidence tracks how willing a model is to commit to an answer, not how likely the...
Ya-Dong Xi, Rong-Sheng Zhang, Tang-Jie Lv et al.· 0 citations
With this ensemble, frequency matching with a public name list recovers zero identities by alignment across the four corpora; the names it got right were ones the detector missed, left in clear text.
Andreas K. Maier, Monica Hinrichs-Mayer, Franziska Weber et al.· 0 citations
This work proposes Threader, a memory system that shifts the focus from memory construction to efficient, structure-aware access over raw interactions, and preserves them as first-class memory, organizes them into topic-coherent segments via lightweight incremental segmentation, and enables accurate retrieval through m...
Dong-Hua Cai, Yong-Heng Deng, Yi-Fei Wang et al.· 0 citations
CoLMbo-SV, a speaker language model that combines strong speaker discrimination with structured, acoustically grounded comparison reports, substantially advance audio-language speaker verification, bring its accuracy toward that of dedicated speaker encoders while adding checkable acoustic reporting, and establish an e...
Massa Baali, Sarthak Bisht, Zi-Yue Qiu et al.· 0 citations
MULTISPEECHQA, a large-scale, synthetically generated and human-verified dataset comprising 9200 hours of 10.8 million spoken question-answer pairs in 23 typologically diverse languages, is presented and shows that high-quality synthetic datasets offer a cheap solution to improving the multilingual capabilities of SLMs...
Tolúlopé Ògúnrèmí, D. Jurafsky, Christopher D. Manning et al.· 0 citations
Test-time scaling and post-training have improved LLM performance in coding and mathematical reasoning, but their effectiveness for individual stance prediction remains unclear. We study this question by predicting a person's stance in a new discussion from their history. We evaluate widely used test-time scaling strat...
Yuyang Zhao, Xuan Liu, HaoYang Shangm Haojian Jin· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduSep 24, 2026