Tabular foundation models adapt to new datasets through in-context learning (ICL), and, like most transformers, they tie computational depth to the number of independently parameterized layers. We ask whether the ICL stage of such a model needs a distinct set of parameters for every layer, or only depth. We introduce T...
The average-reward setting for reinforcement learning is challenging because its Bellman operator is known to contract in span only when the underlying Markov chain is mixing. Whereas existing work typically assumes a contraction property, e.g., through environment mixing, we consider the setting where we are given a r...
Julien Roger, Sam Bodmer, Jian Qian et al.· 0 citations
Recurrent algorithmic reasoners are trained with per-step hints on small graphs and run for many more steps on large ones. On breadth-first search in SALSA-CLRS, we find that a reasoner can reproduce every training hint and still fail on deep graphs: after some exact steps, it declares nodes reached before the search g...
Contrastive reinforcement learning (CRL) learns goal-conditioned values by associating state--action pairs with the states subsequently reached, assuming that no unobserved variable jointly affects the recorded action and its outcome. When offline demonstrations come from a demonstrator with information hidden from the...
Tingrui Huang, Ai Bo, Junzhe Zhang· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Bilevel data selection is a fundamental task with numerous applications in machine learning and statistics. A common strategy for tackling this problem is to relax the original bilevel combinatorial optimization into a continuous one. However, existing methods, including 0-1 relaxation and probabilistic relaxation, sti...
Shi-Zhan Cai, Qi-Xin Zhang, Si-Yuan Ma et al.· 0 citations
Multimodal contrastive learning typically relies on manually specified scoring functions, such as cosine similarity, to quantify the similarity between representations from different modalities. Several such functions have been recently proposed to extend contrastive learning beyond two modalities. In principle, howeve...
Tillmann Rheude, Roland Eils, Benjamin Wild· 0 citations
Training language agents on long-horizon interactive tasks is challenging because sparse terminal rewards provide weak credit signals for intermediate actions. Existing group-based methods either assign a shared trajectory-level advantage or estimate step-level advantages from state groups, which may conflate the curre...
Ruo-Lin Chen, Yang Li, Ji-Hang Wang et al.· 0 citations
SYNTRA is introduced, a self-improving agentic framework that turns a few retrieval examples into reusable synthesis instructions that enables scalable embedding-model adaptation with minimal human intervention.
Zucan Lyu, Rui Tang, Jianlyu Chen et al.· 0 citations
A method integrating policy gradient with fuzzy inference has been proposed. This method, hereafter referred to as the base model, has high flexibility with respect to the configuration of fuzzy inference rules and fuzzy representation. It can also automatically adjust the rule weights and the membership functions in t...
EarthAlign and MeteoLIP provide a foundation for learning and evaluating language-aligned representations of Earth system data and improve upon the corresponding CLIP and SigLIP baselines across three downstream tasks: cross-modal retrieval, weather-condition classification, and physical variable estimation.
F. Maani, N. Saeed, Jia-Qi W. Ma et al.· 0 citations
Dynamic Product Advertising (DPA) retrieval systems are a core component of modern e-commerce advertising; however, their evaluation remains challenging. Conventional offline engagement metrics are limited by sparse, biased feedback, while online evaluation is costly and time-consuming. In this work, we propose a user-...
Wen Zhang, Xiao Bai, Hsiang-wei Chao et al.· 0 citations
Physical systems and distributed AI workflows can retain past information, receive delayed feedback and combine conflicting signals. These features pose a common modeling problem: determining what information about past interactions a state must retain to account for future responses. Active Neural Matter (ANM) address...
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
MIT News · Artificial Intelligence· news.mit.eduOct 27, 2026
Prabha Jha used her experience with MIT Open Learning’s program for senior executives to develop AI solutions for her employer, Verizon, and to write a book.
Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.