Skip to content

Category

machine learning

14,746 papers

#artificial intelligence Preprint Open access Oct 2026

Counterfactual Rollouts for Offline Contrastive Goal-Conditioned Reinforcement Learning

Contrastive reinforcement learning (CRL) learns goal-conditioned values by associating state--action pairs with the states subsequently reached, assuming that no unobserved variable jointly affects the recorded action and its outcome. When offline demonstrations come from a demonstrator with information hidden from the...

Tingrui Huang, Ai Bo, Junzhe Zhang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Probabilistic Multi-Source Data Selection via Learnable Categorical Priors: Variance Reduction and Guaranteed Derandomization

Bilevel data selection is a fundamental task with numerous applications in machine learning and statistics. A common strategy for tackling this problem is to relax the original bilevel combinatorial optimization into a continuous one. However, existing methods, including 0-1 relaxation and probabilistic relaxation, sti...

Shizhan Cai, Qixin Zhang, Siyuan Ma et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Prior-Fitted and Frozen Scorers for Multimodal Contrastive Learning

Multimodal contrastive learning typically relies on manually specified scoring functions, such as cosine similarity, to quantify the similarity between representations from different modalities. Several such functions have been recently proposed to extend contrastive learning beyond two modalities. In principle, howeve...

Tillmann Rheude, Roland Eils, Benjamin Wild · 0 citations
#artificial intelligence Preprint Open access Oct 2026

PTGPO: Prefix Tree Group Policy Optimization

Training language agents on long-horizon interactive tasks is challenging because sparse terminal rewards provide weak credit signals for intermediate actions. Existing group-based methods either assign a shared trajectory-level advantage or estimate step-level advantages from state groups, which may conflate the curre...

Ruolin Chen, Yang Li, Jihang Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Self-improving data synthesis can scale embedding models across domains and tasks

Adapting embedding models to new tasks requires training data that reflect task-specific information needs and relevance criteria. However, manual data design is costly and difficult to scale. Here we introduce SYNTRA, a novel retrieval data synthesis method whose self-improvement loop iteratively refines reusable synt...

Zucan Lyu, Rui Tang, Jianlyu Chen et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Integrating AIRL-Based Reward Estimation into a Control Method Using Fuzzy Inference and Policy Gradient

A method integrating policy gradient with fuzzy inference has been proposed. This method, hereafter referred to as the base model, has high flexibility with respect to the configuration of fuzzy inference rules and fuzzy representation. It can also automatically adjust the rule weights and the membership functions in t...

Seiji Ishihara · 0 citations
#artificial intelligence Preprint Open access Oct 2026

EarthAlign: Learning Language-Aligned Representations of Earth System Data

Interpreting Earth system conditions is central to understanding environmental risks and informing decisions across weather- and climate-sensitive sectors. Existing multimodal weather systems primarily target task-specific prediction, generation, or question answering, while general-purpose alignment between Earth syst...

Fadillah Adamsyah Maani, Numan Saeed, Jiaqi Ma et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

LLM-based User-Product Relevance Evaluation for Dynamic Product Advertising

Dynamic Product Advertising (DPA) retrieval systems are a core component of modern e-commerce advertising; however, their evaluation remains challenging. Conventional offline engagement metrics are limited by sparse, biased feedback, while online evaluation is costly and time-consuming. In this work, we propose a user-...

Wen Zhang, Xiao Bai, Hsiang-wei Chao et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Active Neural Matter: A Finite-Window Response Framework for Physical Systems and Distributed AI Workflows

Physical systems and distributed AI workflows can retain past information, receive delayed feedback and combine conflicting signals. These features pose a common modeling problem: determining what information about past interactions a state must retain to account for future responses. Active Neural Matter (ANM) address...

Tianchi Chen, Shihua Yu · 0 citations
#artificial intelligence Preprint Oct 2026

Rethinking Activation Functions: Reducing Bias Can Improve Learning

Many widely used activation functions, including ReLU, GELU, Swish, and Sigmoid, produce predominantly positive outputs, resulting in a nonzero post-activation mean that we term activation bias. Despite its ubiquity, the effect of activation bias on learning dynamics remains poorly understood. Using controlled models,...

Zi-Rui Peng, Helen Zheng, Zi-Ming Liu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

RES-MR: Risk-Aware Reasoning for Explainable and Safe Medication Recommendation

Medication recommendations seek to deliver personalized drug combinations based on patients' clinical information, where ensuring transparent decision-making and personalized safety are of paramount importance. However, existing approaches predominantly operate as ``black boxes'', offering limited interpretability and...

Cong Wang, Jin Li, Shoujin Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Diffusion-Based Auctions for Multi-Winner Banner Ads

We propose a new framework for banner ad auctions, leveraging diffusion models to allow for multiple bidders to co-win a single banner ad opportunity, and in particular influence the ad shown on the banner depending on the strength of their bids, enabling a far richer outcome space compared to standard banner ad auctio...

Lilian Sun, Henry Huang, Fucheng Warren Zhu et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.