Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Open access Oct 2026

Nash Social Welfare for Multi Armed Bandits: Trajectory-wise Expected and High Probability Regret

We study fair multi-armed bandits under the Nash Social Welfare (NSW) objective, which measures performance via the geometric mean of accumulated rewards. Existing work defines Nash regret as $\mathrm{NR}_T = \mu^\star - (\prod_{t=1}^T \mathbb{E}\mu_{I_t})^{1/T}$, where $\mu_{I_t}$ is the mean reward of the recommended...

Avishek Ghosh · 0 citations
#artificial intelligence Preprint Oct 2026

Learning to Retrieve via Reinforcement Learning in Embedding Space

Dense retrieval models are typically trained with contrastive objectives that learn effective representations but do not directly optimize retrieval metrics or downstream task performance. To address this problem, we introduce RELER (REinforcement LEarning for Retrieval), a reinforcement learning framework that enables...

Qi Liu, Feng-Ming Liang, Yi-Qun Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

SanSi: A Looped Typed Decision Model for System 1.5 Thinking

Typed decision models answer a declared question without generating text: a decision head returns a probability for each of the declared options in a single forward pass. A single pass is fast, intuitive System 1 thinking. We study what lies between one pass and generated reasoning: looping, in which the same layers ar...

Shu-Yu Gan, Young-Jun Lee, Dongyeop Kang · 2 citations
#machine learning Preprint Oct 2026

The Model Plants the Trigger: Answer-Side Backdoor Attacks in Multi-Turn Large Language Models

Safety alignment in Large Language Models (LLMs) remains vulnerable to backdoor attacks. Existing LLM backdoors are almost all input-centric: activation depends on explicit trigger patterns in the user input, so modern guardrails are built to sanitize the input space. We challenge this assumption with a novel answer-si...

Yi-Bo Zhang, Tian-Rong Guan, Liang Lin et al. · 0 citations
#machine learning Preprint Oct 2026

Exact Calibration and Sharp Risk Geometry for Volume-Sampled Ridge Regression

We study ridge regression from exactly $s$ distinct rows of a fixed design. Responses are fixed, and only the subset is random. The determinant law and selected ridge fit share one positive definite penalty. Established mean identities and exponential-family duality give the unique penalty that matches a prescribed ful...

Kihun Rhee · 0 citations
#machine learning Preprint Oct 2026

RefRoute: Decoupling Conditioning Cost from References via Compact Residual Conditioning and Spatial Routing

Multi-reference image generation requires preserving the appearance of multiple subjects while composing them into a coherent scene. However, existing diffusion transformers commonly encode references as dense visual token grids and jointly process them with global attention, making conditioning increasingly expensive...

Wan-Ning He, Yu-Yao Zhang, Yu-Wing Tai · 0 citations
#machine learning Preprint Oct 2026

Stability of Measure-to-Measure Transformers on Sub-Gaussian Data

Transformers have exhibited impressive empirical success across various domains, but their theoretical foundations remain less developed. This work constitutes a mathematical study of the measure-to-measure operators defined by transformers. We show that transformers map sub-Gaussian inputs to sub-Gaussian outputs; thi...

Frank Cole, N. Nelsen, Takashi Furuya · 1 citation
#machine learning Preprint Oct 2026

Mathematical Invariant-Enabled Topological Neural Networks for Molecular and Materials Property Prediction

Existing molecular and materials learning approaches often rely on a limited set of structural representations, which may capture only selected aspects of complex three-dimensional structure. Here, we introduce mathematical invariant-enabled topological neural networks (MITNNs), a framework that represents complex stru...

Yi-Ming Ren, Xiang Liu, Mustafa Hajij et al. · 0 citations
#machine learning Preprint Oct 2026

Independent Multi-Agent Reinforcement Learning with Counterfactual Semantic-Social World Models

Fully decentralized multi-agent reinforcement learning (MARL), also referred to as independent learning, requires each agent to learn and act using only its local information and experience, without a centralized critic or inter-agent communication. Such a stringent information structure renders the conventional reward...

Fernando Martinez, Tao Li, Ying-Dong Lu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

CACHEFORGE: LLM-Guided End-to-End Generative Cache Replacement Policy for Performance and Hardware Efficiency

CACHEFORGE is the first framework to evolve cache-replacement policies end-to-end by embedding a large language model inside a governed hardware-aware loop and enforces feasibility through reward shaping, structural checks, dynamic mutation, temperature scheduling, and cross-policy crossover.

Kaushal Mhapsekar, Bita Aslrousta, Brijesh Kumar Bhayana et al. · 0 citations
#artificial intelligence Review Oct 2026

Joint Workflow and Prompt Optimization for User Behavior Simulation

User behavior simulation is the computational modeling of user interactions within information systems through the use of simulated agents in place of live users. It supports system testing and evaluation, decision-making and forecasting, and user experience design. Existing simulators rely on hand-crafted rules or dom...

Ni-Er Wu, Hong-Zhi Yin, Hui Li et al. · 0 citations
#machine learning Preprint Oct 2026

Uniform Discrete Diffusion Models are Minimax Optimal for Estimating Distributions with Small Effective Support Size

These upper and lower bounds show that uniform discrete diffusion successfully avoids the curse of dimensionality for distributions with small effective support size: the TV error rate depends on the ambient state-space size only through $s_n(P_0)$, while the corresponding KL rate incurs only an additional logarithmic...

D.-H. Yoon, Saptarshi Chakraborty · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.