Skip to content

Category

artificial intelligence

14,515 papers

#artificial intelligence Preprint Open access Oct 2026

Stochastic Penalty-Barrier Method for Constrained Machine Learning

Constrained Machine Learning (CML) enables fairness-aware training, physics-informed neural networks, and integration of symbolic domain knowledge into statistical models. In this work, we introduce the Stochastic Penalty-Barrier Method (SPBM) for CML problems. SPBM extends classical penalty and barrier methods by inco...

Adam Bos\'ak, Andrii Kliachkin, Gilles Bareilles et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Sinkhorn doubly stochastic attention rank decay analysis

The self-attention mechanism is central to the success of Transformer architectures. However, standard row-stochastic attention has been shown to suffer from significant signal degradation across layers. In particular, it can induce rank collapse, resulting in increasingly uniform token representations, as well as entr...

Michela Lapenna, Rita Fioresi, Bahman Gharesifard · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Neural Global Optimization via Iterative Refinement from Noisy Samples

Global optimization of black-box functions from noisy samples is a fundamental challenge in machine learning and scientific computing. Traditional methods such as Bayesian Optimization often converge to local minima on multi-modal functions, while gradient-free methods require many function evaluations. We present a no...

Qusay Muzaffar, David Levin, Michael Werman · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Federated Mixture-of-Experts Alignment on Mobile Edge Networks under Data Heterogeneity

The growing demand for on-device large language model (LLM) services on mobile edge devices has driven the adoption of Mixture-of-Experts (MoE) architectures, which scale model capacity with limited computation. Since fine-tuning MoE-based LLMs relies on privacy-sensitive local data, federated learning (FL) offers a na...

Zihan Fang, Qianru Wang, Haonan An et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Dual-Modality Multi-Stage Adversarial Safety Training: Robustifying Multimodal Web Agents Against Cross-Modal Attacks

Multimodal web agents that process both screenshots and accessibility trees are increasingly deployed to interact with web interfaces, yet their dual-stream architecture opens an underexplored attack surface: an adversary who injects content into the webpage DOM simultaneously corrupts both observation channels with a...

Haoyu Liu, Dingcheng Li, Lukas Rutishauser et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Fast and Efficient Asynchronous Gossip Algorithm for Robust and Non-Smooth Convex Decentralized Learning

Asynchronous primal-dual methods for decentralized non-smooth convex optimization often require each node to maintain $\mathcal{O}(d)$ auxiliary variables, where $d$ is its degree. This dependence on degree increases memory requirements and can amplify the effects of stale information, especially in dense networks. Mot...

Anna van Elst, Olivier Fercoq, Igor Colin et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Intersectional Fairness via Mixed-Integer Optimization

The deployment of Artificial Intelligence in high-risk domains, such as finance and healthcare, necessitates models that are both fair and transparent. While regulatory frameworks, including the EU's AI Act, mandate bias mitigation, they are deliberately vague about the definition of bias. In line with existing researc...

Ji\v{r}\'i N\v{e}me\v{c}ek, Mark Kozdoba, Illia Kryvoviaz et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Aligning LLMs with Biomedical Knowledge using Balanced Fine-Tuning

Engineering LLMs to accelerate life sciences research requires a robust alignment with biomedical knowledge. We observe that biomedical text exhibits a fundamentally different uncertainty structure from general text: dense low-confidence runs encode epistemic knowledge gaps (dense causal chains, rare entities) rather t...

Zhenchao Tang, Fang Wang, Haohuai He et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Stabilizing Off-Policy Training for Long-Horizon LLM Agent via Turn-Level Importance Sampling and Clipping-Triggered Normalization

Reinforcement learning (RL) algorithms such as PPO and GRPO are widely used to train large language models (LLMs) for multi-turn agentic tasks. However, in off-policy training pipelines, these methods can exhibit unstable optimization dynamics and are prone to perfor- mance collapse. Through empirical analysis, we iden...

Chenliang Li, Adel Elmahdy, Alex Boyd et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Quadratic Direct Forecast for Training Multi-Step Time-Series Forecast Models

The design of learning objectives is central to training time-series forecasting models. Existing learning objectives such as mean squared error mostly treat each future step as an independent, equally weighted task, which leads to the following two challenges: (1) they overlook the label autocorrelation effect among f...

Hao Wang, Licheng Pan, Yuan Lu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

DistDF: Time-Series Forecasting Needs Joint-Distribution Wasserstein Alignment

Training time-series forecasting models requires aligning the conditional distribution of model forecasts with that of the label sequence. The standard direct forecast (DF) approach resorts to minimizing the conditional negative log-likelihood, typically estimated by the mean squared error. However, this estimation pro...

Hao Wang, Licheng Pan, Yuan Lu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Predicting kernel regression learning curves from only raw data statistics

We study kernel regression with common rotation-invariant kernels on real datasets including CIFAR-5m, SVHN, and ImageNet. We give a theoretical framework that predicts learning curves (test risk vs. sample size) from only two measurements: the empirical data covariance matrix and an empirical polynomial decomposition...

Dhruva Karkada, Joseph Turnbull, Yuxi Liu et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.