This work proposes a regularized maximum likelihood framework for simultaneous parameter estimation and feature selection in MoE whose experts belong to the generalized linear model family, covering Gaussian, Poisson and multinomial responses within a single formulation.
Thin Nguyen-Van, Faicel Chamroukhi, Ha Hoang Van et al.· 15 citations
Heterogeneous cardiac signals can mutually supervise a single foundation model of cardiac physiology using a physiology-aware joint-embedding predictive architecture built on a physiology-aware joint-embedding predictive architecture.
Hamza Shafiq, Hung Manh Pham, Bin Zhu et al.· 3 citations· ⚡1
The central result recovers the KL order as the decay rate of the directional Fisher quadratic form approaching the singularity, in original coordinates, without a Hironaka resolution.
This paper develops new variance-reduction techniques for the forward-reflected-backward splitting (FRBS) method to solve a class of possibly nonmonotone stochastic composite inclusions. Unlike unbiased estimators such as mini-batching, developing stochastic biased variants faces a fundamental technical challenge and h...
Quoc Tran-Dinh, Nghia Nguyen-Trung· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This paper offers theoretical insights into when MCR yields a more favorable finite-sample estimation-error upper bound, viewed through the lens of neural network distance, and proposes a novel practical diagnostic that leverages the duality gap and a calibrated drift estimator to infer the potential benefit of MCR tra...
A simple decomposition of a neural-network-based normalizing flow that naturally uncovers a pivotal statistic in the presence of nuisance parameters, based only on a sample generator from the distribution of interest is presented.
Two new nuisances are derived as fixed points of a self-induced Bellman equation, in which they approximate the maximum Bellman operator by its softmax correspondence, and a debiased estimator is proposed through the Neyman orthogonality and established its asymptotic normality under diverging horizons.
Nan Lu, Ethan Lee, James M. Robins et al.· 0 citations
Although probabilistic statements are ubiquitous, foundational disagreements persist about their understanding, as exemplified by debates between Bayesians and frequentists; moreover, it is unclear when and why acting on them actually leads to desirable outcomes. Here, we argue that every probability is the output of a...
We identify a diagonal saturation principle in modal inverse problems: when truncation noise is isotropic, the Bayes-optimal Tikhonov shape is a closed-form power law Gamma_k proportional to lambda_k^|s| set by the prior alone, independent of the domain. Berry's random-wave conjecture decorrelates the truncation noise...
Time series foundation models (TSFMs) are increasingly pre-trained on synthetically generated time series trajectories, where the data generating process is known. Current pre-training recipes are based on loss objectives which compare TSFM outputs to realized future values of each trajectory. We instead propose loss o...
The lower bound holds against any randomized algorithm that succeeds with constant probability and extends to settings with ``sparse''noise, ruling out the possibility of improving oracle complexity as a function of $\varepsilon$ by measuring variance in a non-matching $\ell_p$ norm.
Jelena Diakonikolas, Cristóbal Guzmán, David Martínez-Rubio· 0 citations
We develop Gaussian approximation bounds in higher-order Wasserstein distance $W_p$, $p\geq2$, for sums of multivariate martingale differences generated by a uniformly ergodic Markov chain. Under an $L^{(2+\eta)p}$-moment condition with $\eta>0$, we establish the explicit bound $$ O\left( p^3 \|A\|_4^2 + pd^{1/4}\|A\|_...
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026